Jun 03 15:54:37.214282 ip-10-0-138-89 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 15:54:37.214295 ip-10-0-138-89 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 15:54:37.214302 ip-10-0-138-89 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 15:54:37.214527 ip-10-0-138-89 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 15:54:47.260561 ip-10-0-138-89 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 15:54:47.260579 ip-10-0-138-89 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c31e46aea3b147d39c19f70d0963c20a -- Jun 03 15:57:05.212584 ip-10-0-138-89 systemd[1]: Starting Kubernetes Kubelet... Jun 03 15:57:05.654963 ip-10-0-138-89 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:57:05.654963 ip-10-0-138-89 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 15:57:05.654963 ip-10-0-138-89 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:57:05.654963 ip-10-0-138-89 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 15:57:05.654963 ip-10-0-138-89 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:57:05.656940 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.656770 2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 15:57:05.660671 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660654 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:57:05.660671 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660671 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660678 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660683 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660688 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660699 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660704 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660709 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660713 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660717 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660721 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660725 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660729 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660733 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660737 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660741 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660745 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660750 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660754 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660758 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660762 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:57:05.660810 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660766 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660770 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660775 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660779 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660783 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660788 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660792 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660797 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660802 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660806 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660810 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660814 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660818 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660822 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660826 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660830 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660834 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660839 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660843 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660848 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:57:05.661581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660852 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660856 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660860 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660864 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660868 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660872 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660876 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660882 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660886 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660890 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660894 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660898 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660902 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660906 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660912 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660916 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660921 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660926 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660930 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660934 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:57:05.662334 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660938 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660942 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660946 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660950 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660954 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660958 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660962 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660967 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660971 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.660975 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.661035 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.661083 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.661089 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.661095 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.661100 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.661108 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.661113 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.661118 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.661123 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:57:05.663070 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.661130 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.661136 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.661141 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.661153 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.661158 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.662681 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663434 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663446 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663449 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663452 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663456 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663458 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663461 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663464 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663467 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663469 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663472 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663475 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663477 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663479 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:57:05.663642 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663482 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663485 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663487 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663490 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663493 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663496 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663498 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663501 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663504 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663507 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663509 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663511 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663514 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663516 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663519 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663521 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663524 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663526 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663529 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:57:05.664155 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663532 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663535 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663537 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663540 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663542 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663545 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663549 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663553 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663555 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663559 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663563 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663566 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663570 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663573 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663576 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663579 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663582 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663584 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663587 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:57:05.664653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663590 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663592 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663595 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663598 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663601 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663603 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663606 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663609 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663611 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663614 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663616 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663619 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663622 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663626 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663629 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663632 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663635 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663638 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663641 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663644 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:57:05.665120 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663647 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663649 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663652 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663655 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663658 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663661 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663664 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663666 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663669 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663672 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663674 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663677 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663679 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.663681 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664391 2575 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664401 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664411 2575 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664416 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664421 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664424 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664428 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 15:57:05.665641 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664433 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664437 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664444 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664448 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664451 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664455 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664458 2575 flags.go:64] FLAG: --cgroup-root="" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664461 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664464 2575 flags.go:64] FLAG: --client-ca-file="" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664467 2575 flags.go:64] FLAG: --cloud-config="" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664470 2575 flags.go:64] FLAG: --cloud-provider="external" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664473 2575 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664478 2575 flags.go:64] FLAG: --cluster-domain="" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664481 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664483 2575 flags.go:64] FLAG: --config-dir="" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664486 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664490 2575 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664493 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664496 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664500 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664503 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664506 2575 flags.go:64] FLAG: --contention-profiling="false" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664509 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664513 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664516 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 15:57:05.666171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664519 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664523 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664527 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664530 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664532 2575 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664535 2575 flags.go:64] FLAG: --enable-server="true" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664539 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664543 2575 flags.go:64] FLAG: --event-burst="100" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664546 2575 flags.go:64] FLAG: --event-qps="50" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664549 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664553 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664556 2575 flags.go:64] FLAG: --eviction-hard="" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664560 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664564 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664567 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664570 2575 flags.go:64] FLAG: --eviction-soft="" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664573 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664576 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664579 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664582 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664585 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664588 2575 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664591 2575 flags.go:64] FLAG: --feature-gates="" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664595 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664598 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 15:57:05.666791 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664601 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664604 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664607 2575 flags.go:64] FLAG: --healthz-port="10248" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664610 2575 flags.go:64] FLAG: --help="false" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664613 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-138-89.ec2.internal" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664617 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664620 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664622 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664626 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664629 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664632 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664635 2575 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664638 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664641 2575 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664644 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664647 2575 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664650 2575 flags.go:64] FLAG: --kube-reserved="" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664653 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664657 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664660 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664663 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664666 2575 flags.go:64] FLAG: --lock-file="" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664669 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664672 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 15:57:05.667422 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664676 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664681 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664685 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664687 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664690 2575 flags.go:64] FLAG: --logging-format="text" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664693 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664697 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664700 2575 flags.go:64] FLAG: --manifest-url="" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664703 2575 flags.go:64] FLAG: --manifest-url-header="" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664708 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664711 2575 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664715 2575 flags.go:64] FLAG: --max-pods="110" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664718 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664722 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664724 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664727 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664730 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664733 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664736 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664743 2575 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664746 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664749 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664752 2575 flags.go:64] FLAG: --pod-cidr="" Jun 03 15:57:05.668034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664755 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664760 2575 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664767 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664770 2575 flags.go:64] FLAG: --pods-per-core="0" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664774 2575 flags.go:64] FLAG: --port="10250" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664777 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664780 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c5c9936fe531ea13" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664783 2575 flags.go:64] FLAG: --qos-reserved="" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664786 2575 flags.go:64] FLAG: --read-only-port="10255" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664789 2575 flags.go:64] FLAG: --register-node="true" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664791 2575 flags.go:64] FLAG: --register-schedulable="true" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664794 2575 flags.go:64] FLAG: --register-with-taints="" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664798 2575 flags.go:64] FLAG: --registry-burst="10" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664801 2575 flags.go:64] FLAG: --registry-qps="5" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664804 2575 flags.go:64] FLAG: --reserved-cpus="" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664807 2575 flags.go:64] FLAG: --reserved-memory="" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664810 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664813 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664816 2575 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664819 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664822 2575 flags.go:64] FLAG: --runonce="false" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664825 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664828 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664831 2575 flags.go:64] FLAG: --seccomp-default="false" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664834 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664837 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 15:57:05.668625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664840 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664843 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664846 2575 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664849 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664852 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664854 2575 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664857 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664860 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664865 2575 flags.go:64] FLAG: --system-cgroups="" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664868 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664874 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664877 2575 flags.go:64] FLAG: --tls-cert-file="" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664880 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664885 2575 flags.go:64] FLAG: --tls-min-version="" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664887 2575 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664890 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664893 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664896 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664899 2575 flags.go:64] FLAG: --v="2" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664903 2575 flags.go:64] FLAG: --version="false" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664907 2575 flags.go:64] FLAG: --vmodule="" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664911 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.664914 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665000 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665004 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:57:05.669332 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665007 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665010 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665013 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665016 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665018 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665021 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665023 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665026 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665029 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665032 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665034 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665037 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665039 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665042 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665044 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665048 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665051 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665053 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665056 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665062 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:57:05.669940 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665064 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665067 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665069 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665072 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665076 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665080 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665083 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665086 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665089 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665092 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665094 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665097 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665099 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665102 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665105 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665107 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665110 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665112 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665115 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:57:05.670467 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665118 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665121 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665123 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665126 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665128 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665131 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665134 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665136 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665141 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665145 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665148 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665151 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665153 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665161 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665164 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665167 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665170 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665173 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665175 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:57:05.670947 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665178 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665181 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665183 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665186 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665188 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665191 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665193 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665195 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665198 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665204 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665207 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665209 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665212 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665214 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665217 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665219 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665222 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665225 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665228 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665230 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665233 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:57:05.671442 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665235 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:57:05.671959 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665238 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:57:05.671959 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665241 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:57:05.671959 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665243 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:57:05.671959 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.665246 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:57:05.671959 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.666116 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:57:05.673520 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.673500 2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 15:57:05.673558 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.673521 2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 15:57:05.673597 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673575 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:57:05.673597 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673580 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:57:05.673597 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673584 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:57:05.673597 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673587 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:57:05.673597 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673590 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:57:05.673597 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673593 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:57:05.673597 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673596 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:57:05.673597 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673599 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:57:05.673597 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673602 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673605 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673607 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673610 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673613 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673615 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673619 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673624 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673626 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673629 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673632 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673635 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673638 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673640 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673643 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673646 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673648 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673651 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673653 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:57:05.673819 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673656 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673658 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673661 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673665 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673667 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673670 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673673 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673675 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673678 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673681 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673683 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673686 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673688 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673691 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673693 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673697 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673700 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673702 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673705 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673708 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:57:05.674305 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673711 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673713 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673716 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673719 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673721 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673724 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673726 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673729 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673731 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673734 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673736 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673738 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673741 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673744 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673747 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673749 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673752 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673755 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673757 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673760 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:57:05.674799 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673762 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673766 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673770 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673773 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673776 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673778 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673781 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673784 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673787 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673790 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673793 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673796 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673798 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673801 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673803 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673806 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673809 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673811 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:57:05.675287 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673814 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:57:05.675750 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.673819 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:57:05.675750 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673933 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:57:05.675750 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673938 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:57:05.675750 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673942 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:57:05.675750 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673945 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:57:05.675750 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673949 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:57:05.675750 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673952 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:57:05.675750 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673955 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:57:05.675750 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673958 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:57:05.675750 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673961 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:57:05.675750 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673971 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:57:05.675750 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673974 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:57:05.675750 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673977 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:57:05.675750 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673980 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:57:05.675750 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673982 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673985 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673988 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673991 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673993 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673996 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.673999 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674002 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674005 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674007 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674010 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674013 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674015 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674019 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674022 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674024 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674027 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674030 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674032 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:57:05.676113 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674034 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674037 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674039 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674042 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674044 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674047 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674049 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674052 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674054 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674057 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674073 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674076 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674080 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674083 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674086 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674088 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674091 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674094 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674097 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674100 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:57:05.676581 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674103 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674105 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674108 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674110 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674113 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674115 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674118 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674120 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674123 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674125 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674128 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674130 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674133 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674135 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674138 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674140 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674143 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674145 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674148 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674150 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:57:05.677065 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674153 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:57:05.677593 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674155 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:57:05.677593 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674158 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:57:05.677593 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674160 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:57:05.677593 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674163 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:57:05.677593 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674165 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:57:05.677593 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674168 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:57:05.677593 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674170 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:57:05.677593 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674173 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:57:05.677593 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674176 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:57:05.677593 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674178 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:57:05.677593 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674181 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:57:05.677593 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674183 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:57:05.677593 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:05.674186 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:57:05.677593 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.674191 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:57:05.677593 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.675038 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 15:57:05.679487 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.679474 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 15:57:05.680739 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.680728 2575 server.go:1019] "Starting client certificate rotation" Jun 03 15:57:05.680839 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.680824 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:57:05.680867 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.680858 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:57:05.706706 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.706688 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:57:05.708669 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.708651 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:57:05.723609 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.723588 2575 log.go:25] "Validated CRI v1 runtime API" Jun 03 15:57:05.728928 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.728912 2575 log.go:25] "Validated CRI v1 image API" Jun 03 15:57:05.730335 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.730322 2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 15:57:05.736510 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.735876 2575 fs.go:135] Filesystem UUIDs: map[738b28e7-972b-4636-847f-70a169405914:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 afd1d9dd-5880-4565-bd17-87a60cebc6a2:/dev/nvme0n1p3] Jun 03 15:57:05.736599 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.736508 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 15:57:05.738463 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.738444 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:57:05.740756 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.740651 2575 manager.go:217] Machine: {Timestamp:2026-06-03 15:57:05.740115138 +0000 UTC m=+0.407502196 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3123960 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20139d176d014101a0ae19308ea547 SystemUUID:ec20139d-176d-0141-01a0-ae19308ea547 BootID:c31e46ae-a3b1-47d3-9c19-f70d0963c20a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bb:e1:5c:85:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bb:e1:5c:85:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:e7:8a:ad:41:16 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 15:57:05.740756 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.740753 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 15:57:05.740852 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.740830 2575 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 15:57:05.743380 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.743335 2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 15:57:05.743551 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.743383 2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-89.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 15:57:05.744098 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.744086 2575 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 15:57:05.744151 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.744105 2575 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 15:57:05.744151 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.744116 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:57:05.744861 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.744848 2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:57:05.746446 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.746432 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:57:05.746590 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.746578 2575 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 15:57:05.749122 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.749110 2575 kubelet.go:491] "Attempting to sync node with API server" Jun 03 15:57:05.749188 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.749130 2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 15:57:05.749188 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.749148 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 15:57:05.749188 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.749163 2575 kubelet.go:397] "Adding apiserver pod source" Jun 03 15:57:05.749188 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.749178 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 15:57:05.750320 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.750307 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:57:05.750403 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.750330 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:57:05.753521 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.753498 2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 15:57:05.755671 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.755656 2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 15:57:05.758657 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.758642 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 15:57:05.758657 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.758659 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 15:57:05.758758 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.758665 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 15:57:05.758758 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.758670 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 15:57:05.758758 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.758678 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 15:57:05.758758 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.758684 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 15:57:05.758758 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.758691 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 15:57:05.758758 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.758712 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 15:57:05.758758 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.758720 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 15:57:05.758758 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.758725 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 15:57:05.758758 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.758743 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 15:57:05.758758 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.758749 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 15:57:05.759464 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.759455 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 15:57:05.759464 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.759464 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 15:57:05.762590 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.762575 2575 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 15:57:05.762666 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.762607 2575 server.go:1295] "Started kubelet" Jun 03 15:57:05.762726 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.762689 2575 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-89.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 15:57:05.762784 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:05.762722 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-89.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 15:57:05.762784 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:05.762724 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 15:57:05.763796 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.762738 2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 15:57:05.763895 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.763832 2575 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 15:57:05.764505 ip-10-0-138-89 systemd[1]: Started Kubernetes Kubelet. Jun 03 15:57:05.765094 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.764737 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 15:57:05.765203 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.765177 2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 15:57:05.769099 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.769085 2575 server.go:317] "Adding debug handlers to kubelet server" Jun 03 15:57:05.771049 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.771031 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 15:57:05.771129 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.771032 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 15:57:05.771325 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.771237 2575 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 15:57:05.771325 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.771252 2575 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 15:57:05.771478 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.771368 2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 15:57:05.771478 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.771470 2575 reconstruct.go:97] "Volume reconstruction finished" Jun 03 15:57:05.771561 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.771480 2575 reconciler.go:26] "Reconciler: start to sync state" Jun 03 15:57:05.772204 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:05.772179 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found" Jun 03 15:57:05.773410 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.773394 2575 factory.go:55] Registering systemd factory Jun 03 15:57:05.773509 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.773499 2575 factory.go:223] Registration of the systemd container factory successfully Jun 03 15:57:05.773677 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:05.773651 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-89.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 15:57:05.773748 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:05.773736 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 15:57:05.774213 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.774197 2575 factory.go:153] Registering CRI-O factory Jun 03 15:57:05.774298 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.774217 2575 factory.go:223] Registration of the crio container factory successfully Jun 03 15:57:05.774298 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.774285 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 15:57:05.774394 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.774304 2575 factory.go:103] Registering Raw factory Jun 03 15:57:05.774394 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.774318 2575 manager.go:1196] Started watching for new ooms in manager Jun 03 15:57:05.774615 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:05.773665 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-89.ec2.internal.18b59d57405f13a8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-89.ec2.internal,UID:ip-10-0-138-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-89.ec2.internal,},FirstTimestamp:2026-06-03 15:57:05.76258756 +0000 UTC m=+0.429974597,LastTimestamp:2026-06-03 15:57:05.76258756 +0000 UTC m=+0.429974597,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-89.ec2.internal,}" Jun 03 15:57:05.775742 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.775720 2575 manager.go:319] Starting recovery of all containers Jun 03 15:57:05.776698 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:05.776619 2575 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 15:57:05.785878 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.785864 2575 manager.go:324] Recovery completed Jun 03 15:57:05.790361 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.790231 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:57:05.792392 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.792368 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:57:05.792475 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.792405 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:57:05.792475 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.792415 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:57:05.792935 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.792923 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 15:57:05.792935 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.792932 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 15:57:05.793056 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.792962 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:57:05.793167 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.793149 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dqc6l" Jun 03 15:57:05.794542 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:05.794476 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-89.ec2.internal.18b59d574225da9c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-89.ec2.internal,UID:ip-10-0-138-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-89.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-89.ec2.internal,},FirstTimestamp:2026-06-03 15:57:05.792391836 +0000 UTC m=+0.459778874,LastTimestamp:2026-06-03 15:57:05.792391836 +0000 UTC m=+0.459778874,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-89.ec2.internal,}" Jun 03 15:57:05.796033 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.796023 2575 policy_none.go:49] "None policy: Start" Jun 03 15:57:05.796075 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.796038 2575 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 15:57:05.796075 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.796049 2575 state_mem.go:35] "Initializing new in-memory state store" Jun 03 15:57:05.802545 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.802525 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dqc6l" Jun 03 15:57:05.803547 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:05.803476 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-89.ec2.internal.18b59d574226213e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-89.ec2.internal,UID:ip-10-0-138-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-89.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-89.ec2.internal,},FirstTimestamp:2026-06-03 15:57:05.792409918 +0000 UTC m=+0.459796956,LastTimestamp:2026-06-03 15:57:05.792409918 +0000 UTC m=+0.459796956,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-89.ec2.internal,}" Jun 03 15:57:05.836819 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.836802 2575 manager.go:341] "Starting Device Plugin manager" Jun 03 15:57:05.850927 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:05.836841 2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 15:57:05.850927 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.836854 2575 server.go:85] "Starting device plugin registration server" Jun 03 15:57:05.850927 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.837109 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 15:57:05.850927 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.837130 2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 15:57:05.850927 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.837216 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 15:57:05.850927 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.837317 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 15:57:05.850927 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.837326 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 15:57:05.850927 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:05.837846 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 15:57:05.850927 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:05.837887 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-89.ec2.internal\" not found" Jun 03 15:57:05.867191 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.867161 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 15:57:05.868336 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.868321 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 15:57:05.868336 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.868339 2575 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 15:57:05.868483 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.868358 2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 15:57:05.868483 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.868368 2575 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 15:57:05.868483 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:05.868408 2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 15:57:05.871912 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.871897 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:57:05.938113 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.938025 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:57:05.939003 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.938987 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:57:05.939086 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.939023 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:57:05.939086 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.939038 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:57:05.939086 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.939069 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-89.ec2.internal" Jun 03 15:57:05.946342 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.946326 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-89.ec2.internal" Jun 03 15:57:05.946436 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:05.946349 2575 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-89.ec2.internal\": node \"ip-10-0-138-89.ec2.internal\" not found" Jun 03 15:57:05.963726 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:05.963701 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found" Jun 03 15:57:05.968947 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.968930 2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal"] Jun 03 15:57:05.969002 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.968992 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:57:05.971093 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.971076 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:57:05.971180 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.971110 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:57:05.971180 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.971124 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:57:05.972516 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.972501 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:57:05.972676 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.972662 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal" Jun 03 15:57:05.972725 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.972691 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:57:05.973223 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.973209 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:57:05.973306 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.973230 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:57:05.973306 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.973236 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:57:05.973306 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.973251 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:57:05.973306 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.973255 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:57:05.973306 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.973292 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:57:05.974479 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.974464 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal" Jun 03 15:57:05.974556 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.974491 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:57:05.975138 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.975124 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:57:05.975200 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.975150 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:57:05.975200 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:05.975168 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:57:05.993836 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:05.993818 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-89.ec2.internal\" not found" node="ip-10-0-138-89.ec2.internal" Jun 03 15:57:05.997034 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:05.997017 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-89.ec2.internal\" not found" node="ip-10-0-138-89.ec2.internal" Jun 03 15:57:06.064004 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:06.063969 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found" Jun 03 15:57:06.072977 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.072954 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c95e50355c69747b9db9acb3a2905f92-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal\" (UID: \"c95e50355c69747b9db9acb3a2905f92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal" Jun 03 15:57:06.073056 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.072984 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c95e50355c69747b9db9acb3a2905f92-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal\" (UID: \"c95e50355c69747b9db9acb3a2905f92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal" Jun 03 15:57:06.073056 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.073006 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d78abd18259f21ae1cd5ff6d8347d3c9-config\") pod \"kube-apiserver-proxy-ip-10-0-138-89.ec2.internal\" (UID: \"d78abd18259f21ae1cd5ff6d8347d3c9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal" Jun 03 15:57:06.164171 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:06.164127 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found" Jun 03 15:57:06.173472 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.173447 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c95e50355c69747b9db9acb3a2905f92-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal\" (UID: \"c95e50355c69747b9db9acb3a2905f92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal" Jun 03 15:57:06.173542 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.173478 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c95e50355c69747b9db9acb3a2905f92-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal\" (UID: \"c95e50355c69747b9db9acb3a2905f92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal" Jun 03 15:57:06.173542 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.173496 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d78abd18259f21ae1cd5ff6d8347d3c9-config\") pod \"kube-apiserver-proxy-ip-10-0-138-89.ec2.internal\" (UID: \"d78abd18259f21ae1cd5ff6d8347d3c9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal" Jun 03 15:57:06.173542 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.173535 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d78abd18259f21ae1cd5ff6d8347d3c9-config\") pod \"kube-apiserver-proxy-ip-10-0-138-89.ec2.internal\" (UID: \"d78abd18259f21ae1cd5ff6d8347d3c9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal" Jun 03 15:57:06.173666 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.173563 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c95e50355c69747b9db9acb3a2905f92-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal\" (UID: \"c95e50355c69747b9db9acb3a2905f92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal" Jun 03 15:57:06.173666 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.173564 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c95e50355c69747b9db9acb3a2905f92-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal\" (UID: \"c95e50355c69747b9db9acb3a2905f92\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal" Jun 03 15:57:06.264912 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:06.264825 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found" Jun 03 15:57:06.296345 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.296317 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal" Jun 03 15:57:06.300076 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.300059 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal" Jun 03 15:57:06.365781 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:06.365728 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found" Jun 03 15:57:06.466298 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:06.466251 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found" Jun 03 15:57:06.566879 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:06.566803 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found" Jun 03 15:57:06.667344 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:06.667313 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found" Jun 03 15:57:06.680742 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.680716 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 15:57:06.680874 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.680851 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 15:57:06.767988 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:06.767962 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found" Jun 03 15:57:06.771151 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.771135 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 15:57:06.783986 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:06.783947 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd78abd18259f21ae1cd5ff6d8347d3c9.slice/crio-001e765b02946e46bfd025f47aa65922a0f4b789dfd2d90f98c34581526b5ade WatchSource:0}: Error finding container 001e765b02946e46bfd025f47aa65922a0f4b789dfd2d90f98c34581526b5ade: Status 404 returned error can't find the container with id 001e765b02946e46bfd025f47aa65922a0f4b789dfd2d90f98c34581526b5ade Jun 03 15:57:06.787515 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:06.787498 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc95e50355c69747b9db9acb3a2905f92.slice/crio-21705935cd7caed0faae8a6a1c220eec761f8e8520b2f16a6ebb08cee9f3bcb2 WatchSource:0}: Error finding container 21705935cd7caed0faae8a6a1c220eec761f8e8520b2f16a6ebb08cee9f3bcb2: Status 404 returned error can't find the container with id 21705935cd7caed0faae8a6a1c220eec761f8e8520b2f16a6ebb08cee9f3bcb2 Jun 03 15:57:06.790438 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.790379 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:57:06.790950 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.790925 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:57:06.804973 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.804939 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 15:52:05 +0000 UTC" deadline="2028-03-17 13:38:00.11349655 +0000 UTC" Jun 03 15:57:06.804973 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.804972 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15669h40m53.308528165s" Jun 03 15:57:06.812693 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.812678 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5g6sq" Jun 03 15:57:06.821255 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.821215 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5g6sq" Jun 03 15:57:06.868624 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:06.868597 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found" Jun 03 15:57:06.871377 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.871335 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal" event={"ID":"c95e50355c69747b9db9acb3a2905f92","Type":"ContainerStarted","Data":"21705935cd7caed0faae8a6a1c220eec761f8e8520b2f16a6ebb08cee9f3bcb2"} Jun 03 15:57:06.872168 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.872150 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal" event={"ID":"d78abd18259f21ae1cd5ff6d8347d3c9","Type":"ContainerStarted","Data":"001e765b02946e46bfd025f47aa65922a0f4b789dfd2d90f98c34581526b5ade"} Jun 03 15:57:06.969528 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:06.969502 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found" Jun 03 15:57:06.991711 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:06.990532 2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:57:07.070568 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:07.070526 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found" Jun 03 15:57:07.096575 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.096500 2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:57:07.171632 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:07.171601 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found" Jun 03 15:57:07.272186 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:07.272156 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-89.ec2.internal\" not found" Jun 03 15:57:07.307821 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.307794 2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:57:07.371924 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.371820 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal" Jun 03 15:57:07.387139 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.387114 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:57:07.388113 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.388095 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal" Jun 03 15:57:07.397886 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.397858 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:57:07.750855 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.750777 2575 apiserver.go:52] "Watching apiserver" Jun 03 15:57:07.756692 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.756654 2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 15:57:07.758008 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.757978 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd","openshift-cluster-node-tuning-operator/tuned-22mgv","openshift-dns/node-resolver-96gss","openshift-multus/multus-additional-cni-plugins-wsfnl","openshift-multus/network-metrics-daemon-6h6md","openshift-network-operator/iptables-alerter-r6t4v","openshift-ovn-kubernetes/ovnkube-node-vfbq8","kube-system/global-pull-secret-syncer-dhw9d","kube-system/konnectivity-agent-cmm55","openshift-image-registry/node-ca-rx47m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal","openshift-multus/multus-qf7wr","openshift-network-diagnostics/network-check-target-hm4zx","kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal"] Jun 03 15:57:07.760951 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.760926 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.761349 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.761325 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.762526 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.762504 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:07.762633 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:07.762605 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h6md" podUID="6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd" Jun 03 15:57:07.764193 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.763856 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.764580 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.764545 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 15:57:07.764580 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.764574 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 15:57:07.764728 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.764715 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 15:57:07.764785 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.764729 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 15:57:07.764785 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.764756 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hw7js\"" Jun 03 15:57:07.765056 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.764930 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 15:57:07.765056 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.764941 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 15:57:07.765056 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.764993 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m2pmc\"" Jun 03 15:57:07.766377 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.766358 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-96gss" Jun 03 15:57:07.766876 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.766657 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 15:57:07.767737 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.767106 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 15:57:07.767737 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.767207 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 15:57:07.767737 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.767386 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 15:57:07.767737 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.767491 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k276t\"" Jun 03 15:57:07.767737 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.767632 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 15:57:07.768034 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.767744 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 15:57:07.768504 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.768486 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 15:57:07.769294 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.768717 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r6t4v" Jun 03 15:57:07.769294 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.768765 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.769294 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.768864 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 15:57:07.769294 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.769131 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j92gh\"" Jun 03 15:57:07.772437 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.771571 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 15:57:07.772437 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.771625 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 15:57:07.772437 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.771674 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 15:57:07.772437 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.771575 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 15:57:07.772622 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.772528 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5l67q\"" Jun 03 15:57:07.773171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.772715 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:57:07.773171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.773161 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 15:57:07.773942 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.773835 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cmm55" Jun 03 15:57:07.774501 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.774247 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rx47m" Jun 03 15:57:07.774657 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.774638 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bs6tp\"" Jun 03 15:57:07.776177 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.776062 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gfs7v\"" Jun 03 15:57:07.777384 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.777176 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 15:57:07.777488 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.777407 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 15:57:07.777488 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.777422 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 15:57:07.777830 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.777811 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 15:57:07.777926 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.777856 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2pwg8\"" Jun 03 15:57:07.777926 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.777811 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 15:57:07.779131 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.778511 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.779932 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.779909 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:07.780039 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:07.779976 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhw9d" podUID="8005fb8c-13cc-491f-bdb3-80744ed6306c" Jun 03 15:57:07.780212 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.780198 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:07.780603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.780574 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 15:57:07.780691 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:07.780639 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm4zx" podUID="b55f5a62-2148-45e4-a39e-c1dcd628aa44" Jun 03 15:57:07.781145 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.780878 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:57:07.781145 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.780898 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nth2g\"" Jun 03 15:57:07.783607 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.783586 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-device-dir\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.783711 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.783622 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-var-lib-kubelet\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.783711 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.783650 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd98e600-3aa6-4647-be14-6b3a72074ed7-ovn-node-metrics-cert\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.783711 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.783675 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-cnibin\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.783711 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.783699 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-hostroot\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.783914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.783722 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42d28413-02d0-4f2f-adc2-4c08b3f0419d-multus-daemon-config\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.783914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.783766 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-run-ovn\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.783914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.783799 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/499fcfa6-bfea-4f27-8adc-a52a14c799b7-iptables-alerter-script\") pod \"iptables-alerter-r6t4v\" (UID: \"499fcfa6-bfea-4f27-8adc-a52a14c799b7\") " pod="openshift-network-operator/iptables-alerter-r6t4v" Jun 03 15:57:07.783914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.783824 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-run-multus-certs\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.783914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.783848 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.783914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.783877 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-run-ovn-kubernetes\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.784191 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.783923 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/983ee38c-b506-4ac9-b241-37b0292bad9d-konnectivity-ca\") pod \"konnectivity-agent-cmm55\" (UID: \"983ee38c-b506-4ac9-b241-37b0292bad9d\") " pod="kube-system/konnectivity-agent-cmm55" Jun 03 15:57:07.784191 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.783951 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-system-cni-dir\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.784191 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.783975 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42d28413-02d0-4f2f-adc2-4c08b3f0419d-cni-binary-copy\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.784191 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs\") pod \"network-metrics-daemon-6h6md\" (UID: \"6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd\") " pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:07.784191 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784022 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-etc-openvswitch\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.784191 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784067 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd98e600-3aa6-4647-be14-6b3a72074ed7-env-overrides\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.784191 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784102 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/773fe981-eb8d-4ad7-8434-78168e05801d-serviceca\") pod \"node-ca-rx47m\" (UID: \"773fe981-eb8d-4ad7-8434-78168e05801d\") " pod="openshift-image-registry/node-ca-rx47m" Jun 03 15:57:07.784191 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784129 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-system-cni-dir\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.784191 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-os-release\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.784191 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784176 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-var-lib-openvswitch\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.784661 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784213 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzc8q\" (UniqueName: \"kubernetes.io/projected/cd98e600-3aa6-4647-be14-6b3a72074ed7-kube-api-access-pzc8q\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.784661 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784289 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e98840fb-b4bc-48f4-b044-c91aa26a528b-hosts-file\") pod \"node-resolver-96gss\" (UID: \"e98840fb-b4bc-48f4-b044-c91aa26a528b\") " pod="openshift-dns/node-resolver-96gss" Jun 03 15:57:07.784661 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784323 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.784661 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784349 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-var-lib-cni-bin\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.784661 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784374 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-os-release\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.784661 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784398 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.784661 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784424 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-run-openvswitch\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.784661 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784447 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-socket-dir\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.784661 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784472 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skqz7\" (UniqueName: \"kubernetes.io/projected/790580c1-afa7-4c35-853d-4fd9f45561cd-kube-api-access-skqz7\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.784661 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784495 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-multus-cni-dir\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.784661 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-systemd-units\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.784661 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784536 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdfw4\" (UniqueName: \"kubernetes.io/projected/499fcfa6-bfea-4f27-8adc-a52a14c799b7-kube-api-access-cdfw4\") pod \"iptables-alerter-r6t4v\" (UID: \"499fcfa6-bfea-4f27-8adc-a52a14c799b7\") " pod="openshift-network-operator/iptables-alerter-r6t4v" Jun 03 15:57:07.784661 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784560 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-cnibin\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.784661 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784595 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-etc-kubernetes\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.784661 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784630 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd98e600-3aa6-4647-be14-6b3a72074ed7-ovnkube-config\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.784661 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784659 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/983ee38c-b506-4ac9-b241-37b0292bad9d-agent-certs\") pod \"konnectivity-agent-cmm55\" (UID: \"983ee38c-b506-4ac9-b241-37b0292bad9d\") " pod="kube-system/konnectivity-agent-cmm55" Jun 03 15:57:07.785397 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784684 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-run-netns\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.785397 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784706 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-node-log\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.785397 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784730 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-cni-netd\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.785397 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784754 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-sys-fs\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.785397 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784783 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-cni-binary-copy\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.785397 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784799 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glbgl\" (UniqueName: \"kubernetes.io/projected/42d28413-02d0-4f2f-adc2-4c08b3f0419d-kube-api-access-glbgl\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.785397 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784816 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-run-systemd\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.785397 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784878 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.785397 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784911 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-slash\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.785397 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784935 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e98840fb-b4bc-48f4-b044-c91aa26a528b-tmp-dir\") pod \"node-resolver-96gss\" (UID: \"e98840fb-b4bc-48f4-b044-c91aa26a528b\") " pod="openshift-dns/node-resolver-96gss" Jun 03 15:57:07.785397 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-registration-dir\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.785397 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.784983 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-cni-bin\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.785397 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.785007 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.785397 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.785031 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-multus-socket-dir-parent\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.785397 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.785058 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-run-netns\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.785397 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.785098 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-var-lib-cni-multus\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.786107 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.785129 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/499fcfa6-bfea-4f27-8adc-a52a14c799b7-host-slash\") pod \"iptables-alerter-r6t4v\" (UID: \"499fcfa6-bfea-4f27-8adc-a52a14c799b7\") " pod="openshift-network-operator/iptables-alerter-r6t4v" Jun 03 15:57:07.786107 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.785166 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/773fe981-eb8d-4ad7-8434-78168e05801d-host\") pod \"node-ca-rx47m\" (UID: \"773fe981-eb8d-4ad7-8434-78168e05801d\") " pod="openshift-image-registry/node-ca-rx47m" Jun 03 15:57:07.786107 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.785190 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln9jd\" (UniqueName: \"kubernetes.io/projected/773fe981-eb8d-4ad7-8434-78168e05801d-kube-api-access-ln9jd\") pod \"node-ca-rx47m\" (UID: \"773fe981-eb8d-4ad7-8434-78168e05801d\") " pod="openshift-image-registry/node-ca-rx47m" Jun 03 15:57:07.786107 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.785213 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-run-k8s-cni-cncf-io\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.786107 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.785242 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.786107 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.785286 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxp2f\" (UniqueName: \"kubernetes.io/projected/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-kube-api-access-fxp2f\") pod \"network-metrics-daemon-6h6md\" (UID: \"6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd\") " pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:07.786107 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.785309 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-kubelet\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.786107 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.785333 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-log-socket\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.786107 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.785372 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd98e600-3aa6-4647-be14-6b3a72074ed7-ovnkube-script-lib\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.786107 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.785409 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd2vp\" (UniqueName: \"kubernetes.io/projected/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-kube-api-access-bd2vp\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.786107 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.785433 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-multus-conf-dir\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.786107 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.785473 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fwkr\" (UniqueName: \"kubernetes.io/projected/e98840fb-b4bc-48f4-b044-c91aa26a528b-kube-api-access-9fwkr\") pod \"node-resolver-96gss\" (UID: \"e98840fb-b4bc-48f4-b044-c91aa26a528b\") " pod="openshift-dns/node-resolver-96gss" Jun 03 15:57:07.821939 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.821905 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 15:52:06 +0000 UTC" deadline="2027-12-21 11:00:11.264837392 +0000 UTC" Jun 03 15:57:07.822059 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.821939 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13579h3m3.44290148s" Jun 03 15:57:07.874253 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.874224 2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 15:57:07.886480 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.886454 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/499fcfa6-bfea-4f27-8adc-a52a14c799b7-iptables-alerter-script\") pod \"iptables-alerter-r6t4v\" (UID: \"499fcfa6-bfea-4f27-8adc-a52a14c799b7\") " pod="openshift-network-operator/iptables-alerter-r6t4v" Jun 03 15:57:07.886480 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.886483 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-run-multus-certs\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.886665 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.886506 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.886665 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.886527 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-run-ovn-kubernetes\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.886665 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.886550 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/983ee38c-b506-4ac9-b241-37b0292bad9d-konnectivity-ca\") pod \"konnectivity-agent-cmm55\" (UID: \"983ee38c-b506-4ac9-b241-37b0292bad9d\") " pod="kube-system/konnectivity-agent-cmm55" Jun 03 15:57:07.886665 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.886574 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-system-cni-dir\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.886665 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.886577 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.886665 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.886598 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42d28413-02d0-4f2f-adc2-4c08b3f0419d-cni-binary-copy\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.886665 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.886570 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-run-multus-certs\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.886665 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.886610 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-run-ovn-kubernetes\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.886665 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.886622 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs\") pod \"network-metrics-daemon-6h6md\" (UID: \"6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd\") " pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:07.886665 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.886629 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-system-cni-dir\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.887126 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.886672 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-etc-openvswitch\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.887126 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.886741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8005fb8c-13cc-491f-bdb3-80744ed6306c-dbus\") pod \"global-pull-secret-syncer-dhw9d\" (UID: \"8005fb8c-13cc-491f-bdb3-80744ed6306c\") " pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:07.887126 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.886769 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd98e600-3aa6-4647-be14-6b3a72074ed7-env-overrides\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.887126 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:07.886794 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:57:07.887126 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.886796 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/773fe981-eb8d-4ad7-8434-78168e05801d-serviceca\") pod \"node-ca-rx47m\" (UID: \"773fe981-eb8d-4ad7-8434-78168e05801d\") " pod="openshift-image-registry/node-ca-rx47m" Jun 03 15:57:07.887126 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887048 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/499fcfa6-bfea-4f27-8adc-a52a14c799b7-iptables-alerter-script\") pod \"iptables-alerter-r6t4v\" (UID: \"499fcfa6-bfea-4f27-8adc-a52a14c799b7\") " pod="openshift-network-operator/iptables-alerter-r6t4v" Jun 03 15:57:07.887126 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887111 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-system-cni-dir\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.887479 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887136 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-os-release\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.887479 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887151 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/983ee38c-b506-4ac9-b241-37b0292bad9d-konnectivity-ca\") pod \"konnectivity-agent-cmm55\" (UID: \"983ee38c-b506-4ac9-b241-37b0292bad9d\") " pod="kube-system/konnectivity-agent-cmm55" Jun 03 15:57:07.887479 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887163 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-var-lib-openvswitch\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.887479 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887179 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd98e600-3aa6-4647-be14-6b3a72074ed7-env-overrides\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.887479 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887202 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzc8q\" (UniqueName: \"kubernetes.io/projected/cd98e600-3aa6-4647-be14-6b3a72074ed7-kube-api-access-pzc8q\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.887479 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887205 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-var-lib-openvswitch\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.887479 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887229 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-etc-openvswitch\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.887479 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887247 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-os-release\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.887479 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887308 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e98840fb-b4bc-48f4-b044-c91aa26a528b-hosts-file\") pod \"node-resolver-96gss\" (UID: \"e98840fb-b4bc-48f4-b044-c91aa26a528b\") " pod="openshift-dns/node-resolver-96gss" Jun 03 15:57:07.887479 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887322 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-system-cni-dir\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.887479 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:07.887336 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs podName:6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd nodeName:}" failed. No retries permitted until 2026-06-03 15:57:08.387300431 +0000 UTC m=+3.054687462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs") pod "network-metrics-daemon-6h6md" (UID: "6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:57:07.887479 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887350 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e98840fb-b4bc-48f4-b044-c91aa26a528b-hosts-file\") pod \"node-resolver-96gss\" (UID: \"e98840fb-b4bc-48f4-b044-c91aa26a528b\") " pod="openshift-dns/node-resolver-96gss" Jun 03 15:57:07.887479 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887360 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42d28413-02d0-4f2f-adc2-4c08b3f0419d-cni-binary-copy\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.887479 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887476 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.888179 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887522 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-var-lib-cni-bin\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.888179 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887553 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-os-release\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.888179 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887564 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-var-lib-cni-bin\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.888179 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887580 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.888179 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887590 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.888179 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887599 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/773fe981-eb8d-4ad7-8434-78168e05801d-serviceca\") pod \"node-ca-rx47m\" (UID: \"773fe981-eb8d-4ad7-8434-78168e05801d\") " pod="openshift-image-registry/node-ca-rx47m" Jun 03 15:57:07.888179 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887613 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-os-release\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.888179 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887625 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-run-openvswitch\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.888179 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887652 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-socket-dir\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.888179 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887656 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-run-openvswitch\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.888179 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887677 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-skqz7\" (UniqueName: \"kubernetes.io/projected/790580c1-afa7-4c35-853d-4fd9f45561cd-kube-api-access-skqz7\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.888179 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887705 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-sysctl-conf\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.888179 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887729 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-var-lib-kubelet\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.888179 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887755 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-multus-cni-dir\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.888179 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887781 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-systemd-units\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.888179 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887787 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-socket-dir\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.888179 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887821 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cdfw4\" (UniqueName: \"kubernetes.io/projected/499fcfa6-bfea-4f27-8adc-a52a14c799b7-kube-api-access-cdfw4\") pod \"iptables-alerter-r6t4v\" (UID: \"499fcfa6-bfea-4f27-8adc-a52a14c799b7\") " pod="openshift-network-operator/iptables-alerter-r6t4v" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887848 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-cnibin\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887851 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-systemd-units\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887868 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-etc-kubernetes\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887889 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd98e600-3aa6-4647-be14-6b3a72074ed7-ovnkube-config\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887908 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-cnibin\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret\") pod \"global-pull-secret-syncer-dhw9d\" (UID: \"8005fb8c-13cc-491f-bdb3-80744ed6306c\") " pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887923 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-etc-kubernetes\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887936 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-multus-cni-dir\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887942 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/983ee38c-b506-4ac9-b241-37b0292bad9d-agent-certs\") pod \"konnectivity-agent-cmm55\" (UID: \"983ee38c-b506-4ac9-b241-37b0292bad9d\") " pod="kube-system/konnectivity-agent-cmm55" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.887975 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-run-netns\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888001 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-node-log\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888024 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-cni-netd\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888048 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-sys-fs\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888056 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-run-netns\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888074 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-modprobe-d\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888085 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-node-log\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888096 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-cni-netd\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.888954 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888097 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a911b23-c625-4075-9942-eee0e418c89b-tmp\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.889827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888104 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.889827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888133 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc8cb\" (UniqueName: \"kubernetes.io/projected/7a911b23-c625-4075-9942-eee0e418c89b-kube-api-access-vc8cb\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.889827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888141 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-sys-fs\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.889827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888167 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-cni-binary-copy\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.889827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888194 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glbgl\" (UniqueName: \"kubernetes.io/projected/42d28413-02d0-4f2f-adc2-4c08b3f0419d-kube-api-access-glbgl\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.889827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888239 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 15:57:07.889827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888291 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-run-systemd\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.889827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888311 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-kubernetes\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.889827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888327 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-sysctl-d\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.889827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888342 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-run\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.889827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888359 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.889827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888368 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd98e600-3aa6-4647-be14-6b3a72074ed7-ovnkube-config\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.889827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888382 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-slash\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.889827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888402 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-run-systemd\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.889827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888408 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e98840fb-b4bc-48f4-b044-c91aa26a528b-tmp-dir\") pod \"node-resolver-96gss\" (UID: \"e98840fb-b4bc-48f4-b044-c91aa26a528b\") " pod="openshift-dns/node-resolver-96gss" Jun 03 15:57:07.889827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888441 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-registration-dir\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.889827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888451 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-slash\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.890603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888469 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-sysconfig\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.890603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888494 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.890603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888495 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-systemd\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.890603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888532 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-cni-bin\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.890603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888551 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-registration-dir\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.890603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888571 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-cni-bin\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.890603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888555 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.890603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888620 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-multus-socket-dir-parent\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.890603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888644 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-cni-binary-copy\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.890603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888648 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-run-netns\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.890603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888681 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-run-netns\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.890603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888695 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-var-lib-cni-multus\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.890603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888720 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-lib-modules\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.890603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a911b23-c625-4075-9942-eee0e418c89b-etc-tuned\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.890603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888739 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e98840fb-b4bc-48f4-b044-c91aa26a528b-tmp-dir\") pod \"node-resolver-96gss\" (UID: \"e98840fb-b4bc-48f4-b044-c91aa26a528b\") " pod="openshift-dns/node-resolver-96gss" Jun 03 15:57:07.890603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888741 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-multus-socket-dir-parent\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.890603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888766 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/499fcfa6-bfea-4f27-8adc-a52a14c799b7-host-slash\") pod \"iptables-alerter-r6t4v\" (UID: \"499fcfa6-bfea-4f27-8adc-a52a14c799b7\") " pod="openshift-network-operator/iptables-alerter-r6t4v" Jun 03 15:57:07.891430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888780 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-var-lib-cni-multus\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.891430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888795 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/773fe981-eb8d-4ad7-8434-78168e05801d-host\") pod \"node-ca-rx47m\" (UID: \"773fe981-eb8d-4ad7-8434-78168e05801d\") " pod="openshift-image-registry/node-ca-rx47m" Jun 03 15:57:07.891430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888800 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/499fcfa6-bfea-4f27-8adc-a52a14c799b7-host-slash\") pod \"iptables-alerter-r6t4v\" (UID: \"499fcfa6-bfea-4f27-8adc-a52a14c799b7\") " pod="openshift-network-operator/iptables-alerter-r6t4v" Jun 03 15:57:07.891430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888823 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ln9jd\" (UniqueName: \"kubernetes.io/projected/773fe981-eb8d-4ad7-8434-78168e05801d-kube-api-access-ln9jd\") pod \"node-ca-rx47m\" (UID: \"773fe981-eb8d-4ad7-8434-78168e05801d\") " pod="openshift-image-registry/node-ca-rx47m" Jun 03 15:57:07.891430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888839 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/773fe981-eb8d-4ad7-8434-78168e05801d-host\") pod \"node-ca-rx47m\" (UID: \"773fe981-eb8d-4ad7-8434-78168e05801d\") " pod="openshift-image-registry/node-ca-rx47m" Jun 03 15:57:07.891430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888844 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-run-k8s-cni-cncf-io\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.891430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888866 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.891430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888888 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rfn5\" (UniqueName: \"kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5\") pod \"network-check-target-hm4zx\" (UID: \"b55f5a62-2148-45e4-a39e-c1dcd628aa44\") " pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:07.891430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888912 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxp2f\" (UniqueName: \"kubernetes.io/projected/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-kube-api-access-fxp2f\") pod \"network-metrics-daemon-6h6md\" (UID: \"6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd\") " pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:07.891430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888934 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-kubelet\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.891430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888948 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.891430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888954 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-log-socket\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.891430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888977 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.891430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888985 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-log-socket\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.891430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.888988 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd98e600-3aa6-4647-be14-6b3a72074ed7-ovnkube-script-lib\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.891430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889010 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-host\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.891430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889027 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-run-k8s-cni-cncf-io\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8005fb8c-13cc-491f-bdb3-80744ed6306c-kubelet-config\") pod \"global-pull-secret-syncer-dhw9d\" (UID: \"8005fb8c-13cc-491f-bdb3-80744ed6306c\") " pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889171 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-host-kubelet\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889213 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bd2vp\" (UniqueName: \"kubernetes.io/projected/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-kube-api-access-bd2vp\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889236 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-multus-conf-dir\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889256 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9fwkr\" (UniqueName: \"kubernetes.io/projected/e98840fb-b4bc-48f4-b044-c91aa26a528b-kube-api-access-9fwkr\") pod \"node-resolver-96gss\" (UID: \"e98840fb-b4bc-48f4-b044-c91aa26a528b\") " pod="openshift-dns/node-resolver-96gss" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889292 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-device-dir\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889311 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-var-lib-kubelet\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889321 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-multus-conf-dir\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889332 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd98e600-3aa6-4647-be14-6b3a72074ed7-ovn-node-metrics-cert\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889370 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-sys\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889387 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-host-var-lib-kubelet\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889398 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-cnibin\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889422 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-hostroot\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889445 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42d28413-02d0-4f2f-adc2-4c08b3f0419d-multus-daemon-config\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889461 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd98e600-3aa6-4647-be14-6b3a72074ed7-ovnkube-script-lib\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889470 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-run-ovn\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889474 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-hostroot\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.892185 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889464 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42d28413-02d0-4f2f-adc2-4c08b3f0419d-cnibin\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.893025 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889507 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/790580c1-afa7-4c35-853d-4fd9f45561cd-device-dir\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.893025 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889541 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd98e600-3aa6-4647-be14-6b3a72074ed7-run-ovn\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.893025 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.889842 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42d28413-02d0-4f2f-adc2-4c08b3f0419d-multus-daemon-config\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.893025 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.891890 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd98e600-3aa6-4647-be14-6b3a72074ed7-ovn-node-metrics-cert\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.893025 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.892001 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/983ee38c-b506-4ac9-b241-37b0292bad9d-agent-certs\") pod \"konnectivity-agent-cmm55\" (UID: \"983ee38c-b506-4ac9-b241-37b0292bad9d\") " pod="kube-system/konnectivity-agent-cmm55" Jun 03 15:57:07.898190 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.898167 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdfw4\" (UniqueName: \"kubernetes.io/projected/499fcfa6-bfea-4f27-8adc-a52a14c799b7-kube-api-access-cdfw4\") pod \"iptables-alerter-r6t4v\" (UID: \"499fcfa6-bfea-4f27-8adc-a52a14c799b7\") " pod="openshift-network-operator/iptables-alerter-r6t4v" Jun 03 15:57:07.899686 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.899662 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glbgl\" (UniqueName: \"kubernetes.io/projected/42d28413-02d0-4f2f-adc2-4c08b3f0419d-kube-api-access-glbgl\") pod \"multus-qf7wr\" (UID: \"42d28413-02d0-4f2f-adc2-4c08b3f0419d\") " pod="openshift-multus/multus-qf7wr" Jun 03 15:57:07.899942 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.899916 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd2vp\" (UniqueName: \"kubernetes.io/projected/fa4ea0e6-081d-4f6f-a5db-f66831a07a15-kube-api-access-bd2vp\") pod \"multus-additional-cni-plugins-wsfnl\" (UID: \"fa4ea0e6-081d-4f6f-a5db-f66831a07a15\") " pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:07.901141 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.901093 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzc8q\" (UniqueName: \"kubernetes.io/projected/cd98e600-3aa6-4647-be14-6b3a72074ed7-kube-api-access-pzc8q\") pod \"ovnkube-node-vfbq8\" (UID: \"cd98e600-3aa6-4647-be14-6b3a72074ed7\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:07.901226 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.901152 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skqz7\" (UniqueName: \"kubernetes.io/projected/790580c1-afa7-4c35-853d-4fd9f45561cd-kube-api-access-skqz7\") pod \"aws-ebs-csi-driver-node-qkbgd\" (UID: \"790580c1-afa7-4c35-853d-4fd9f45561cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:07.901297 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.901227 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxp2f\" (UniqueName: \"kubernetes.io/projected/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-kube-api-access-fxp2f\") pod \"network-metrics-daemon-6h6md\" (UID: \"6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd\") " pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:07.901711 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.901693 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fwkr\" (UniqueName: \"kubernetes.io/projected/e98840fb-b4bc-48f4-b044-c91aa26a528b-kube-api-access-9fwkr\") pod \"node-resolver-96gss\" (UID: \"e98840fb-b4bc-48f4-b044-c91aa26a528b\") " pod="openshift-dns/node-resolver-96gss" Jun 03 15:57:07.910203 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.910181 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln9jd\" (UniqueName: \"kubernetes.io/projected/773fe981-eb8d-4ad7-8434-78168e05801d-kube-api-access-ln9jd\") pod \"node-ca-rx47m\" (UID: \"773fe981-eb8d-4ad7-8434-78168e05801d\") " pod="openshift-image-registry/node-ca-rx47m" Jun 03 15:57:07.990455 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990427 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-host\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.990455 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990457 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8005fb8c-13cc-491f-bdb3-80744ed6306c-kubelet-config\") pod \"global-pull-secret-syncer-dhw9d\" (UID: \"8005fb8c-13cc-491f-bdb3-80744ed6306c\") " pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:07.990631 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990475 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-sys\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.990631 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990545 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-host\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.990631 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990572 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8005fb8c-13cc-491f-bdb3-80744ed6306c-dbus\") pod \"global-pull-secret-syncer-dhw9d\" (UID: \"8005fb8c-13cc-491f-bdb3-80744ed6306c\") " pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:07.990631 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990604 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-sys\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.990631 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990615 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-sysctl-conf\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.990631 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990631 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-var-lib-kubelet\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.990914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990648 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8005fb8c-13cc-491f-bdb3-80744ed6306c-kubelet-config\") pod \"global-pull-secret-syncer-dhw9d\" (UID: \"8005fb8c-13cc-491f-bdb3-80744ed6306c\") " pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:07.990914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990651 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret\") pod \"global-pull-secret-syncer-dhw9d\" (UID: \"8005fb8c-13cc-491f-bdb3-80744ed6306c\") " pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:07.990914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990676 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8005fb8c-13cc-491f-bdb3-80744ed6306c-dbus\") pod \"global-pull-secret-syncer-dhw9d\" (UID: \"8005fb8c-13cc-491f-bdb3-80744ed6306c\") " pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:07.990914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990691 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-modprobe-d\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.990914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990716 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-var-lib-kubelet\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.990914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990739 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a911b23-c625-4075-9942-eee0e418c89b-tmp\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.990914 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:07.990763 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:57:07.990914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990771 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc8cb\" (UniqueName: \"kubernetes.io/projected/7a911b23-c625-4075-9942-eee0e418c89b-kube-api-access-vc8cb\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.990914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990790 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-sysctl-conf\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.990914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990795 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-kubernetes\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.990914 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:07.990813 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret podName:8005fb8c-13cc-491f-bdb3-80744ed6306c nodeName:}" failed. No retries permitted until 2026-06-03 15:57:08.490792031 +0000 UTC m=+3.158179066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret") pod "global-pull-secret-syncer-dhw9d" (UID: "8005fb8c-13cc-491f-bdb3-80744ed6306c") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:57:07.990914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990836 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-modprobe-d\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.990914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990843 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-kubernetes\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.990914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990844 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-sysctl-d\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.990914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990879 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-run\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.990914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990913 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-run\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.990914 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990921 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-sysconfig\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.991586 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990946 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-systemd\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.991586 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990948 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-sysctl-d\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.991586 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990978 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-lib-modules\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.991586 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990976 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-sysconfig\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.991586 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.990998 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-etc-systemd\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.991586 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.991001 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a911b23-c625-4075-9942-eee0e418c89b-etc-tuned\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.991586 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.991044 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rfn5\" (UniqueName: \"kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5\") pod \"network-check-target-hm4zx\" (UID: \"b55f5a62-2148-45e4-a39e-c1dcd628aa44\") " pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:07.991586 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.991061 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a911b23-c625-4075-9942-eee0e418c89b-lib-modules\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.993430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.993405 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a911b23-c625-4075-9942-eee0e418c89b-tmp\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.993540 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.993452 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a911b23-c625-4075-9942-eee0e418c89b-etc-tuned\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:07.998367 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:07.998346 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:57:07.998367 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:07.998364 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:57:07.998545 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:07.998376 2575 projected.go:194] Error preparing data for projected volume kube-api-access-7rfn5 for pod openshift-network-diagnostics/network-check-target-hm4zx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:57:07.998545 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:07.998442 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5 podName:b55f5a62-2148-45e4-a39e-c1dcd628aa44 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:08.498424488 +0000 UTC m=+3.165811519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7rfn5" (UniqueName: "kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5") pod "network-check-target-hm4zx" (UID: "b55f5a62-2148-45e4-a39e-c1dcd628aa44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:57:07.999964 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:07.999946 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc8cb\" (UniqueName: \"kubernetes.io/projected/7a911b23-c625-4075-9942-eee0e418c89b-kube-api-access-vc8cb\") pod \"tuned-22mgv\" (UID: \"7a911b23-c625-4075-9942-eee0e418c89b\") " pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:08.074378 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.074333 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wsfnl" Jun 03 15:57:08.083342 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.083301 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qf7wr" Jun 03 15:57:08.093408 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.093385 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:08.099009 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.098991 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-96gss" Jun 03 15:57:08.106556 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.106536 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" Jun 03 15:57:08.115031 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.115012 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r6t4v" Jun 03 15:57:08.122673 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.122655 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cmm55" Jun 03 15:57:08.129218 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.129199 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rx47m" Jun 03 15:57:08.134798 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.134781 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-22mgv" Jun 03 15:57:08.168553 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.168530 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:57:08.392845 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.392759 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs\") pod \"network-metrics-daemon-6h6md\" (UID: \"6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd\") " pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:08.393007 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:08.392911 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:57:08.393007 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:08.392979 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs podName:6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd nodeName:}" failed. No retries permitted until 2026-06-03 15:57:09.392960746 +0000 UTC m=+4.060347788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs") pod "network-metrics-daemon-6h6md" (UID: "6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:57:08.465653 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:08.465626 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d28413_02d0_4f2f_adc2_4c08b3f0419d.slice/crio-5f3ca26d4f8a6a148d2778603aae9655b99079135e12afa272f03e2d6f8a1375 WatchSource:0}: Error finding container 5f3ca26d4f8a6a148d2778603aae9655b99079135e12afa272f03e2d6f8a1375: Status 404 returned error can't find the container with id 5f3ca26d4f8a6a148d2778603aae9655b99079135e12afa272f03e2d6f8a1375 Jun 03 15:57:08.467108 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:08.467087 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd98e600_3aa6_4647_be14_6b3a72074ed7.slice/crio-d927add153480f60771a457eb58474bd0d4b3d84f8253e5a7d5050a1aeff3b31 WatchSource:0}: Error finding container d927add153480f60771a457eb58474bd0d4b3d84f8253e5a7d5050a1aeff3b31: Status 404 returned error can't find the container with id d927add153480f60771a457eb58474bd0d4b3d84f8253e5a7d5050a1aeff3b31 Jun 03 15:57:08.470848 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:08.470828 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4ea0e6_081d_4f6f_a5db_f66831a07a15.slice/crio-778c0f13125e00e26d589bc4c8467e3d7bfcabdf5cdb492094f1a6ec8ba68b74 WatchSource:0}: Error finding container 778c0f13125e00e26d589bc4c8467e3d7bfcabdf5cdb492094f1a6ec8ba68b74: Status 404 returned error can't find the container with id 778c0f13125e00e26d589bc4c8467e3d7bfcabdf5cdb492094f1a6ec8ba68b74 Jun 03 15:57:08.471631 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:08.471607 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode98840fb_b4bc_48f4_b044_c91aa26a528b.slice/crio-e3b48a1748f1f248805f5a3bd9a8a90dc064a199244b867b022fd5728867f6ff WatchSource:0}: Error finding container e3b48a1748f1f248805f5a3bd9a8a90dc064a199244b867b022fd5728867f6ff: Status 404 returned error can't find the container with id e3b48a1748f1f248805f5a3bd9a8a90dc064a199244b867b022fd5728867f6ff Jun 03 15:57:08.472916 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:08.472853 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod983ee38c_b506_4ac9_b241_37b0292bad9d.slice/crio-75b6e3a67294c2a7874b1432f0545c3e379f2366665d8571316ac0f98f71959a WatchSource:0}: Error finding container 75b6e3a67294c2a7874b1432f0545c3e379f2366665d8571316ac0f98f71959a: Status 404 returned error can't find the container with id 75b6e3a67294c2a7874b1432f0545c3e379f2366665d8571316ac0f98f71959a Jun 03 15:57:08.475722 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:08.474076 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod499fcfa6_bfea_4f27_8adc_a52a14c799b7.slice/crio-7182db929d29dbb1b49b25bffbc74e8a4876b0fd2cd115b43c46d1b8fcfa5df1 WatchSource:0}: Error finding container 7182db929d29dbb1b49b25bffbc74e8a4876b0fd2cd115b43c46d1b8fcfa5df1: Status 404 returned error can't find the container with id 7182db929d29dbb1b49b25bffbc74e8a4876b0fd2cd115b43c46d1b8fcfa5df1 Jun 03 15:57:08.475722 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:08.475336 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773fe981_eb8d_4ad7_8434_78168e05801d.slice/crio-f9daf0c382242f9216c102abc2468a9f45ab3864fdc949e251a6c7d612870041 WatchSource:0}: Error finding container f9daf0c382242f9216c102abc2468a9f45ab3864fdc949e251a6c7d612870041: Status 404 returned error can't find the container with id f9daf0c382242f9216c102abc2468a9f45ab3864fdc949e251a6c7d612870041 Jun 03 15:57:08.477440 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:08.477056 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790580c1_afa7_4c35_853d_4fd9f45561cd.slice/crio-06ce8f229fad2a0329e15a08b61c5c9f0e7478ebfd90ca1249d16bd5cf31b067 WatchSource:0}: Error finding container 06ce8f229fad2a0329e15a08b61c5c9f0e7478ebfd90ca1249d16bd5cf31b067: Status 404 returned error can't find the container with id 06ce8f229fad2a0329e15a08b61c5c9f0e7478ebfd90ca1249d16bd5cf31b067 Jun 03 15:57:08.477496 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:57:08.477441 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a911b23_c625_4075_9942_eee0e418c89b.slice/crio-333ff9029d1e7672be8024c902b13a5a15820736325a938818f0125be62ac3a1 WatchSource:0}: Error finding container 333ff9029d1e7672be8024c902b13a5a15820736325a938818f0125be62ac3a1: Status 404 returned error can't find the container with id 333ff9029d1e7672be8024c902b13a5a15820736325a938818f0125be62ac3a1 Jun 03 15:57:08.493847 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.493824 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret\") pod \"global-pull-secret-syncer-dhw9d\" (UID: \"8005fb8c-13cc-491f-bdb3-80744ed6306c\") " pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:08.493964 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:08.493950 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:57:08.494016 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:08.493996 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret podName:8005fb8c-13cc-491f-bdb3-80744ed6306c nodeName:}" failed. No retries permitted until 2026-06-03 15:57:09.493983754 +0000 UTC m=+4.161370779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret") pod "global-pull-secret-syncer-dhw9d" (UID: "8005fb8c-13cc-491f-bdb3-80744ed6306c") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:57:08.594866 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.594834 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rfn5\" (UniqueName: \"kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5\") pod \"network-check-target-hm4zx\" (UID: \"b55f5a62-2148-45e4-a39e-c1dcd628aa44\") " pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:08.595038 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:08.595018 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:57:08.595093 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:08.595047 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:57:08.595093 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:08.595062 2575 projected.go:194] Error preparing data for projected volume kube-api-access-7rfn5 for pod openshift-network-diagnostics/network-check-target-hm4zx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:57:08.595165 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:08.595123 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5 podName:b55f5a62-2148-45e4-a39e-c1dcd628aa44 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:09.595101024 +0000 UTC m=+4.262488067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7rfn5" (UniqueName: "kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5") pod "network-check-target-hm4zx" (UID: "b55f5a62-2148-45e4-a39e-c1dcd628aa44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:57:08.822949 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.822909 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 15:52:06 +0000 UTC" deadline="2028-01-11 23:34:16.456827618 +0000 UTC" Jun 03 15:57:08.822949 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.822944 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14095h37m7.633887183s" Jun 03 15:57:08.878727 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.878090 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal" event={"ID":"d78abd18259f21ae1cd5ff6d8347d3c9","Type":"ContainerStarted","Data":"3a35260af17ba07c03bc802445bf5cc0906943b1f28e84b5d6b48c9b288a05d1"} Jun 03 15:57:08.881035 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.881005 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" event={"ID":"790580c1-afa7-4c35-853d-4fd9f45561cd","Type":"ContainerStarted","Data":"06ce8f229fad2a0329e15a08b61c5c9f0e7478ebfd90ca1249d16bd5cf31b067"} Jun 03 15:57:08.882362 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.882337 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r6t4v" event={"ID":"499fcfa6-bfea-4f27-8adc-a52a14c799b7","Type":"ContainerStarted","Data":"7182db929d29dbb1b49b25bffbc74e8a4876b0fd2cd115b43c46d1b8fcfa5df1"} Jun 03 15:57:08.883776 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.883752 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wsfnl" event={"ID":"fa4ea0e6-081d-4f6f-a5db-f66831a07a15","Type":"ContainerStarted","Data":"778c0f13125e00e26d589bc4c8467e3d7bfcabdf5cdb492094f1a6ec8ba68b74"} Jun 03 15:57:08.885226 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.885203 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" event={"ID":"cd98e600-3aa6-4647-be14-6b3a72074ed7","Type":"ContainerStarted","Data":"d927add153480f60771a457eb58474bd0d4b3d84f8253e5a7d5050a1aeff3b31"} Jun 03 15:57:08.886600 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.886575 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qf7wr" event={"ID":"42d28413-02d0-4f2f-adc2-4c08b3f0419d","Type":"ContainerStarted","Data":"5f3ca26d4f8a6a148d2778603aae9655b99079135e12afa272f03e2d6f8a1375"} Jun 03 15:57:08.892087 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.892061 2575 generic.go:358] "Generic (PLEG): container finished" podID="c95e50355c69747b9db9acb3a2905f92" containerID="b2c601dd9f879581cf460f399ba29ee1a6081fa0f42653cc63c4f1a25d5e894c" exitCode=0 Jun 03 15:57:08.892374 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.892337 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal" event={"ID":"c95e50355c69747b9db9acb3a2905f92","Type":"ContainerDied","Data":"b2c601dd9f879581cf460f399ba29ee1a6081fa0f42653cc63c4f1a25d5e894c"} Jun 03 15:57:08.893498 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.893473 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-22mgv" event={"ID":"7a911b23-c625-4075-9942-eee0e418c89b","Type":"ContainerStarted","Data":"333ff9029d1e7672be8024c902b13a5a15820736325a938818f0125be62ac3a1"} Jun 03 15:57:08.894146 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.894096 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-89.ec2.internal" podStartSLOduration=1.894080878 podStartE2EDuration="1.894080878s" podCreationTimestamp="2026-06-03 15:57:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:57:08.893236659 +0000 UTC m=+3.560623707" watchObservedRunningTime="2026-06-03 15:57:08.894080878 +0000 UTC m=+3.561467927" Jun 03 15:57:08.894918 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.894896 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rx47m" event={"ID":"773fe981-eb8d-4ad7-8434-78168e05801d","Type":"ContainerStarted","Data":"f9daf0c382242f9216c102abc2468a9f45ab3864fdc949e251a6c7d612870041"} Jun 03 15:57:08.898177 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.898144 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cmm55" event={"ID":"983ee38c-b506-4ac9-b241-37b0292bad9d","Type":"ContainerStarted","Data":"75b6e3a67294c2a7874b1432f0545c3e379f2366665d8571316ac0f98f71959a"} Jun 03 15:57:08.900304 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:08.900281 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-96gss" event={"ID":"e98840fb-b4bc-48f4-b044-c91aa26a528b","Type":"ContainerStarted","Data":"e3b48a1748f1f248805f5a3bd9a8a90dc064a199244b867b022fd5728867f6ff"} Jun 03 15:57:09.400933 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:09.400797 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs\") pod \"network-metrics-daemon-6h6md\" (UID: \"6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd\") " pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:09.401147 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:09.401024 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:57:09.401147 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:09.401097 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs podName:6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd nodeName:}" failed. No retries permitted until 2026-06-03 15:57:11.401076384 +0000 UTC m=+6.068463418 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs") pod "network-metrics-daemon-6h6md" (UID: "6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:57:09.502436 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:09.501851 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret\") pod \"global-pull-secret-syncer-dhw9d\" (UID: \"8005fb8c-13cc-491f-bdb3-80744ed6306c\") " pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:09.502436 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:09.502003 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:57:09.502436 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:09.502075 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret podName:8005fb8c-13cc-491f-bdb3-80744ed6306c nodeName:}" failed. No retries permitted until 2026-06-03 15:57:11.502056482 +0000 UTC m=+6.169443519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret") pod "global-pull-secret-syncer-dhw9d" (UID: "8005fb8c-13cc-491f-bdb3-80744ed6306c") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:57:09.603294 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:09.602753 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rfn5\" (UniqueName: \"kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5\") pod \"network-check-target-hm4zx\" (UID: \"b55f5a62-2148-45e4-a39e-c1dcd628aa44\") " pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:09.603294 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:09.602963 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:57:09.603294 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:09.602984 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:57:09.603294 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:09.602997 2575 projected.go:194] Error preparing data for projected volume kube-api-access-7rfn5 for pod openshift-network-diagnostics/network-check-target-hm4zx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:57:09.603294 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:09.603055 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5 podName:b55f5a62-2148-45e4-a39e-c1dcd628aa44 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:11.60303745 +0000 UTC m=+6.270424483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7rfn5" (UniqueName: "kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5") pod "network-check-target-hm4zx" (UID: "b55f5a62-2148-45e4-a39e-c1dcd628aa44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:57:09.874656 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:09.874622 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:09.875099 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:09.874797 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:09.875099 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:09.874948 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h6md" podUID="6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd" Jun 03 15:57:09.875568 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:09.875535 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm4zx" podUID="b55f5a62-2148-45e4-a39e-c1dcd628aa44" Jun 03 15:57:09.875895 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:09.875684 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:09.875895 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:09.875851 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhw9d" podUID="8005fb8c-13cc-491f-bdb3-80744ed6306c" Jun 03 15:57:09.931098 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:09.931034 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal" event={"ID":"c95e50355c69747b9db9acb3a2905f92","Type":"ContainerStarted","Data":"4adc8d691083714df1b95f3f69597e5e15ad40ebf69c2da80d226bed88fcaf38"} Jun 03 15:57:09.947707 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:09.946388 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-89.ec2.internal" podStartSLOduration=2.94636809 podStartE2EDuration="2.94636809s" podCreationTimestamp="2026-06-03 15:57:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:57:09.945412936 +0000 UTC m=+4.612799985" watchObservedRunningTime="2026-06-03 15:57:09.94636809 +0000 UTC m=+4.613755138" Jun 03 15:57:11.422233 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:11.421606 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs\") pod \"network-metrics-daemon-6h6md\" (UID: \"6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd\") " pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:11.422233 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:11.421813 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:57:11.422233 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:11.421876 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs podName:6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd nodeName:}" failed. No retries permitted until 2026-06-03 15:57:15.421857128 +0000 UTC m=+10.089244158 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs") pod "network-metrics-daemon-6h6md" (UID: "6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:57:11.522491 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:11.522455 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret\") pod \"global-pull-secret-syncer-dhw9d\" (UID: \"8005fb8c-13cc-491f-bdb3-80744ed6306c\") " pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:11.522680 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:11.522629 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:57:11.522746 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:11.522688 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret podName:8005fb8c-13cc-491f-bdb3-80744ed6306c nodeName:}" failed. No retries permitted until 2026-06-03 15:57:15.522668666 +0000 UTC m=+10.190055697 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret") pod "global-pull-secret-syncer-dhw9d" (UID: "8005fb8c-13cc-491f-bdb3-80744ed6306c") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:57:11.623633 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:11.623596 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rfn5\" (UniqueName: \"kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5\") pod \"network-check-target-hm4zx\" (UID: \"b55f5a62-2148-45e4-a39e-c1dcd628aa44\") " pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:11.623835 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:11.623818 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:57:11.623900 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:11.623843 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:57:11.623900 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:11.623855 2575 projected.go:194] Error preparing data for projected volume kube-api-access-7rfn5 for pod openshift-network-diagnostics/network-check-target-hm4zx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:57:11.624002 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:11.623911 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5 podName:b55f5a62-2148-45e4-a39e-c1dcd628aa44 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:15.623892044 +0000 UTC m=+10.291279076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7rfn5" (UniqueName: "kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5") pod "network-check-target-hm4zx" (UID: "b55f5a62-2148-45e4-a39e-c1dcd628aa44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:57:11.868828 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:11.868800 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:11.868989 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:11.868910 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm4zx" podUID="b55f5a62-2148-45e4-a39e-c1dcd628aa44" Jun 03 15:57:11.868989 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:11.868939 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:11.868989 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:11.868967 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:11.869158 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:11.869042 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhw9d" podUID="8005fb8c-13cc-491f-bdb3-80744ed6306c" Jun 03 15:57:11.869158 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:11.869142 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h6md" podUID="6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd" Jun 03 15:57:13.869837 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:13.869356 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:13.869837 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:13.869487 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm4zx" podUID="b55f5a62-2148-45e4-a39e-c1dcd628aa44" Jun 03 15:57:13.870380 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:13.869915 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:13.870380 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:13.869934 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:13.870380 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:13.870016 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhw9d" podUID="8005fb8c-13cc-491f-bdb3-80744ed6306c" Jun 03 15:57:13.870380 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:13.870108 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h6md" podUID="6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd" Jun 03 15:57:15.454789 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:15.454709 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs\") pod \"network-metrics-daemon-6h6md\" (UID: \"6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd\") " pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:15.455258 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:15.454862 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:57:15.455258 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:15.454944 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs podName:6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd nodeName:}" failed. No retries permitted until 2026-06-03 15:57:23.454923449 +0000 UTC m=+18.122310482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs") pod "network-metrics-daemon-6h6md" (UID: "6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:57:15.555622 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:15.555572 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret\") pod \"global-pull-secret-syncer-dhw9d\" (UID: \"8005fb8c-13cc-491f-bdb3-80744ed6306c\") " pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:15.555790 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:15.555727 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:57:15.555856 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:15.555794 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret podName:8005fb8c-13cc-491f-bdb3-80744ed6306c nodeName:}" failed. No retries permitted until 2026-06-03 15:57:23.555773558 +0000 UTC m=+18.223160583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret") pod "global-pull-secret-syncer-dhw9d" (UID: "8005fb8c-13cc-491f-bdb3-80744ed6306c") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:57:15.656986 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:15.656903 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rfn5\" (UniqueName: \"kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5\") pod \"network-check-target-hm4zx\" (UID: \"b55f5a62-2148-45e4-a39e-c1dcd628aa44\") " pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:15.657464 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:15.657318 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:57:15.657464 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:15.657340 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:57:15.657464 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:15.657354 2575 projected.go:194] Error preparing data for projected volume kube-api-access-7rfn5 for pod openshift-network-diagnostics/network-check-target-hm4zx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:57:15.657464 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:15.657414 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5 podName:b55f5a62-2148-45e4-a39e-c1dcd628aa44 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:23.657394584 +0000 UTC m=+18.324781615 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7rfn5" (UniqueName: "kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5") pod "network-check-target-hm4zx" (UID: "b55f5a62-2148-45e4-a39e-c1dcd628aa44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:57:15.869553 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:15.869513 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:15.869715 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:15.869636 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm4zx" podUID="b55f5a62-2148-45e4-a39e-c1dcd628aa44" Jun 03 15:57:15.870192 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:15.870008 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:15.870192 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:15.870111 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h6md" podUID="6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd" Jun 03 15:57:15.870192 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:15.870156 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:15.870434 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:15.870227 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhw9d" podUID="8005fb8c-13cc-491f-bdb3-80744ed6306c" Jun 03 15:57:17.869016 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:17.868978 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:17.869483 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:17.868978 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:17.869483 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:17.869120 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h6md" podUID="6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd" Jun 03 15:57:17.869483 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:17.869294 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm4zx" podUID="b55f5a62-2148-45e4-a39e-c1dcd628aa44" Jun 03 15:57:17.869483 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:17.868978 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:17.869483 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:17.869399 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhw9d" podUID="8005fb8c-13cc-491f-bdb3-80744ed6306c" Jun 03 15:57:19.869439 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:19.869405 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:19.869895 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:19.869405 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:19.869895 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:19.869565 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h6md" podUID="6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd" Jun 03 15:57:19.869895 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:19.869410 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:19.869895 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:19.869626 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhw9d" podUID="8005fb8c-13cc-491f-bdb3-80744ed6306c" Jun 03 15:57:19.869895 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:19.869695 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm4zx" podUID="b55f5a62-2148-45e4-a39e-c1dcd628aa44" Jun 03 15:57:21.872418 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:21.872387 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:21.872818 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:21.872430 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:21.872818 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:21.872387 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:21.872818 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:21.872513 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm4zx" podUID="b55f5a62-2148-45e4-a39e-c1dcd628aa44" Jun 03 15:57:21.872818 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:21.872596 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h6md" podUID="6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd" Jun 03 15:57:21.872818 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:21.872681 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhw9d" podUID="8005fb8c-13cc-491f-bdb3-80744ed6306c" Jun 03 15:57:23.519479 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:23.519443 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs\") pod \"network-metrics-daemon-6h6md\" (UID: \"6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd\") " pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:23.519876 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:23.519601 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:57:23.519876 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:23.519675 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs podName:6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd nodeName:}" failed. No retries permitted until 2026-06-03 15:57:39.519654535 +0000 UTC m=+34.187041567 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs") pod "network-metrics-daemon-6h6md" (UID: "6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:57:23.620497 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:23.620466 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret\") pod \"global-pull-secret-syncer-dhw9d\" (UID: \"8005fb8c-13cc-491f-bdb3-80744ed6306c\") " pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:23.620668 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:23.620583 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:57:23.620668 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:23.620637 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret podName:8005fb8c-13cc-491f-bdb3-80744ed6306c nodeName:}" failed. No retries permitted until 2026-06-03 15:57:39.620625289 +0000 UTC m=+34.288012315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret") pod "global-pull-secret-syncer-dhw9d" (UID: "8005fb8c-13cc-491f-bdb3-80744ed6306c") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:57:23.721176 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:23.721141 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rfn5\" (UniqueName: \"kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5\") pod \"network-check-target-hm4zx\" (UID: \"b55f5a62-2148-45e4-a39e-c1dcd628aa44\") " pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:23.721367 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:23.721285 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:57:23.721367 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:23.721307 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:57:23.721367 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:23.721316 2575 projected.go:194] Error preparing data for projected volume kube-api-access-7rfn5 for pod openshift-network-diagnostics/network-check-target-hm4zx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:57:23.721367 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:23.721366 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5 podName:b55f5a62-2148-45e4-a39e-c1dcd628aa44 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:39.721349782 +0000 UTC m=+34.388736812 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7rfn5" (UniqueName: "kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5") pod "network-check-target-hm4zx" (UID: "b55f5a62-2148-45e4-a39e-c1dcd628aa44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:57:23.872367 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:23.872290 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:23.872514 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:23.872290 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:23.872514 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:23.872413 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h6md" podUID="6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd" Jun 03 15:57:23.872514 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:23.872290 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:23.872514 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:23.872471 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm4zx" podUID="b55f5a62-2148-45e4-a39e-c1dcd628aa44" Jun 03 15:57:23.872696 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:23.872548 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhw9d" podUID="8005fb8c-13cc-491f-bdb3-80744ed6306c" Jun 03 15:57:25.872039 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:25.872008 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:25.872577 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:25.872010 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:25.872577 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:25.872121 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm4zx" podUID="b55f5a62-2148-45e4-a39e-c1dcd628aa44" Jun 03 15:57:25.872577 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:25.872133 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:25.872577 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:25.872189 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhw9d" podUID="8005fb8c-13cc-491f-bdb3-80744ed6306c" Jun 03 15:57:25.872577 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:25.872246 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h6md" podUID="6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd" Jun 03 15:57:26.962120 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:26.961925 2575 generic.go:358] "Generic (PLEG): container finished" podID="fa4ea0e6-081d-4f6f-a5db-f66831a07a15" containerID="b76e9d50fdc0227864b4c85d04056194ac0aa798580dcb82ae9df9782546880b" exitCode=0 Jun 03 15:57:26.962654 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:26.962007 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wsfnl" event={"ID":"fa4ea0e6-081d-4f6f-a5db-f66831a07a15","Type":"ContainerDied","Data":"b76e9d50fdc0227864b4c85d04056194ac0aa798580dcb82ae9df9782546880b"} Jun 03 15:57:26.963696 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:26.963672 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/ovn-acl-logging/0.log" Jun 03 15:57:26.964073 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:26.964047 2575 generic.go:358] "Generic (PLEG): container finished" podID="cd98e600-3aa6-4647-be14-6b3a72074ed7" containerID="5038c3290c8c6b8a9d8e9da49f1d60f09563dc1191ded339a8841e864d5450ad" exitCode=1 Jun 03 15:57:26.964162 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:26.964113 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" event={"ID":"cd98e600-3aa6-4647-be14-6b3a72074ed7","Type":"ContainerDied","Data":"5038c3290c8c6b8a9d8e9da49f1d60f09563dc1191ded339a8841e864d5450ad"} Jun 03 15:57:26.964162 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:26.964146 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" event={"ID":"cd98e600-3aa6-4647-be14-6b3a72074ed7","Type":"ContainerStarted","Data":"806c2b2ace6ef5d4845b655f2d038946df8ca0ad58e36dcaf0d94651bb124af9"} Jun 03 15:57:26.965608 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:26.965590 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qf7wr" event={"ID":"42d28413-02d0-4f2f-adc2-4c08b3f0419d","Type":"ContainerStarted","Data":"3657d97603d2e742e3e9023e0d8af49cb77235c0fab01e879fb15e4ef502cfcc"} Jun 03 15:57:26.966983 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:26.966958 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-22mgv" event={"ID":"7a911b23-c625-4075-9942-eee0e418c89b","Type":"ContainerStarted","Data":"99492d561d06305dbf0cd73fcaa27067a948dd8a2d60826d9012e0a15993875b"} Jun 03 15:57:26.968321 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:26.968295 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rx47m" event={"ID":"773fe981-eb8d-4ad7-8434-78168e05801d","Type":"ContainerStarted","Data":"5fe65fc2e7a1057152d85af1d8dc93a0b7fd51e4f8a7a1a74e8b89cf8880604b"} Jun 03 15:57:26.969420 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:26.969403 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cmm55" event={"ID":"983ee38c-b506-4ac9-b241-37b0292bad9d","Type":"ContainerStarted","Data":"bd60848a21aaec692f53d021de370159f6f26440583d455106566176f2d34346"} Jun 03 15:57:26.970507 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:26.970490 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-96gss" event={"ID":"e98840fb-b4bc-48f4-b044-c91aa26a528b","Type":"ContainerStarted","Data":"fbc2cbfdcf11404521d7f3376634572b52960853d90d08d4d1c730b1e2548965"} Jun 03 15:57:26.971532 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:26.971503 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" event={"ID":"790580c1-afa7-4c35-853d-4fd9f45561cd","Type":"ContainerStarted","Data":"08d86386837668cf4a250c8cccc1c8d17f571ac7f2c9d59629a05c9d3672f87c"} Jun 03 15:57:26.998120 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:26.997984 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-96gss" podStartSLOduration=2.9416369639999997 podStartE2EDuration="20.997971102s" podCreationTimestamp="2026-06-03 15:57:06 +0000 UTC" firstStartedPulling="2026-06-03 15:57:08.474355388 +0000 UTC m=+3.141742428" lastFinishedPulling="2026-06-03 15:57:26.530689531 +0000 UTC m=+21.198076566" observedRunningTime="2026-06-03 15:57:26.997707398 +0000 UTC m=+21.665094445" watchObservedRunningTime="2026-06-03 15:57:26.997971102 +0000 UTC m=+21.665358150" Jun 03 15:57:27.011958 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:27.011911 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cmm55" podStartSLOduration=2.957974648 podStartE2EDuration="21.011896694s" podCreationTimestamp="2026-06-03 15:57:06 +0000 UTC" firstStartedPulling="2026-06-03 15:57:08.476245855 +0000 UTC m=+3.143632882" lastFinishedPulling="2026-06-03 15:57:26.530167891 +0000 UTC m=+21.197554928" observedRunningTime="2026-06-03 15:57:27.011652653 +0000 UTC m=+21.679039700" watchObservedRunningTime="2026-06-03 15:57:27.011896694 +0000 UTC m=+21.679283743" Jun 03 15:57:27.028681 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:27.028646 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-22mgv" podStartSLOduration=2.976921756 podStartE2EDuration="21.028633533s" podCreationTimestamp="2026-06-03 15:57:06 +0000 UTC" firstStartedPulling="2026-06-03 15:57:08.4814582 +0000 UTC m=+3.148845232" lastFinishedPulling="2026-06-03 15:57:26.53316997 +0000 UTC m=+21.200557009" observedRunningTime="2026-06-03 15:57:27.028352982 +0000 UTC m=+21.695740030" watchObservedRunningTime="2026-06-03 15:57:27.028633533 +0000 UTC m=+21.696020580" Jun 03 15:57:27.044194 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:27.044158 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-qf7wr" podStartSLOduration=3.965553941 podStartE2EDuration="22.044147677s" podCreationTimestamp="2026-06-03 15:57:05 +0000 UTC" firstStartedPulling="2026-06-03 15:57:08.468219915 +0000 UTC m=+3.135606957" lastFinishedPulling="2026-06-03 15:57:26.546813663 +0000 UTC m=+21.214200693" observedRunningTime="2026-06-03 15:57:27.044009941 +0000 UTC m=+21.711396988" watchObservedRunningTime="2026-06-03 15:57:27.044147677 +0000 UTC m=+21.711534738" Jun 03 15:57:27.071485 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:27.071448 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rx47m" podStartSLOduration=11.06624652 podStartE2EDuration="21.071435365s" podCreationTimestamp="2026-06-03 15:57:06 +0000 UTC" firstStartedPulling="2026-06-03 15:57:08.478424721 +0000 UTC m=+3.145811759" lastFinishedPulling="2026-06-03 15:57:18.483613562 +0000 UTC m=+13.151000604" observedRunningTime="2026-06-03 15:57:27.068731224 +0000 UTC m=+21.736118270" watchObservedRunningTime="2026-06-03 15:57:27.071435365 +0000 UTC m=+21.738822409" Jun 03 15:57:27.869661 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:27.869590 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:27.869817 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:27.869676 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:27.869817 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:27.869696 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:27.869817 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:27.869761 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm4zx" podUID="b55f5a62-2148-45e4-a39e-c1dcd628aa44" Jun 03 15:57:27.869938 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:27.869842 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h6md" podUID="6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd" Jun 03 15:57:27.869973 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:27.869935 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhw9d" podUID="8005fb8c-13cc-491f-bdb3-80744ed6306c" Jun 03 15:57:27.975437 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:27.975399 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r6t4v" event={"ID":"499fcfa6-bfea-4f27-8adc-a52a14c799b7","Type":"ContainerStarted","Data":"9df442b8e858a2c1977eb7995a56c40d0278fbacaa25e104966bbb61363edd1a"} Jun 03 15:57:27.978028 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:27.978003 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/ovn-acl-logging/0.log" Jun 03 15:57:27.978452 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:27.978425 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" event={"ID":"cd98e600-3aa6-4647-be14-6b3a72074ed7","Type":"ContainerStarted","Data":"eaba455e608d2f5a90675beadcc737359af174c74aacbe8985920f318243bc44"} Jun 03 15:57:27.978574 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:27.978461 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" event={"ID":"cd98e600-3aa6-4647-be14-6b3a72074ed7","Type":"ContainerStarted","Data":"14b7cdf6d0bf8df16b12b4b28c3040ac218181dc37589e51dcd6539a83679c74"} Jun 03 15:57:27.978574 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:27.978477 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" event={"ID":"cd98e600-3aa6-4647-be14-6b3a72074ed7","Type":"ContainerStarted","Data":"8281e0f68f546aad12622a02122b02905d530f034aaa048a5a1abc10e0122ced"} Jun 03 15:57:27.978574 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:27.978488 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" event={"ID":"cd98e600-3aa6-4647-be14-6b3a72074ed7","Type":"ContainerStarted","Data":"21ec7831e0548b4c086afd8eb13fc76b0b3f6d1136d94094219286843eba687d"} Jun 03 15:57:27.989431 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:27.989391 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r6t4v" podStartSLOduration=3.936816758 podStartE2EDuration="21.989380364s" podCreationTimestamp="2026-06-03 15:57:06 +0000 UTC" firstStartedPulling="2026-06-03 15:57:08.47813049 +0000 UTC m=+3.145517515" lastFinishedPulling="2026-06-03 15:57:26.530694083 +0000 UTC m=+21.198081121" observedRunningTime="2026-06-03 15:57:27.988719649 +0000 UTC m=+22.656106696" watchObservedRunningTime="2026-06-03 15:57:27.989380364 +0000 UTC m=+22.656767411" Jun 03 15:57:28.230246 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:28.230220 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 15:57:28.850584 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:28.850368 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T15:57:28.230240748Z","UUID":"f2004f45-c3b5-4f30-96d5-89cc5cc5c409","Handler":null,"Name":"","Endpoint":""} Jun 03 15:57:28.853749 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:28.853725 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 15:57:28.853894 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:28.853759 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 15:57:28.982440 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:28.982385 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" event={"ID":"790580c1-afa7-4c35-853d-4fd9f45561cd","Type":"ContainerStarted","Data":"b09cc6161c451565d5a96deb5eed78016232edf245503fac72d96eb4eb0bde74"} Jun 03 15:57:29.869055 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:29.868972 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:29.869055 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:29.868999 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:29.869219 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:29.868975 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:29.869219 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:29.869078 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm4zx" podUID="b55f5a62-2148-45e4-a39e-c1dcd628aa44" Jun 03 15:57:29.869219 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:29.869141 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhw9d" podUID="8005fb8c-13cc-491f-bdb3-80744ed6306c" Jun 03 15:57:29.869219 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:29.869210 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h6md" podUID="6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd" Jun 03 15:57:29.986456 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:29.986424 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" event={"ID":"790580c1-afa7-4c35-853d-4fd9f45561cd","Type":"ContainerStarted","Data":"b78bf20151690b3776bc1394881c666a5f35e4f2bb58ef9a695d7e5b9b19b251"} Jun 03 15:57:29.988982 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:29.988963 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/ovn-acl-logging/0.log" Jun 03 15:57:29.989307 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:29.989289 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" event={"ID":"cd98e600-3aa6-4647-be14-6b3a72074ed7","Type":"ContainerStarted","Data":"d3087691fa87b8c7236cecfe306d8aa341bfea4e3ff6e903bba4d43f8edb188f"} Jun 03 15:57:30.004610 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:30.004566 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qkbgd" podStartSLOduration=3.086546509 podStartE2EDuration="24.004553515s" podCreationTimestamp="2026-06-03 15:57:06 +0000 UTC" firstStartedPulling="2026-06-03 15:57:08.481448008 +0000 UTC m=+3.148835042" lastFinishedPulling="2026-06-03 15:57:29.399455009 +0000 UTC m=+24.066842048" observedRunningTime="2026-06-03 15:57:30.004101007 +0000 UTC m=+24.671488078" watchObservedRunningTime="2026-06-03 15:57:30.004553515 +0000 UTC m=+24.671940558" Jun 03 15:57:31.518257 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:31.518215 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cmm55" Jun 03 15:57:31.518912 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:31.518894 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cmm55" Jun 03 15:57:31.868738 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:31.868618 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:31.868738 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:31.868647 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:31.868738 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:31.868618 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:31.868974 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:31.868763 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h6md" podUID="6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd" Jun 03 15:57:31.868974 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:31.868835 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm4zx" podUID="b55f5a62-2148-45e4-a39e-c1dcd628aa44" Jun 03 15:57:31.868974 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:31.868957 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhw9d" podUID="8005fb8c-13cc-491f-bdb3-80744ed6306c" Jun 03 15:57:31.997171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:31.997146 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/ovn-acl-logging/0.log" Jun 03 15:57:31.997917 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:31.997810 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cmm55" Jun 03 15:57:31.998637 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:31.998619 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cmm55" Jun 03 15:57:33.000958 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:33.000775 2575 generic.go:358] "Generic (PLEG): container finished" podID="fa4ea0e6-081d-4f6f-a5db-f66831a07a15" containerID="3a386aacfa0ac9275063430ea219b8ea79176d55e6f51f205a8288b2bd3c30e1" exitCode=0 Jun 03 15:57:33.001686 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:33.000860 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wsfnl" event={"ID":"fa4ea0e6-081d-4f6f-a5db-f66831a07a15","Type":"ContainerDied","Data":"3a386aacfa0ac9275063430ea219b8ea79176d55e6f51f205a8288b2bd3c30e1"} Jun 03 15:57:33.003932 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:33.003917 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/ovn-acl-logging/0.log" Jun 03 15:57:33.004309 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:33.004292 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" event={"ID":"cd98e600-3aa6-4647-be14-6b3a72074ed7","Type":"ContainerStarted","Data":"c6c8e24414f4ff59ec709984ce4cab78fd60f0bf67f8920e4392c8a94ea8240d"} Jun 03 15:57:33.004534 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:33.004518 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:33.004584 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:33.004545 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:33.004669 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:33.004651 2575 scope.go:117] "RemoveContainer" containerID="5038c3290c8c6b8a9d8e9da49f1d60f09563dc1191ded339a8841e864d5450ad" Jun 03 15:57:33.020309 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:33.020289 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:33.020395 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:33.020377 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:33.868986 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:33.868960 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:33.869109 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:33.868960 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:33.869109 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:33.869053 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm4zx" podUID="b55f5a62-2148-45e4-a39e-c1dcd628aa44" Jun 03 15:57:33.869216 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:33.869146 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhw9d" podUID="8005fb8c-13cc-491f-bdb3-80744ed6306c" Jun 03 15:57:33.869216 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:33.869171 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:33.869333 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:33.869291 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h6md" podUID="6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd" Jun 03 15:57:33.916044 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:33.916019 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6h6md"] Jun 03 15:57:33.919576 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:33.919551 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hm4zx"] Jun 03 15:57:33.920035 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:33.920012 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dhw9d"] Jun 03 15:57:34.008155 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:34.008076 2575 generic.go:358] "Generic (PLEG): container finished" podID="fa4ea0e6-081d-4f6f-a5db-f66831a07a15" containerID="ca2ef4832634f654ebcc2150ba402e424cc785f45ee5a2843ae73e1c38c7c871" exitCode=0 Jun 03 15:57:34.008620 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:34.008168 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wsfnl" event={"ID":"fa4ea0e6-081d-4f6f-a5db-f66831a07a15","Type":"ContainerDied","Data":"ca2ef4832634f654ebcc2150ba402e424cc785f45ee5a2843ae73e1c38c7c871"} Jun 03 15:57:34.011507 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:34.011487 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/ovn-acl-logging/0.log" Jun 03 15:57:34.011858 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:34.011788 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" event={"ID":"cd98e600-3aa6-4647-be14-6b3a72074ed7","Type":"ContainerStarted","Data":"d15e7d1689c04d692ecf732b1a9ade0f7ea4b97243be3f26a743055b5bd15122"} Jun 03 15:57:34.011858 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:34.011841 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:34.011993 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:34.011877 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:34.011993 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:34.011955 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm4zx" podUID="b55f5a62-2148-45e4-a39e-c1dcd628aa44" Jun 03 15:57:34.012069 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:34.012019 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhw9d" podUID="8005fb8c-13cc-491f-bdb3-80744ed6306c" Jun 03 15:57:34.012069 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:34.012056 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:34.012136 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:34.012110 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h6md" podUID="6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd" Jun 03 15:57:34.012331 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:34.012316 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 15:57:34.054971 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:34.054922 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" podStartSLOduration=9.935793314 podStartE2EDuration="28.0549042s" podCreationTimestamp="2026-06-03 15:57:06 +0000 UTC" firstStartedPulling="2026-06-03 15:57:08.469206375 +0000 UTC m=+3.136593401" lastFinishedPulling="2026-06-03 15:57:26.588317255 +0000 UTC m=+21.255704287" observedRunningTime="2026-06-03 15:57:34.054016649 +0000 UTC m=+28.721403696" watchObservedRunningTime="2026-06-03 15:57:34.0549042 +0000 UTC m=+28.722291248" Jun 03 15:57:35.015754 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:35.015724 2575 generic.go:358] "Generic (PLEG): container finished" podID="fa4ea0e6-081d-4f6f-a5db-f66831a07a15" containerID="c4778a6be9edc81f585e939eb5e51f5ac3cf46fed196ea59ac5b82739395b5b1" exitCode=0 Jun 03 15:57:35.016124 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:35.015804 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wsfnl" event={"ID":"fa4ea0e6-081d-4f6f-a5db-f66831a07a15","Type":"ContainerDied","Data":"c4778a6be9edc81f585e939eb5e51f5ac3cf46fed196ea59ac5b82739395b5b1"} Jun 03 15:57:35.016124 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:35.015922 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 15:57:35.164645 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:35.164615 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:57:35.871337 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:35.871172 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:35.871468 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:35.871193 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:35.871468 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:35.871414 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhw9d" podUID="8005fb8c-13cc-491f-bdb3-80744ed6306c" Jun 03 15:57:35.871557 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:35.871254 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:35.871557 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:35.871524 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h6md" podUID="6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd" Jun 03 15:57:35.871626 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:35.871603 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm4zx" podUID="b55f5a62-2148-45e4-a39e-c1dcd628aa44" Jun 03 15:57:36.032107 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:36.032056 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" podUID="cd98e600-3aa6-4647-be14-6b3a72074ed7" containerName="ovnkube-controller" probeResult="failure" output="" Jun 03 15:57:37.871874 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:37.871838 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:37.872464 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:37.871838 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:37.872464 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:37.871973 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hm4zx" podUID="b55f5a62-2148-45e4-a39e-c1dcd628aa44" Jun 03 15:57:37.872464 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:37.872049 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhw9d" podUID="8005fb8c-13cc-491f-bdb3-80744ed6306c" Jun 03 15:57:37.872464 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:37.871864 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:37.872464 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:37.872128 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6h6md" podUID="6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd" Jun 03 15:57:39.141726 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.141691 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-89.ec2.internal" event="NodeReady" Jun 03 15:57:39.142333 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.141850 2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 15:57:39.176186 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.176154 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6db4ffc696-rnmgh"] Jun 03 15:57:39.181219 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.181197 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.183777 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.183753 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 15:57:39.183777 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.183766 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 15:57:39.184024 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.184007 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2c4jd\"" Jun 03 15:57:39.184096 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.184064 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 15:57:39.190005 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.189783 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 15:57:39.191885 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.191863 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db4ffc696-rnmgh"] Jun 03 15:57:39.194051 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.194024 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7h2s8"] Jun 03 15:57:39.197607 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.197586 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v67kr"] Jun 03 15:57:39.197747 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.197730 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7h2s8" Jun 03 15:57:39.200245 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.200223 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 15:57:39.200479 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.200464 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 15:57:39.200555 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.200495 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 15:57:39.200555 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.200503 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-drwlt\"" Jun 03 15:57:39.201215 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.201198 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v67kr" Jun 03 15:57:39.203461 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.203441 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 15:57:39.203565 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.203476 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 15:57:39.203768 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.203747 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vbxw8\"" Jun 03 15:57:39.208456 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.207977 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v67kr"] Jun 03 15:57:39.213094 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.213073 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7h2s8"] Jun 03 15:57:39.341452 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.341366 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.341452 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.341416 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4465e033-8e83-4a18-92fc-16596d24a5d3-config-volume\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:57:39.341452 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.341451 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4465e033-8e83-4a18-92fc-16596d24a5d3-tmp-dir\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:57:39.341707 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.341478 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72545bb0-dbef-4456-8418-0566192ff7d9-installation-pull-secrets\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.341707 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.341501 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtmxr\" (UniqueName: \"kubernetes.io/projected/4465e033-8e83-4a18-92fc-16596d24a5d3-kube-api-access-vtmxr\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:57:39.341707 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.341552 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfg92\" (UniqueName: \"kubernetes.io/projected/14eb1552-43bf-42ab-9e89-982e0cf1d219-kube-api-access-nfg92\") pod \"ingress-canary-7h2s8\" (UID: \"14eb1552-43bf-42ab-9e89-982e0cf1d219\") " pod="openshift-ingress-canary/ingress-canary-7h2s8" Jun 03 15:57:39.341707 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.341576 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72545bb0-dbef-4456-8418-0566192ff7d9-registry-certificates\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.341707 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.341610 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert\") pod \"ingress-canary-7h2s8\" (UID: \"14eb1552-43bf-42ab-9e89-982e0cf1d219\") " pod="openshift-ingress-canary/ingress-canary-7h2s8" Jun 03 15:57:39.341707 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.341632 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jdvf\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-kube-api-access-6jdvf\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.341707 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.341653 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:57:39.341707 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.341673 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72545bb0-dbef-4456-8418-0566192ff7d9-trusted-ca\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.342056 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.341717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72545bb0-dbef-4456-8418-0566192ff7d9-image-registry-private-configuration\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.342056 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.341753 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72545bb0-dbef-4456-8418-0566192ff7d9-ca-trust-extracted\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.342056 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.341770 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-bound-sa-token\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.442718 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.442665 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72545bb0-dbef-4456-8418-0566192ff7d9-installation-pull-secrets\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.442718 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.442718 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmxr\" (UniqueName: \"kubernetes.io/projected/4465e033-8e83-4a18-92fc-16596d24a5d3-kube-api-access-vtmxr\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:57:39.442948 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.442758 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfg92\" (UniqueName: \"kubernetes.io/projected/14eb1552-43bf-42ab-9e89-982e0cf1d219-kube-api-access-nfg92\") pod \"ingress-canary-7h2s8\" (UID: \"14eb1552-43bf-42ab-9e89-982e0cf1d219\") " pod="openshift-ingress-canary/ingress-canary-7h2s8" Jun 03 15:57:39.442948 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.442783 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72545bb0-dbef-4456-8418-0566192ff7d9-registry-certificates\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.442948 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.442820 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert\") pod \"ingress-canary-7h2s8\" (UID: \"14eb1552-43bf-42ab-9e89-982e0cf1d219\") " pod="openshift-ingress-canary/ingress-canary-7h2s8" Jun 03 15:57:39.442948 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.442847 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jdvf\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-kube-api-access-6jdvf\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.442948 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.442877 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:57:39.442948 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.442904 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72545bb0-dbef-4456-8418-0566192ff7d9-trusted-ca\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.442948 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.442924 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:57:39.442948 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.442942 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72545bb0-dbef-4456-8418-0566192ff7d9-image-registry-private-configuration\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.443293 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.442987 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert podName:14eb1552-43bf-42ab-9e89-982e0cf1d219 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:39.942972545 +0000 UTC m=+34.610359579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert") pod "ingress-canary-7h2s8" (UID: "14eb1552-43bf-42ab-9e89-982e0cf1d219") : secret "canary-serving-cert" not found Jun 03 15:57:39.443293 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.443006 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72545bb0-dbef-4456-8418-0566192ff7d9-ca-trust-extracted\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.443293 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.443031 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-bound-sa-token\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.443293 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.443057 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.443293 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.443084 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4465e033-8e83-4a18-92fc-16596d24a5d3-config-volume\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:57:39.443293 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.443100 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4465e033-8e83-4a18-92fc-16596d24a5d3-tmp-dir\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:57:39.443578 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.443410 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4465e033-8e83-4a18-92fc-16596d24a5d3-tmp-dir\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:57:39.443578 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.443482 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72545bb0-dbef-4456-8418-0566192ff7d9-registry-certificates\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.443578 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.443502 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:57:39.443578 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.443515 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db4ffc696-rnmgh: secret "image-registry-tls" not found Jun 03 15:57:39.443578 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.443558 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls podName:72545bb0-dbef-4456-8418-0566192ff7d9 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:39.943542313 +0000 UTC m=+34.610929353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls") pod "image-registry-6db4ffc696-rnmgh" (UID: "72545bb0-dbef-4456-8418-0566192ff7d9") : secret "image-registry-tls" not found Jun 03 15:57:39.443578 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.443571 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:57:39.443802 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.443626 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls podName:4465e033-8e83-4a18-92fc-16596d24a5d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:39.943605869 +0000 UTC m=+34.610992909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls") pod "dns-default-v67kr" (UID: "4465e033-8e83-4a18-92fc-16596d24a5d3") : secret "dns-default-metrics-tls" not found Jun 03 15:57:39.443802 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.443791 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72545bb0-dbef-4456-8418-0566192ff7d9-ca-trust-extracted\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.444074 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.444030 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4465e033-8e83-4a18-92fc-16596d24a5d3-config-volume\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:57:39.444401 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.444381 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72545bb0-dbef-4456-8418-0566192ff7d9-trusted-ca\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.447306 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.447286 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72545bb0-dbef-4456-8418-0566192ff7d9-image-registry-private-configuration\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.447306 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.447293 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72545bb0-dbef-4456-8418-0566192ff7d9-installation-pull-secrets\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.455207 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.455184 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfg92\" (UniqueName: \"kubernetes.io/projected/14eb1552-43bf-42ab-9e89-982e0cf1d219-kube-api-access-nfg92\") pod \"ingress-canary-7h2s8\" (UID: \"14eb1552-43bf-42ab-9e89-982e0cf1d219\") " pod="openshift-ingress-canary/ingress-canary-7h2s8" Jun 03 15:57:39.455626 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.455606 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtmxr\" (UniqueName: \"kubernetes.io/projected/4465e033-8e83-4a18-92fc-16596d24a5d3-kube-api-access-vtmxr\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:57:39.456171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.456136 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-bound-sa-token\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.456315 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.456295 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jdvf\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-kube-api-access-6jdvf\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.543955 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.543915 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs\") pod \"network-metrics-daemon-6h6md\" (UID: \"6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd\") " pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:39.544120 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.544078 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:57:39.544204 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.544192 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs podName:6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd nodeName:}" failed. No retries permitted until 2026-06-03 15:58:11.544169495 +0000 UTC m=+66.211556525 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs") pod "network-metrics-daemon-6h6md" (UID: "6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:57:39.645323 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.645224 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret\") pod \"global-pull-secret-syncer-dhw9d\" (UID: \"8005fb8c-13cc-491f-bdb3-80744ed6306c\") " pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:39.645477 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.645391 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:57:39.645530 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.645479 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret podName:8005fb8c-13cc-491f-bdb3-80744ed6306c nodeName:}" failed. No retries permitted until 2026-06-03 15:58:11.645457022 +0000 UTC m=+66.312844052 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret") pod "global-pull-secret-syncer-dhw9d" (UID: "8005fb8c-13cc-491f-bdb3-80744ed6306c") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:57:39.746410 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.746373 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rfn5\" (UniqueName: \"kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5\") pod \"network-check-target-hm4zx\" (UID: \"b55f5a62-2148-45e4-a39e-c1dcd628aa44\") " pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:39.746585 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.746547 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:57:39.746585 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.746572 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:57:39.746585 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.746585 2575 projected.go:194] Error preparing data for projected volume kube-api-access-7rfn5 for pod openshift-network-diagnostics/network-check-target-hm4zx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:57:39.746735 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.746653 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5 podName:b55f5a62-2148-45e4-a39e-c1dcd628aa44 nodeName:}" failed. No retries permitted until 2026-06-03 15:58:11.746633083 +0000 UTC m=+66.414020111 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7rfn5" (UniqueName: "kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5") pod "network-check-target-hm4zx" (UID: "b55f5a62-2148-45e4-a39e-c1dcd628aa44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:57:39.872210 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.872170 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:57:39.872377 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.872317 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:57:39.872431 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.872402 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:57:39.875358 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.875291 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 15:57:39.875505 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.875357 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 15:57:39.875505 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.875359 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qk87p\"" Jun 03 15:57:39.875505 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.875418 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 15:57:39.875682 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.875663 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:57:39.875737 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.875700 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xx6f7\"" Jun 03 15:57:39.948486 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.948397 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert\") pod \"ingress-canary-7h2s8\" (UID: \"14eb1552-43bf-42ab-9e89-982e0cf1d219\") " pod="openshift-ingress-canary/ingress-canary-7h2s8" Jun 03 15:57:39.948486 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.948449 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:57:39.948683 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:39.948521 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:39.948683 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.948545 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:57:39.948683 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.948605 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert podName:14eb1552-43bf-42ab-9e89-982e0cf1d219 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:40.948587111 +0000 UTC m=+35.615974156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert") pod "ingress-canary-7h2s8" (UID: "14eb1552-43bf-42ab-9e89-982e0cf1d219") : secret "canary-serving-cert" not found Jun 03 15:57:39.948683 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.948613 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:57:39.948683 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.948616 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:57:39.948683 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.948624 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db4ffc696-rnmgh: secret "image-registry-tls" not found Jun 03 15:57:39.948932 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.948674 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls podName:4465e033-8e83-4a18-92fc-16596d24a5d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:40.948656185 +0000 UTC m=+35.616043210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls") pod "dns-default-v67kr" (UID: "4465e033-8e83-4a18-92fc-16596d24a5d3") : secret "dns-default-metrics-tls" not found Jun 03 15:57:39.948932 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:39.948739 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls podName:72545bb0-dbef-4456-8418-0566192ff7d9 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:40.948725864 +0000 UTC m=+35.616112906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls") pod "image-registry-6db4ffc696-rnmgh" (UID: "72545bb0-dbef-4456-8418-0566192ff7d9") : secret "image-registry-tls" not found Jun 03 15:57:40.957061 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:40.957022 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert\") pod \"ingress-canary-7h2s8\" (UID: \"14eb1552-43bf-42ab-9e89-982e0cf1d219\") " pod="openshift-ingress-canary/ingress-canary-7h2s8" Jun 03 15:57:40.957679 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:40.957076 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:57:40.957679 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:40.957155 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:40.957679 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:40.957161 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:57:40.957679 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:40.957231 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert podName:14eb1552-43bf-42ab-9e89-982e0cf1d219 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:42.957210092 +0000 UTC m=+37.624597126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert") pod "ingress-canary-7h2s8" (UID: "14eb1552-43bf-42ab-9e89-982e0cf1d219") : secret "canary-serving-cert" not found Jun 03 15:57:40.957679 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:40.957297 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:57:40.957679 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:40.957313 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db4ffc696-rnmgh: secret "image-registry-tls" not found Jun 03 15:57:40.957679 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:40.957350 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls podName:72545bb0-dbef-4456-8418-0566192ff7d9 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:42.957338726 +0000 UTC m=+37.624725767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls") pod "image-registry-6db4ffc696-rnmgh" (UID: "72545bb0-dbef-4456-8418-0566192ff7d9") : secret "image-registry-tls" not found Jun 03 15:57:40.957679 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:40.957299 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:57:40.957679 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:40.957390 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls podName:4465e033-8e83-4a18-92fc-16596d24a5d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:42.957383194 +0000 UTC m=+37.624770220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls") pod "dns-default-v67kr" (UID: "4465e033-8e83-4a18-92fc-16596d24a5d3") : secret "dns-default-metrics-tls" not found Jun 03 15:57:42.032072 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:42.032040 2575 generic.go:358] "Generic (PLEG): container finished" podID="fa4ea0e6-081d-4f6f-a5db-f66831a07a15" containerID="278f29bf7a2224bf183e9d6b6d034eaa7e6e3625a663095171dd39082f41f91f" exitCode=0 Jun 03 15:57:42.032509 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:42.032091 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wsfnl" event={"ID":"fa4ea0e6-081d-4f6f-a5db-f66831a07a15","Type":"ContainerDied","Data":"278f29bf7a2224bf183e9d6b6d034eaa7e6e3625a663095171dd39082f41f91f"} Jun 03 15:57:42.973545 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:42.973485 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert\") pod \"ingress-canary-7h2s8\" (UID: \"14eb1552-43bf-42ab-9e89-982e0cf1d219\") " pod="openshift-ingress-canary/ingress-canary-7h2s8" Jun 03 15:57:42.973721 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:42.973558 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:57:42.973721 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:42.973626 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:42.973721 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:42.973636 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:57:42.973721 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:42.973696 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:57:42.973846 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:42.973701 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert podName:14eb1552-43bf-42ab-9e89-982e0cf1d219 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:46.973681145 +0000 UTC m=+41.641068188 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert") pod "ingress-canary-7h2s8" (UID: "14eb1552-43bf-42ab-9e89-982e0cf1d219") : secret "canary-serving-cert" not found Jun 03 15:57:42.973846 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:42.973745 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:57:42.973846 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:42.973757 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db4ffc696-rnmgh: secret "image-registry-tls" not found Jun 03 15:57:42.973846 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:42.973757 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls podName:4465e033-8e83-4a18-92fc-16596d24a5d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:46.973744806 +0000 UTC m=+41.641131834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls") pod "dns-default-v67kr" (UID: "4465e033-8e83-4a18-92fc-16596d24a5d3") : secret "dns-default-metrics-tls" not found Jun 03 15:57:42.973846 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:42.973801 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls podName:72545bb0-dbef-4456-8418-0566192ff7d9 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:46.973790274 +0000 UTC m=+41.641177303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls") pod "image-registry-6db4ffc696-rnmgh" (UID: "72545bb0-dbef-4456-8418-0566192ff7d9") : secret "image-registry-tls" not found Jun 03 15:57:43.036799 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:43.036624 2575 generic.go:358] "Generic (PLEG): container finished" podID="fa4ea0e6-081d-4f6f-a5db-f66831a07a15" containerID="768b0b3fdcfb0f8a7ed6392359f55e5ebaefcf845d66115705a88578b557e9be" exitCode=0 Jun 03 15:57:43.037166 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:43.036702 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wsfnl" event={"ID":"fa4ea0e6-081d-4f6f-a5db-f66831a07a15","Type":"ContainerDied","Data":"768b0b3fdcfb0f8a7ed6392359f55e5ebaefcf845d66115705a88578b557e9be"} Jun 03 15:57:44.041503 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:44.041467 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wsfnl" event={"ID":"fa4ea0e6-081d-4f6f-a5db-f66831a07a15","Type":"ContainerStarted","Data":"997686f26b555942dc57e46bdc13932c792261f86c943c39587930b7a3ccea47"} Jun 03 15:57:44.067180 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:44.067131 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wsfnl" podStartSLOduration=6.052540117 podStartE2EDuration="39.067117674s" podCreationTimestamp="2026-06-03 15:57:05 +0000 UTC" firstStartedPulling="2026-06-03 15:57:08.47320095 +0000 UTC m=+3.140587988" lastFinishedPulling="2026-06-03 15:57:41.487778517 +0000 UTC m=+36.155165545" observedRunningTime="2026-06-03 15:57:44.066857294 +0000 UTC m=+38.734244355" watchObservedRunningTime="2026-06-03 15:57:44.067117674 +0000 UTC m=+38.734504721" Jun 03 15:57:47.001472 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:47.001428 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert\") pod \"ingress-canary-7h2s8\" (UID: \"14eb1552-43bf-42ab-9e89-982e0cf1d219\") " pod="openshift-ingress-canary/ingress-canary-7h2s8" Jun 03 15:57:47.001472 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:47.001479 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:57:47.001946 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:47.001552 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:47.001946 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:47.001571 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:57:47.001946 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:47.001631 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert podName:14eb1552-43bf-42ab-9e89-982e0cf1d219 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:55.00161575 +0000 UTC m=+49.669002776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert") pod "ingress-canary-7h2s8" (UID: "14eb1552-43bf-42ab-9e89-982e0cf1d219") : secret "canary-serving-cert" not found Jun 03 15:57:47.001946 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:47.001638 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:57:47.001946 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:47.001678 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:57:47.001946 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:47.001691 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db4ffc696-rnmgh: secret "image-registry-tls" not found Jun 03 15:57:47.001946 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:47.001723 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls podName:4465e033-8e83-4a18-92fc-16596d24a5d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:55.001685459 +0000 UTC m=+49.669072484 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls") pod "dns-default-v67kr" (UID: "4465e033-8e83-4a18-92fc-16596d24a5d3") : secret "dns-default-metrics-tls" not found Jun 03 15:57:47.001946 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:47.001738 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls podName:72545bb0-dbef-4456-8418-0566192ff7d9 nodeName:}" failed. No retries permitted until 2026-06-03 15:57:55.001732127 +0000 UTC m=+49.669119152 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls") pod "image-registry-6db4ffc696-rnmgh" (UID: "72545bb0-dbef-4456-8418-0566192ff7d9") : secret "image-registry-tls" not found Jun 03 15:57:55.056839 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:55.056797 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert\") pod \"ingress-canary-7h2s8\" (UID: \"14eb1552-43bf-42ab-9e89-982e0cf1d219\") " pod="openshift-ingress-canary/ingress-canary-7h2s8" Jun 03 15:57:55.056839 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:55.056839 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:57:55.057351 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:57:55.056896 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:57:55.057351 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:55.056947 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:57:55.057351 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:55.057003 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:57:55.057351 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:55.057012 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:57:55.057351 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:55.057019 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db4ffc696-rnmgh: secret "image-registry-tls" not found Jun 03 15:57:55.057351 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:55.057021 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert podName:14eb1552-43bf-42ab-9e89-982e0cf1d219 nodeName:}" failed. No retries permitted until 2026-06-03 15:58:11.05700492 +0000 UTC m=+65.724391951 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert") pod "ingress-canary-7h2s8" (UID: "14eb1552-43bf-42ab-9e89-982e0cf1d219") : secret "canary-serving-cert" not found Jun 03 15:57:55.057351 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:55.057082 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls podName:72545bb0-dbef-4456-8418-0566192ff7d9 nodeName:}" failed. No retries permitted until 2026-06-03 15:58:11.057064978 +0000 UTC m=+65.724452004 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls") pod "image-registry-6db4ffc696-rnmgh" (UID: "72545bb0-dbef-4456-8418-0566192ff7d9") : secret "image-registry-tls" not found Jun 03 15:57:55.057351 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:57:55.057092 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls podName:4465e033-8e83-4a18-92fc-16596d24a5d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:58:11.057087111 +0000 UTC m=+65.724474136 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls") pod "dns-default-v67kr" (UID: "4465e033-8e83-4a18-92fc-16596d24a5d3") : secret "dns-default-metrics-tls" not found Jun 03 15:58:06.028794 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:06.028763 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfbq8" Jun 03 15:58:11.078320 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:11.078278 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:58:11.078823 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:11.078358 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert\") pod \"ingress-canary-7h2s8\" (UID: \"14eb1552-43bf-42ab-9e89-982e0cf1d219\") " pod="openshift-ingress-canary/ingress-canary-7h2s8" Jun 03 15:58:11.078823 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:11.078381 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:58:11.078823 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:11.078387 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:58:11.078823 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:11.078410 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db4ffc696-rnmgh: secret "image-registry-tls" not found Jun 03 15:58:11.078823 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:11.078478 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls podName:72545bb0-dbef-4456-8418-0566192ff7d9 nodeName:}" failed. No retries permitted until 2026-06-03 15:58:43.078461573 +0000 UTC m=+97.745848598 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls") pod "image-registry-6db4ffc696-rnmgh" (UID: "72545bb0-dbef-4456-8418-0566192ff7d9") : secret "image-registry-tls" not found Jun 03 15:58:11.078823 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:11.078478 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:58:11.078823 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:11.078483 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:58:11.078823 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:11.078526 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls podName:4465e033-8e83-4a18-92fc-16596d24a5d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:58:43.078515414 +0000 UTC m=+97.745902440 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls") pod "dns-default-v67kr" (UID: "4465e033-8e83-4a18-92fc-16596d24a5d3") : secret "dns-default-metrics-tls" not found Jun 03 15:58:11.078823 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:11.078542 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert podName:14eb1552-43bf-42ab-9e89-982e0cf1d219 nodeName:}" failed. No retries permitted until 2026-06-03 15:58:43.07853284 +0000 UTC m=+97.745919865 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert") pod "ingress-canary-7h2s8" (UID: "14eb1552-43bf-42ab-9e89-982e0cf1d219") : secret "canary-serving-cert" not found Jun 03 15:58:11.583092 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:11.583053 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs\") pod \"network-metrics-daemon-6h6md\" (UID: \"6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd\") " pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:58:11.585570 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:11.585551 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:58:11.593393 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:11.593378 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 15:58:11.593465 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:11.593429 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs podName:6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd nodeName:}" failed. No retries permitted until 2026-06-03 15:59:15.593413857 +0000 UTC m=+130.260800881 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs") pod "network-metrics-daemon-6h6md" (UID: "6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd") : secret "metrics-daemon-secret" not found Jun 03 15:58:11.683777 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:11.683744 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret\") pod \"global-pull-secret-syncer-dhw9d\" (UID: \"8005fb8c-13cc-491f-bdb3-80744ed6306c\") " pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:58:11.686651 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:11.686632 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 15:58:11.697555 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:11.697524 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8005fb8c-13cc-491f-bdb3-80744ed6306c-original-pull-secret\") pod \"global-pull-secret-syncer-dhw9d\" (UID: \"8005fb8c-13cc-491f-bdb3-80744ed6306c\") " pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:58:11.784245 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:11.784211 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rfn5\" (UniqueName: \"kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5\") pod \"network-check-target-hm4zx\" (UID: \"b55f5a62-2148-45e4-a39e-c1dcd628aa44\") " pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:58:11.786868 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:11.786852 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 15:58:11.796943 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:11.796920 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 15:58:11.808042 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:11.808010 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rfn5\" (UniqueName: \"kubernetes.io/projected/b55f5a62-2148-45e4-a39e-c1dcd628aa44-kube-api-access-7rfn5\") pod \"network-check-target-hm4zx\" (UID: \"b55f5a62-2148-45e4-a39e-c1dcd628aa44\") " pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:58:11.994151 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:11.994069 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xx6f7\"" Jun 03 15:58:11.996854 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:11.996834 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhw9d" Jun 03 15:58:12.001559 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:12.001521 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:58:12.182043 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:12.182012 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dhw9d"] Jun 03 15:58:12.185807 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:58:12.185771 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8005fb8c_13cc_491f_bdb3_80744ed6306c.slice/crio-45e47c208c87fad8b309e2bddccea5d1c7cfabdbe021820a489b43dadccbd736 WatchSource:0}: Error finding container 45e47c208c87fad8b309e2bddccea5d1c7cfabdbe021820a489b43dadccbd736: Status 404 returned error can't find the container with id 45e47c208c87fad8b309e2bddccea5d1c7cfabdbe021820a489b43dadccbd736 Jun 03 15:58:12.195297 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:12.195258 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hm4zx"] Jun 03 15:58:12.200062 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:58:12.200037 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb55f5a62_2148_45e4_a39e_c1dcd628aa44.slice/crio-35e34ffa7331057b4c5083a671b1de716442fddd268f447efae4baad7e4284a8 WatchSource:0}: Error finding container 35e34ffa7331057b4c5083a671b1de716442fddd268f447efae4baad7e4284a8: Status 404 returned error can't find the container with id 35e34ffa7331057b4c5083a671b1de716442fddd268f447efae4baad7e4284a8 Jun 03 15:58:13.097871 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:13.097832 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hm4zx" event={"ID":"b55f5a62-2148-45e4-a39e-c1dcd628aa44","Type":"ContainerStarted","Data":"35e34ffa7331057b4c5083a671b1de716442fddd268f447efae4baad7e4284a8"} Jun 03 15:58:13.099136 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:13.099105 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dhw9d" event={"ID":"8005fb8c-13cc-491f-bdb3-80744ed6306c","Type":"ContainerStarted","Data":"45e47c208c87fad8b309e2bddccea5d1c7cfabdbe021820a489b43dadccbd736"} Jun 03 15:58:17.108332 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:17.108290 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hm4zx" event={"ID":"b55f5a62-2148-45e4-a39e-c1dcd628aa44","Type":"ContainerStarted","Data":"a5ca1f83ad35b7b1ec1fd9e13b9fbc6e00aed269b45dd55878d235bd63e5e570"} Jun 03 15:58:17.108788 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:17.108405 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:58:17.109603 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:17.109579 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dhw9d" event={"ID":"8005fb8c-13cc-491f-bdb3-80744ed6306c","Type":"ContainerStarted","Data":"96069dcf8c70701ee11d7f90f6c6b98abd4be61b0f84abb26df930397dfcb281"} Jun 03 15:58:17.123540 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:17.123501 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hm4zx" podStartSLOduration=66.866038787 podStartE2EDuration="1m11.123490319s" podCreationTimestamp="2026-06-03 15:57:06 +0000 UTC" firstStartedPulling="2026-06-03 15:58:12.201805924 +0000 UTC m=+66.869192948" lastFinishedPulling="2026-06-03 15:58:16.459257452 +0000 UTC m=+71.126644480" observedRunningTime="2026-06-03 15:58:17.123205905 +0000 UTC m=+71.790592953" watchObservedRunningTime="2026-06-03 15:58:17.123490319 +0000 UTC m=+71.790877399" Jun 03 15:58:17.136650 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:17.136613 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dhw9d" podStartSLOduration=65.861752853 podStartE2EDuration="1m10.136601866s" podCreationTimestamp="2026-06-03 15:57:07 +0000 UTC" firstStartedPulling="2026-06-03 15:58:12.187394644 +0000 UTC m=+66.854781670" lastFinishedPulling="2026-06-03 15:58:16.462243654 +0000 UTC m=+71.129630683" observedRunningTime="2026-06-03 15:58:17.136253362 +0000 UTC m=+71.803640409" watchObservedRunningTime="2026-06-03 15:58:17.136601866 +0000 UTC m=+71.803988912" Jun 03 15:58:43.115433 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:43.115296 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:58:43.115433 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:43.115358 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert\") pod \"ingress-canary-7h2s8\" (UID: \"14eb1552-43bf-42ab-9e89-982e0cf1d219\") " pod="openshift-ingress-canary/ingress-canary-7h2s8" Jun 03 15:58:43.115433 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:43.115380 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:58:43.116006 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:43.115449 2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:58:43.116006 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:43.115472 2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6db4ffc696-rnmgh: secret "image-registry-tls" not found Jun 03 15:58:43.116006 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:43.115479 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:58:43.116006 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:43.115481 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:58:43.116006 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:43.115542 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert podName:14eb1552-43bf-42ab-9e89-982e0cf1d219 nodeName:}" failed. No retries permitted until 2026-06-03 15:59:47.115524993 +0000 UTC m=+161.782912018 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert") pod "ingress-canary-7h2s8" (UID: "14eb1552-43bf-42ab-9e89-982e0cf1d219") : secret "canary-serving-cert" not found Jun 03 15:58:43.116006 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:43.115555 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls podName:72545bb0-dbef-4456-8418-0566192ff7d9 nodeName:}" failed. No retries permitted until 2026-06-03 15:59:47.115549002 +0000 UTC m=+161.782936027 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls") pod "image-registry-6db4ffc696-rnmgh" (UID: "72545bb0-dbef-4456-8418-0566192ff7d9") : secret "image-registry-tls" not found Jun 03 15:58:43.116006 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:43.115565 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls podName:4465e033-8e83-4a18-92fc-16596d24a5d3 nodeName:}" failed. No retries permitted until 2026-06-03 15:59:47.115559652 +0000 UTC m=+161.782946677 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls") pod "dns-default-v67kr" (UID: "4465e033-8e83-4a18-92fc-16596d24a5d3") : secret "dns-default-metrics-tls" not found Jun 03 15:58:47.027219 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.027183 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9"] Jun 03 15:58:47.030023 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.030004 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" Jun 03 15:58:47.035593 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.035568 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 15:58:47.035593 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.035585 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 15:58:47.035778 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.035620 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 15:58:47.036055 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.036038 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 15:58:47.036121 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.036094 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pdxh8\"" Jun 03 15:58:47.039911 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.039890 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9"] Jun 03 15:58:47.130392 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.130358 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-fjjpr"] Jun 03 15:58:47.132181 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.132166 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6"] Jun 03 15:58:47.132348 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.132328 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.134488 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.134465 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 15:58:47.134594 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.134494 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" Jun 03 15:58:47.134594 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.134465 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 15:58:47.134963 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.134945 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 15:58:47.135084 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.135066 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2prb8\"" Jun 03 15:58:47.135139 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.135067 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 15:58:47.138094 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.138072 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 15:58:47.138212 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.138136 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:58:47.138212 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.138189 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 15:58:47.138510 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.138491 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fv88f\"" Jun 03 15:58:47.141031 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.140957 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 15:58:47.144741 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.144725 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6"] Jun 03 15:58:47.145973 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.145957 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-fjjpr"] Jun 03 15:58:47.146163 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.146140 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dmml9\" (UID: \"953f9708-f510-4a1e-a7e7-107ae6f5f46e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" Jun 03 15:58:47.146281 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.146247 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4vzm\" (UniqueName: \"kubernetes.io/projected/953f9708-f510-4a1e-a7e7-107ae6f5f46e-kube-api-access-b4vzm\") pod \"cluster-monitoring-operator-69b6cbdb88-dmml9\" (UID: \"953f9708-f510-4a1e-a7e7-107ae6f5f46e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" Jun 03 15:58:47.146360 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.146339 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/953f9708-f510-4a1e-a7e7-107ae6f5f46e-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-dmml9\" (UID: \"953f9708-f510-4a1e-a7e7-107ae6f5f46e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" Jun 03 15:58:47.247657 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.247619 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/953f9708-f510-4a1e-a7e7-107ae6f5f46e-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-dmml9\" (UID: \"953f9708-f510-4a1e-a7e7-107ae6f5f46e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" Jun 03 15:58:47.247893 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.247683 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dmml9\" (UID: \"953f9708-f510-4a1e-a7e7-107ae6f5f46e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" Jun 03 15:58:47.247893 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.247717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmhms\" (UniqueName: \"kubernetes.io/projected/134d251f-a962-46f6-817f-f4b4b52b4694-kube-api-access-qmhms\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.247893 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.247753 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/134d251f-a962-46f6-817f-f4b4b52b4694-service-ca-bundle\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.247893 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.247789 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-z6lr6\" (UID: \"0cb1e9a5-783d-4fae-ac90-c2df2ac201b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" Jun 03 15:58:47.247893 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.247831 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlthn\" (UniqueName: \"kubernetes.io/projected/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-kube-api-access-dlthn\") pod \"cluster-samples-operator-755bbf9bfb-z6lr6\" (UID: \"0cb1e9a5-783d-4fae-ac90-c2df2ac201b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" Jun 03 15:58:47.247893 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.247856 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/134d251f-a962-46f6-817f-f4b4b52b4694-snapshots\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.247893 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.247881 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/134d251f-a962-46f6-817f-f4b4b52b4694-serving-cert\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.248220 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:47.247880 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:58:47.248220 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.247937 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4vzm\" (UniqueName: \"kubernetes.io/projected/953f9708-f510-4a1e-a7e7-107ae6f5f46e-kube-api-access-b4vzm\") pod \"cluster-monitoring-operator-69b6cbdb88-dmml9\" (UID: \"953f9708-f510-4a1e-a7e7-107ae6f5f46e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" Jun 03 15:58:47.248220 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.247964 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/134d251f-a962-46f6-817f-f4b4b52b4694-tmp\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.248220 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.247992 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/134d251f-a962-46f6-817f-f4b4b52b4694-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.248220 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:47.248018 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls podName:953f9708-f510-4a1e-a7e7-107ae6f5f46e nodeName:}" failed. No retries permitted until 2026-06-03 15:58:47.747993077 +0000 UTC m=+102.415380114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-dmml9" (UID: "953f9708-f510-4a1e-a7e7-107ae6f5f46e") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:58:47.248448 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.248402 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/953f9708-f510-4a1e-a7e7-107ae6f5f46e-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-dmml9\" (UID: \"953f9708-f510-4a1e-a7e7-107ae6f5f46e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" Jun 03 15:58:47.256429 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.256411 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4vzm\" (UniqueName: \"kubernetes.io/projected/953f9708-f510-4a1e-a7e7-107ae6f5f46e-kube-api-access-b4vzm\") pod \"cluster-monitoring-operator-69b6cbdb88-dmml9\" (UID: \"953f9708-f510-4a1e-a7e7-107ae6f5f46e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" Jun 03 15:58:47.348739 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.348630 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmhms\" (UniqueName: \"kubernetes.io/projected/134d251f-a962-46f6-817f-f4b4b52b4694-kube-api-access-qmhms\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.348739 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.348686 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/134d251f-a962-46f6-817f-f4b4b52b4694-service-ca-bundle\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.348739 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.348710 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-z6lr6\" (UID: \"0cb1e9a5-783d-4fae-ac90-c2df2ac201b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" Jun 03 15:58:47.348739 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.348729 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlthn\" (UniqueName: \"kubernetes.io/projected/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-kube-api-access-dlthn\") pod \"cluster-samples-operator-755bbf9bfb-z6lr6\" (UID: \"0cb1e9a5-783d-4fae-ac90-c2df2ac201b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" Jun 03 15:58:47.348739 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.348748 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/134d251f-a962-46f6-817f-f4b4b52b4694-snapshots\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.349083 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.348763 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/134d251f-a962-46f6-817f-f4b4b52b4694-serving-cert\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.349083 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.348796 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/134d251f-a962-46f6-817f-f4b4b52b4694-tmp\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.349083 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:47.348856 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 15:58:47.349083 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:47.348920 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls podName:0cb1e9a5-783d-4fae-ac90-c2df2ac201b4 nodeName:}" failed. No retries permitted until 2026-06-03 15:58:47.848901968 +0000 UTC m=+102.516288994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-z6lr6" (UID: "0cb1e9a5-783d-4fae-ac90-c2df2ac201b4") : secret "samples-operator-tls" not found Jun 03 15:58:47.349619 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.348859 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/134d251f-a962-46f6-817f-f4b4b52b4694-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.350387 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.349736 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/134d251f-a962-46f6-817f-f4b4b52b4694-service-ca-bundle\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.350387 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.349759 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/134d251f-a962-46f6-817f-f4b4b52b4694-snapshots\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.350387 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.349976 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/134d251f-a962-46f6-817f-f4b4b52b4694-tmp\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.350387 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.350115 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/134d251f-a962-46f6-817f-f4b4b52b4694-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.352122 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.352102 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/134d251f-a962-46f6-817f-f4b4b52b4694-serving-cert\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.357559 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.357535 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmhms\" (UniqueName: \"kubernetes.io/projected/134d251f-a962-46f6-817f-f4b4b52b4694-kube-api-access-qmhms\") pod \"insights-operator-788bf58df5-fjjpr\" (UID: \"134d251f-a962-46f6-817f-f4b4b52b4694\") " pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.357788 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.357767 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlthn\" (UniqueName: \"kubernetes.io/projected/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-kube-api-access-dlthn\") pod \"cluster-samples-operator-755bbf9bfb-z6lr6\" (UID: \"0cb1e9a5-783d-4fae-ac90-c2df2ac201b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" Jun 03 15:58:47.443567 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.443528 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-fjjpr" Jun 03 15:58:47.569874 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.569839 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-fjjpr"] Jun 03 15:58:47.573765 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:58:47.573742 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod134d251f_a962_46f6_817f_f4b4b52b4694.slice/crio-eb520a82efe6fa791d7a49ff9efb0923e5682dce6fcc5410a18332bbbd50b250 WatchSource:0}: Error finding container eb520a82efe6fa791d7a49ff9efb0923e5682dce6fcc5410a18332bbbd50b250: Status 404 returned error can't find the container with id eb520a82efe6fa791d7a49ff9efb0923e5682dce6fcc5410a18332bbbd50b250 Jun 03 15:58:47.753061 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.752971 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dmml9\" (UID: \"953f9708-f510-4a1e-a7e7-107ae6f5f46e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" Jun 03 15:58:47.753214 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:47.753096 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:58:47.753214 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:47.753147 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls podName:953f9708-f510-4a1e-a7e7-107ae6f5f46e nodeName:}" failed. No retries permitted until 2026-06-03 15:58:48.753133776 +0000 UTC m=+103.420520801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-dmml9" (UID: "953f9708-f510-4a1e-a7e7-107ae6f5f46e") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:58:47.853981 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:47.853942 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-z6lr6\" (UID: \"0cb1e9a5-783d-4fae-ac90-c2df2ac201b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" Jun 03 15:58:47.854131 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:47.854099 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 15:58:47.854192 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:47.854174 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls podName:0cb1e9a5-783d-4fae-ac90-c2df2ac201b4 nodeName:}" failed. No retries permitted until 2026-06-03 15:58:48.854158276 +0000 UTC m=+103.521545300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-z6lr6" (UID: "0cb1e9a5-783d-4fae-ac90-c2df2ac201b4") : secret "samples-operator-tls" not found Jun 03 15:58:48.021628 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.021595 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-rmtzs"] Jun 03 15:58:48.024458 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.024442 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:58:48.027028 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.027003 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 15:58:48.027150 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.027070 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:58:48.027227 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.027192 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qhtd8\"" Jun 03 15:58:48.027630 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.027295 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 15:58:48.027630 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.027324 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 15:58:48.032031 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.032011 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 15:58:48.032488 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.032468 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-rmtzs"] Jun 03 15:58:48.113230 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.113202 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hm4zx" Jun 03 15:58:48.156160 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.156121 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0eeb520a-4f7b-409d-821b-a549bfa9d1f5-config\") pod \"console-operator-86d7c6cc77-rmtzs\" (UID: \"0eeb520a-4f7b-409d-821b-a549bfa9d1f5\") " pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:58:48.156327 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.156178 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0eeb520a-4f7b-409d-821b-a549bfa9d1f5-serving-cert\") pod \"console-operator-86d7c6cc77-rmtzs\" (UID: \"0eeb520a-4f7b-409d-821b-a549bfa9d1f5\") " pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:58:48.156327 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.156299 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0eeb520a-4f7b-409d-821b-a549bfa9d1f5-trusted-ca\") pod \"console-operator-86d7c6cc77-rmtzs\" (UID: \"0eeb520a-4f7b-409d-821b-a549bfa9d1f5\") " pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:58:48.156419 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.156330 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwc9f\" (UniqueName: \"kubernetes.io/projected/0eeb520a-4f7b-409d-821b-a549bfa9d1f5-kube-api-access-nwc9f\") pod \"console-operator-86d7c6cc77-rmtzs\" (UID: \"0eeb520a-4f7b-409d-821b-a549bfa9d1f5\") " pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:58:48.167465 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.167433 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-fjjpr" event={"ID":"134d251f-a962-46f6-817f-f4b4b52b4694","Type":"ContainerStarted","Data":"eb520a82efe6fa791d7a49ff9efb0923e5682dce6fcc5410a18332bbbd50b250"} Jun 03 15:58:48.257518 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.257488 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0eeb520a-4f7b-409d-821b-a549bfa9d1f5-trusted-ca\") pod \"console-operator-86d7c6cc77-rmtzs\" (UID: \"0eeb520a-4f7b-409d-821b-a549bfa9d1f5\") " pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:58:48.257808 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.257535 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwc9f\" (UniqueName: \"kubernetes.io/projected/0eeb520a-4f7b-409d-821b-a549bfa9d1f5-kube-api-access-nwc9f\") pod \"console-operator-86d7c6cc77-rmtzs\" (UID: \"0eeb520a-4f7b-409d-821b-a549bfa9d1f5\") " pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:58:48.257808 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.257635 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0eeb520a-4f7b-409d-821b-a549bfa9d1f5-config\") pod \"console-operator-86d7c6cc77-rmtzs\" (UID: \"0eeb520a-4f7b-409d-821b-a549bfa9d1f5\") " pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:58:48.257808 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.257703 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0eeb520a-4f7b-409d-821b-a549bfa9d1f5-serving-cert\") pod \"console-operator-86d7c6cc77-rmtzs\" (UID: \"0eeb520a-4f7b-409d-821b-a549bfa9d1f5\") " pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:58:48.258353 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.258324 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0eeb520a-4f7b-409d-821b-a549bfa9d1f5-trusted-ca\") pod \"console-operator-86d7c6cc77-rmtzs\" (UID: \"0eeb520a-4f7b-409d-821b-a549bfa9d1f5\") " pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:58:48.258465 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.258436 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0eeb520a-4f7b-409d-821b-a549bfa9d1f5-config\") pod \"console-operator-86d7c6cc77-rmtzs\" (UID: \"0eeb520a-4f7b-409d-821b-a549bfa9d1f5\") " pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:58:48.260187 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.260166 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0eeb520a-4f7b-409d-821b-a549bfa9d1f5-serving-cert\") pod \"console-operator-86d7c6cc77-rmtzs\" (UID: \"0eeb520a-4f7b-409d-821b-a549bfa9d1f5\") " pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:58:48.266633 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.266608 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwc9f\" (UniqueName: \"kubernetes.io/projected/0eeb520a-4f7b-409d-821b-a549bfa9d1f5-kube-api-access-nwc9f\") pod \"console-operator-86d7c6cc77-rmtzs\" (UID: \"0eeb520a-4f7b-409d-821b-a549bfa9d1f5\") " pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:58:48.334497 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.334414 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:58:48.454245 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.454187 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-rmtzs"] Jun 03 15:58:48.458087 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:58:48.458055 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eeb520a_4f7b_409d_821b_a549bfa9d1f5.slice/crio-14cff1e661e804aeed0daa12607921d8e0d06f3aed5c6c13f85dd746c3ddd463 WatchSource:0}: Error finding container 14cff1e661e804aeed0daa12607921d8e0d06f3aed5c6c13f85dd746c3ddd463: Status 404 returned error can't find the container with id 14cff1e661e804aeed0daa12607921d8e0d06f3aed5c6c13f85dd746c3ddd463 Jun 03 15:58:48.761867 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.761778 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dmml9\" (UID: \"953f9708-f510-4a1e-a7e7-107ae6f5f46e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" Jun 03 15:58:48.762037 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:48.761920 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:58:48.762037 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:48.761996 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls podName:953f9708-f510-4a1e-a7e7-107ae6f5f46e nodeName:}" failed. No retries permitted until 2026-06-03 15:58:50.761973458 +0000 UTC m=+105.429360499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-dmml9" (UID: "953f9708-f510-4a1e-a7e7-107ae6f5f46e") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:58:48.862843 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:48.862808 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-z6lr6\" (UID: \"0cb1e9a5-783d-4fae-ac90-c2df2ac201b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" Jun 03 15:58:48.863017 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:48.862972 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 15:58:48.863064 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:48.863052 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls podName:0cb1e9a5-783d-4fae-ac90-c2df2ac201b4 nodeName:}" failed. No retries permitted until 2026-06-03 15:58:50.863029515 +0000 UTC m=+105.530416566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-z6lr6" (UID: "0cb1e9a5-783d-4fae-ac90-c2df2ac201b4") : secret "samples-operator-tls" not found Jun 03 15:58:49.169853 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:49.169814 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" event={"ID":"0eeb520a-4f7b-409d-821b-a549bfa9d1f5","Type":"ContainerStarted","Data":"14cff1e661e804aeed0daa12607921d8e0d06f3aed5c6c13f85dd746c3ddd463"} Jun 03 15:58:50.779912 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:50.779874 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dmml9\" (UID: \"953f9708-f510-4a1e-a7e7-107ae6f5f46e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" Jun 03 15:58:50.780368 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:50.780044 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:58:50.780368 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:50.780140 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls podName:953f9708-f510-4a1e-a7e7-107ae6f5f46e nodeName:}" failed. No retries permitted until 2026-06-03 15:58:54.780118652 +0000 UTC m=+109.447505680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-dmml9" (UID: "953f9708-f510-4a1e-a7e7-107ae6f5f46e") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:58:50.880622 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:50.880590 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-z6lr6\" (UID: \"0cb1e9a5-783d-4fae-ac90-c2df2ac201b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" Jun 03 15:58:50.880799 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:50.880776 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 15:58:50.880864 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:50.880858 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls podName:0cb1e9a5-783d-4fae-ac90-c2df2ac201b4 nodeName:}" failed. No retries permitted until 2026-06-03 15:58:54.88083752 +0000 UTC m=+109.548224550 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-z6lr6" (UID: "0cb1e9a5-783d-4fae-ac90-c2df2ac201b4") : secret "samples-operator-tls" not found Jun 03 15:58:51.175430 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:51.175342 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-fjjpr" event={"ID":"134d251f-a962-46f6-817f-f4b4b52b4694","Type":"ContainerStarted","Data":"f66ff3e853b96f526f23f3d5e2314751a4d4449eba9f5a4d4ba0dd4dee5e7792"} Jun 03 15:58:51.192674 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:51.192604 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-fjjpr" podStartSLOduration=1.471848666 podStartE2EDuration="4.192583801s" podCreationTimestamp="2026-06-03 15:58:47 +0000 UTC" firstStartedPulling="2026-06-03 15:58:47.575456913 +0000 UTC m=+102.242843941" lastFinishedPulling="2026-06-03 15:58:50.296192034 +0000 UTC m=+104.963579076" observedRunningTime="2026-06-03 15:58:51.191304505 +0000 UTC m=+105.858691553" watchObservedRunningTime="2026-06-03 15:58:51.192583801 +0000 UTC m=+105.859970850" Jun 03 15:58:52.178514 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:52.178486 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-rmtzs_0eeb520a-4f7b-409d-821b-a549bfa9d1f5/console-operator/0.log" Jun 03 15:58:52.179009 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:52.178526 2575 generic.go:358] "Generic (PLEG): container finished" podID="0eeb520a-4f7b-409d-821b-a549bfa9d1f5" containerID="31eb607c89e476b3a7b089576b4862fbc5f94d39ff64937c261b2ad6bb04f167" exitCode=255 Jun 03 15:58:52.179009 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:52.178628 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" event={"ID":"0eeb520a-4f7b-409d-821b-a549bfa9d1f5","Type":"ContainerDied","Data":"31eb607c89e476b3a7b089576b4862fbc5f94d39ff64937c261b2ad6bb04f167"} Jun 03 15:58:52.179009 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:52.178900 2575 scope.go:117] "RemoveContainer" containerID="31eb607c89e476b3a7b089576b4862fbc5f94d39ff64937c261b2ad6bb04f167" Jun 03 15:58:53.178409 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:53.178381 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-96gss_e98840fb-b4bc-48f4-b044-c91aa26a528b/dns-node-resolver/0.log" Jun 03 15:58:53.182403 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:53.182381 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-rmtzs_0eeb520a-4f7b-409d-821b-a549bfa9d1f5/console-operator/1.log" Jun 03 15:58:53.182777 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:53.182740 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-rmtzs_0eeb520a-4f7b-409d-821b-a549bfa9d1f5/console-operator/0.log" Jun 03 15:58:53.182839 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:53.182772 2575 generic.go:358] "Generic (PLEG): container finished" podID="0eeb520a-4f7b-409d-821b-a549bfa9d1f5" containerID="ad0a5ecdc2befe773db01379e7d3b0dbb0f563217d2589ae5ffec0d951ae83d3" exitCode=255 Jun 03 15:58:53.182839 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:53.182812 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" event={"ID":"0eeb520a-4f7b-409d-821b-a549bfa9d1f5","Type":"ContainerDied","Data":"ad0a5ecdc2befe773db01379e7d3b0dbb0f563217d2589ae5ffec0d951ae83d3"} Jun 03 15:58:53.182933 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:53.182839 2575 scope.go:117] "RemoveContainer" containerID="31eb607c89e476b3a7b089576b4862fbc5f94d39ff64937c261b2ad6bb04f167" Jun 03 15:58:53.183184 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:53.183166 2575 scope.go:117] "RemoveContainer" containerID="ad0a5ecdc2befe773db01379e7d3b0dbb0f563217d2589ae5ffec0d951ae83d3" Jun 03 15:58:53.183432 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:53.183412 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-rmtzs_openshift-console-operator(0eeb520a-4f7b-409d-821b-a549bfa9d1f5)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" podUID="0eeb520a-4f7b-409d-821b-a549bfa9d1f5" Jun 03 15:58:54.063098 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.063029 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh"] Jun 03 15:58:54.065907 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.065885 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh" Jun 03 15:58:54.068369 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.068344 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 15:58:54.068369 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.068358 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jrdsp\"" Jun 03 15:58:54.069196 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.069177 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 15:58:54.069196 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.069189 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:58:54.069196 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.069177 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 15:58:54.075162 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.075138 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh"] Jun 03 15:58:54.107171 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.107123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v49pr\" (UniqueName: \"kubernetes.io/projected/b8a89d7a-e967-458e-897f-a90a997e5e7b-kube-api-access-v49pr\") pod \"service-ca-operator-69877444c-bfdhh\" (UID: \"b8a89d7a-e967-458e-897f-a90a997e5e7b\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh" Jun 03 15:58:54.107436 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.107196 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8a89d7a-e967-458e-897f-a90a997e5e7b-config\") pod \"service-ca-operator-69877444c-bfdhh\" (UID: \"b8a89d7a-e967-458e-897f-a90a997e5e7b\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh" Jun 03 15:58:54.107513 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.107457 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8a89d7a-e967-458e-897f-a90a997e5e7b-serving-cert\") pod \"service-ca-operator-69877444c-bfdhh\" (UID: \"b8a89d7a-e967-458e-897f-a90a997e5e7b\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh" Jun 03 15:58:54.186303 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.186254 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-rmtzs_0eeb520a-4f7b-409d-821b-a549bfa9d1f5/console-operator/1.log" Jun 03 15:58:54.186698 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.186679 2575 scope.go:117] "RemoveContainer" containerID="ad0a5ecdc2befe773db01379e7d3b0dbb0f563217d2589ae5ffec0d951ae83d3" Jun 03 15:58:54.186886 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:54.186868 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-rmtzs_openshift-console-operator(0eeb520a-4f7b-409d-821b-a549bfa9d1f5)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" podUID="0eeb520a-4f7b-409d-821b-a549bfa9d1f5" Jun 03 15:58:54.207907 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.207872 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v49pr\" (UniqueName: \"kubernetes.io/projected/b8a89d7a-e967-458e-897f-a90a997e5e7b-kube-api-access-v49pr\") pod \"service-ca-operator-69877444c-bfdhh\" (UID: \"b8a89d7a-e967-458e-897f-a90a997e5e7b\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh" Jun 03 15:58:54.208080 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.207939 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8a89d7a-e967-458e-897f-a90a997e5e7b-config\") pod \"service-ca-operator-69877444c-bfdhh\" (UID: \"b8a89d7a-e967-458e-897f-a90a997e5e7b\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh" Jun 03 15:58:54.208137 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.208105 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8a89d7a-e967-458e-897f-a90a997e5e7b-serving-cert\") pod \"service-ca-operator-69877444c-bfdhh\" (UID: \"b8a89d7a-e967-458e-897f-a90a997e5e7b\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh" Jun 03 15:58:54.208499 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.208476 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8a89d7a-e967-458e-897f-a90a997e5e7b-config\") pod \"service-ca-operator-69877444c-bfdhh\" (UID: \"b8a89d7a-e967-458e-897f-a90a997e5e7b\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh" Jun 03 15:58:54.210299 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.210279 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8a89d7a-e967-458e-897f-a90a997e5e7b-serving-cert\") pod \"service-ca-operator-69877444c-bfdhh\" (UID: \"b8a89d7a-e967-458e-897f-a90a997e5e7b\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh" Jun 03 15:58:54.215222 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.215200 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v49pr\" (UniqueName: \"kubernetes.io/projected/b8a89d7a-e967-458e-897f-a90a997e5e7b-kube-api-access-v49pr\") pod \"service-ca-operator-69877444c-bfdhh\" (UID: \"b8a89d7a-e967-458e-897f-a90a997e5e7b\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh" Jun 03 15:58:54.374435 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.374351 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh" Jun 03 15:58:54.377644 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.377624 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rx47m_773fe981-eb8d-4ad7-8434-78168e05801d/node-ca/0.log" Jun 03 15:58:54.495134 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.495105 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh"] Jun 03 15:58:54.498522 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:58:54.498491 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a89d7a_e967_458e_897f_a90a997e5e7b.slice/crio-d0a268ba49267c8b5c2910051b8881f66dbd96dc3b6cff06a633431fa47fd40a WatchSource:0}: Error finding container d0a268ba49267c8b5c2910051b8881f66dbd96dc3b6cff06a633431fa47fd40a: Status 404 returned error can't find the container with id d0a268ba49267c8b5c2910051b8881f66dbd96dc3b6cff06a633431fa47fd40a Jun 03 15:58:54.813616 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.813580 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dmml9\" (UID: \"953f9708-f510-4a1e-a7e7-107ae6f5f46e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" Jun 03 15:58:54.813796 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:54.813736 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:58:54.813839 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:54.813809 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls podName:953f9708-f510-4a1e-a7e7-107ae6f5f46e nodeName:}" failed. No retries permitted until 2026-06-03 15:59:02.813793757 +0000 UTC m=+117.481180782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-dmml9" (UID: "953f9708-f510-4a1e-a7e7-107ae6f5f46e") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:58:54.914022 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:54.913979 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-z6lr6\" (UID: \"0cb1e9a5-783d-4fae-ac90-c2df2ac201b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" Jun 03 15:58:54.914185 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:54.914128 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 15:58:54.914224 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:54.914195 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls podName:0cb1e9a5-783d-4fae-ac90-c2df2ac201b4 nodeName:}" failed. No retries permitted until 2026-06-03 15:59:02.914179572 +0000 UTC m=+117.581566596 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-z6lr6" (UID: "0cb1e9a5-783d-4fae-ac90-c2df2ac201b4") : secret "samples-operator-tls" not found Jun 03 15:58:55.189118 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:55.189037 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh" event={"ID":"b8a89d7a-e967-458e-897f-a90a997e5e7b","Type":"ContainerStarted","Data":"d0a268ba49267c8b5c2910051b8881f66dbd96dc3b6cff06a633431fa47fd40a"} Jun 03 15:58:55.949256 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:55.949225 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-dthrj"] Jun 03 15:58:55.951135 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:55.951121 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dthrj" Jun 03 15:58:55.953471 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:55.953450 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kz8gn\"" Jun 03 15:58:55.953471 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:55.953467 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 15:58:55.953655 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:55.953473 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 15:58:55.962101 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:55.962072 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-dthrj"] Jun 03 15:58:56.022387 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:56.022354 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxxkh\" (UniqueName: \"kubernetes.io/projected/6a701f60-2c8a-49d6-b8ea-f038a36d10d0-kube-api-access-qxxkh\") pod \"migrator-96c6f749-dthrj\" (UID: \"6a701f60-2c8a-49d6-b8ea-f038a36d10d0\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dthrj" Jun 03 15:58:56.122975 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:56.122939 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxxkh\" (UniqueName: \"kubernetes.io/projected/6a701f60-2c8a-49d6-b8ea-f038a36d10d0-kube-api-access-qxxkh\") pod \"migrator-96c6f749-dthrj\" (UID: \"6a701f60-2c8a-49d6-b8ea-f038a36d10d0\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dthrj" Jun 03 15:58:56.130755 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:56.130717 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxxkh\" (UniqueName: \"kubernetes.io/projected/6a701f60-2c8a-49d6-b8ea-f038a36d10d0-kube-api-access-qxxkh\") pod \"migrator-96c6f749-dthrj\" (UID: \"6a701f60-2c8a-49d6-b8ea-f038a36d10d0\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dthrj" Jun 03 15:58:56.260427 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:56.260339 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dthrj" Jun 03 15:58:56.381367 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:56.381332 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-dthrj"] Jun 03 15:58:56.384823 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:58:56.384779 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a701f60_2c8a_49d6_b8ea_f038a36d10d0.slice/crio-6e734232175f4af4a08935b4cd72b16487e0a28be02d249ee29d20e9d13bc071 WatchSource:0}: Error finding container 6e734232175f4af4a08935b4cd72b16487e0a28be02d249ee29d20e9d13bc071: Status 404 returned error can't find the container with id 6e734232175f4af4a08935b4cd72b16487e0a28be02d249ee29d20e9d13bc071 Jun 03 15:58:57.195887 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:57.195825 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh" event={"ID":"b8a89d7a-e967-458e-897f-a90a997e5e7b","Type":"ContainerStarted","Data":"bed0060466989108343c2de060ef6e40a24147953a46f4a303f49537b3cbe11a"} Jun 03 15:58:57.197146 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:57.197114 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dthrj" event={"ID":"6a701f60-2c8a-49d6-b8ea-f038a36d10d0","Type":"ContainerStarted","Data":"6e734232175f4af4a08935b4cd72b16487e0a28be02d249ee29d20e9d13bc071"} Jun 03 15:58:57.210571 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:57.210525 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh" podStartSLOduration=0.674968837 podStartE2EDuration="3.210508408s" podCreationTimestamp="2026-06-03 15:58:54 +0000 UTC" firstStartedPulling="2026-06-03 15:58:54.500354048 +0000 UTC m=+109.167741073" lastFinishedPulling="2026-06-03 15:58:57.035893603 +0000 UTC m=+111.703280644" observedRunningTime="2026-06-03 15:58:57.209926855 +0000 UTC m=+111.877313937" watchObservedRunningTime="2026-06-03 15:58:57.210508408 +0000 UTC m=+111.877895456" Jun 03 15:58:58.201156 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:58.201066 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dthrj" event={"ID":"6a701f60-2c8a-49d6-b8ea-f038a36d10d0","Type":"ContainerStarted","Data":"c03131a03b4a49694a4a390fce8d2c7d484bdfbd8d4f3dac5c0527cfb80bffae"} Jun 03 15:58:58.201156 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:58.201109 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dthrj" event={"ID":"6a701f60-2c8a-49d6-b8ea-f038a36d10d0","Type":"ContainerStarted","Data":"3f547f2e378afe7c83bb65b4dc4ddbbb43f5332f71ecc6173838f489c54506c9"} Jun 03 15:58:58.216620 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:58.216572 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-dthrj" podStartSLOduration=1.689327074 podStartE2EDuration="3.21655908s" podCreationTimestamp="2026-06-03 15:58:55 +0000 UTC" firstStartedPulling="2026-06-03 15:58:56.386817283 +0000 UTC m=+111.054204321" lastFinishedPulling="2026-06-03 15:58:57.914049296 +0000 UTC m=+112.581436327" observedRunningTime="2026-06-03 15:58:58.21516697 +0000 UTC m=+112.882554016" watchObservedRunningTime="2026-06-03 15:58:58.21655908 +0000 UTC m=+112.883946126" Jun 03 15:58:58.334996 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:58.334965 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:58:58.334996 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:58.334997 2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:58:58.335368 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:58:58.335355 2575 scope.go:117] "RemoveContainer" containerID="ad0a5ecdc2befe773db01379e7d3b0dbb0f563217d2589ae5ffec0d951ae83d3" Jun 03 15:58:58.335545 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:58:58.335529 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-rmtzs_openshift-console-operator(0eeb520a-4f7b-409d-821b-a549bfa9d1f5)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" podUID="0eeb520a-4f7b-409d-821b-a549bfa9d1f5" Jun 03 15:59:02.873937 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:02.873899 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dmml9\" (UID: \"953f9708-f510-4a1e-a7e7-107ae6f5f46e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" Jun 03 15:59:02.874432 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:59:02.874076 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:59:02.874432 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:59:02.874150 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls podName:953f9708-f510-4a1e-a7e7-107ae6f5f46e nodeName:}" failed. No retries permitted until 2026-06-03 15:59:18.874132171 +0000 UTC m=+133.541519203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-dmml9" (UID: "953f9708-f510-4a1e-a7e7-107ae6f5f46e") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:59:02.974445 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:02.974407 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-z6lr6\" (UID: \"0cb1e9a5-783d-4fae-ac90-c2df2ac201b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" Jun 03 15:59:02.974627 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:59:02.974598 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 15:59:02.974700 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:59:02.974687 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls podName:0cb1e9a5-783d-4fae-ac90-c2df2ac201b4 nodeName:}" failed. No retries permitted until 2026-06-03 15:59:18.974662984 +0000 UTC m=+133.642050017 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-z6lr6" (UID: "0cb1e9a5-783d-4fae-ac90-c2df2ac201b4") : secret "samples-operator-tls" not found Jun 03 15:59:13.869461 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:13.869424 2575 scope.go:117] "RemoveContainer" containerID="ad0a5ecdc2befe773db01379e7d3b0dbb0f563217d2589ae5ffec0d951ae83d3" Jun 03 15:59:14.241479 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:14.241403 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-rmtzs_0eeb520a-4f7b-409d-821b-a549bfa9d1f5/console-operator/2.log" Jun 03 15:59:14.241779 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:14.241760 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-rmtzs_0eeb520a-4f7b-409d-821b-a549bfa9d1f5/console-operator/1.log" Jun 03 15:59:14.241871 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:14.241800 2575 generic.go:358] "Generic (PLEG): container finished" podID="0eeb520a-4f7b-409d-821b-a549bfa9d1f5" containerID="5cb5edf8e8b9ab0270c67244dc8d3c523d68f203f84af8be04660fbe459b46ff" exitCode=255 Jun 03 15:59:14.241871 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:14.241848 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" event={"ID":"0eeb520a-4f7b-409d-821b-a549bfa9d1f5","Type":"ContainerDied","Data":"5cb5edf8e8b9ab0270c67244dc8d3c523d68f203f84af8be04660fbe459b46ff"} Jun 03 15:59:14.241972 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:14.241887 2575 scope.go:117] "RemoveContainer" containerID="ad0a5ecdc2befe773db01379e7d3b0dbb0f563217d2589ae5ffec0d951ae83d3" Jun 03 15:59:14.242231 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:14.242205 2575 scope.go:117] "RemoveContainer" containerID="5cb5edf8e8b9ab0270c67244dc8d3c523d68f203f84af8be04660fbe459b46ff" Jun 03 15:59:14.242473 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:59:14.242438 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-rmtzs_openshift-console-operator(0eeb520a-4f7b-409d-821b-a549bfa9d1f5)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" podUID="0eeb520a-4f7b-409d-821b-a549bfa9d1f5" Jun 03 15:59:15.245630 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:15.245602 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-rmtzs_0eeb520a-4f7b-409d-821b-a549bfa9d1f5/console-operator/2.log" Jun 03 15:59:15.681985 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:15.681950 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs\") pod \"network-metrics-daemon-6h6md\" (UID: \"6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd\") " pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:59:15.684205 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:15.684183 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd-metrics-certs\") pod \"network-metrics-daemon-6h6md\" (UID: \"6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd\") " pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:59:15.885807 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:15.885779 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qk87p\"" Jun 03 15:59:15.893940 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:15.893922 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6h6md" Jun 03 15:59:16.012121 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:16.012093 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6h6md"] Jun 03 15:59:16.014530 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:59:16.014504 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8532b6_914d_42d8_bc0e_ab5a82f5c3bd.slice/crio-1f0fdb5125b1b298f19470e573f535ee09e945044783ab8606cd9e34b3ff9ef4 WatchSource:0}: Error finding container 1f0fdb5125b1b298f19470e573f535ee09e945044783ab8606cd9e34b3ff9ef4: Status 404 returned error can't find the container with id 1f0fdb5125b1b298f19470e573f535ee09e945044783ab8606cd9e34b3ff9ef4 Jun 03 15:59:16.248831 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:16.248745 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6h6md" event={"ID":"6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd","Type":"ContainerStarted","Data":"1f0fdb5125b1b298f19470e573f535ee09e945044783ab8606cd9e34b3ff9ef4"} Jun 03 15:59:17.253660 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:17.253119 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6h6md" event={"ID":"6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd","Type":"ContainerStarted","Data":"8f348966760b116e716c70b68f851e5854035c998fe8dae290085c4927e7af53"} Jun 03 15:59:17.253660 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:17.253165 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6h6md" event={"ID":"6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd","Type":"ContainerStarted","Data":"9063a6e8b92270ce790aeb8aa66d67a8278c84fc14014ed28da41469249987df"} Jun 03 15:59:17.270507 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:17.270319 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6h6md" podStartSLOduration=131.225527644 podStartE2EDuration="2m12.27030004s" podCreationTimestamp="2026-06-03 15:57:05 +0000 UTC" firstStartedPulling="2026-06-03 15:59:16.016451048 +0000 UTC m=+130.683838087" lastFinishedPulling="2026-06-03 15:59:17.061223444 +0000 UTC m=+131.728610483" observedRunningTime="2026-06-03 15:59:17.269844619 +0000 UTC m=+131.937231665" watchObservedRunningTime="2026-06-03 15:59:17.27030004 +0000 UTC m=+131.937687090" Jun 03 15:59:18.335055 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:18.335025 2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:59:18.335055 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:18.335059 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:59:18.335471 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:18.335375 2575 scope.go:117] "RemoveContainer" containerID="5cb5edf8e8b9ab0270c67244dc8d3c523d68f203f84af8be04660fbe459b46ff" Jun 03 15:59:18.335547 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:59:18.335530 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-rmtzs_openshift-console-operator(0eeb520a-4f7b-409d-821b-a549bfa9d1f5)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" podUID="0eeb520a-4f7b-409d-821b-a549bfa9d1f5" Jun 03 15:59:18.907812 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:18.907774 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dmml9\" (UID: \"953f9708-f510-4a1e-a7e7-107ae6f5f46e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" Jun 03 15:59:18.910167 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:18.910135 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953f9708-f510-4a1e-a7e7-107ae6f5f46e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dmml9\" (UID: \"953f9708-f510-4a1e-a7e7-107ae6f5f46e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" Jun 03 15:59:19.008942 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:19.008903 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-z6lr6\" (UID: \"0cb1e9a5-783d-4fae-ac90-c2df2ac201b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" Jun 03 15:59:19.011225 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:19.011198 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb1e9a5-783d-4fae-ac90-c2df2ac201b4-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-z6lr6\" (UID: \"0cb1e9a5-783d-4fae-ac90-c2df2ac201b4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" Jun 03 15:59:19.141769 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:19.141740 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pdxh8\"" Jun 03 15:59:19.149724 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:19.149705 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" Jun 03 15:59:19.252952 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:19.252922 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fv88f\"" Jun 03 15:59:19.261110 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:19.261079 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" Jun 03 15:59:19.267559 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:19.267534 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9"] Jun 03 15:59:19.270114 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:59:19.270086 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953f9708_f510_4a1e_a7e7_107ae6f5f46e.slice/crio-7c7f27cf5fc88cb8ae503ff5ba917be756543f2785f8d9004d54cfb1fa6318de WatchSource:0}: Error finding container 7c7f27cf5fc88cb8ae503ff5ba917be756543f2785f8d9004d54cfb1fa6318de: Status 404 returned error can't find the container with id 7c7f27cf5fc88cb8ae503ff5ba917be756543f2785f8d9004d54cfb1fa6318de Jun 03 15:59:19.376057 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:19.376026 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6"] Jun 03 15:59:20.264434 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:20.264385 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" event={"ID":"0cb1e9a5-783d-4fae-ac90-c2df2ac201b4","Type":"ContainerStarted","Data":"4d31d36c6f9a3222c5e5d640f0f4d34ed5d0da3affa9078cb8324ec93274560b"} Jun 03 15:59:20.265467 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:20.265437 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" event={"ID":"953f9708-f510-4a1e-a7e7-107ae6f5f46e","Type":"ContainerStarted","Data":"7c7f27cf5fc88cb8ae503ff5ba917be756543f2785f8d9004d54cfb1fa6318de"} Jun 03 15:59:22.272952 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:22.272919 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" event={"ID":"0cb1e9a5-783d-4fae-ac90-c2df2ac201b4","Type":"ContainerStarted","Data":"0c4f281e9a51e9fe341f787cbec612680dde7a11c85942d355d5400c7a049b69"} Jun 03 15:59:22.272952 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:22.272958 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" event={"ID":"0cb1e9a5-783d-4fae-ac90-c2df2ac201b4","Type":"ContainerStarted","Data":"31e5a3e9496d667f49be2f75c3b336dd822ad0232a308cf31043f3b3ecd9a528"} Jun 03 15:59:22.274387 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:22.274365 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" event={"ID":"953f9708-f510-4a1e-a7e7-107ae6f5f46e","Type":"ContainerStarted","Data":"38b8ad89862671d612e8175a8029ecc2d82b06b14b7a8f4c8f84155e4496b2f5"} Jun 03 15:59:22.294285 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:22.294225 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-z6lr6" podStartSLOduration=32.927432341 podStartE2EDuration="35.29421218s" podCreationTimestamp="2026-06-03 15:58:47 +0000 UTC" firstStartedPulling="2026-06-03 15:59:19.413060123 +0000 UTC m=+134.080447149" lastFinishedPulling="2026-06-03 15:59:21.77983996 +0000 UTC m=+136.447226988" observedRunningTime="2026-06-03 15:59:22.293973198 +0000 UTC m=+136.961360258" watchObservedRunningTime="2026-06-03 15:59:22.29421218 +0000 UTC m=+136.961599247" Jun 03 15:59:22.308229 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:22.308194 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dmml9" podStartSLOduration=32.796704126 podStartE2EDuration="35.308179324s" podCreationTimestamp="2026-06-03 15:58:47 +0000 UTC" firstStartedPulling="2026-06-03 15:59:19.272016611 +0000 UTC m=+133.939403637" lastFinishedPulling="2026-06-03 15:59:21.783491806 +0000 UTC m=+136.450878835" observedRunningTime="2026-06-03 15:59:22.307536429 +0000 UTC m=+136.974923479" watchObservedRunningTime="2026-06-03 15:59:22.308179324 +0000 UTC m=+136.975566374" Jun 03 15:59:23.316910 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.316879 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8kq4p"] Jun 03 15:59:23.319996 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.319974 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8kq4p" Jun 03 15:59:23.322705 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.322684 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 15:59:23.322810 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.322684 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-25cmw\"" Jun 03 15:59:23.323781 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.323758 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 15:59:23.337445 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.337421 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8kq4p"] Jun 03 15:59:23.450301 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.447327 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eeb91613-21b9-4926-80b8-2a1f18caf9f5-crio-socket\") pod \"insights-runtime-extractor-8kq4p\" (UID: \"eeb91613-21b9-4926-80b8-2a1f18caf9f5\") " pod="openshift-insights/insights-runtime-extractor-8kq4p" Jun 03 15:59:23.450301 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.447412 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eeb91613-21b9-4926-80b8-2a1f18caf9f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kq4p\" (UID: \"eeb91613-21b9-4926-80b8-2a1f18caf9f5\") " pod="openshift-insights/insights-runtime-extractor-8kq4p" Jun 03 15:59:23.450301 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.447460 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eeb91613-21b9-4926-80b8-2a1f18caf9f5-data-volume\") pod \"insights-runtime-extractor-8kq4p\" (UID: \"eeb91613-21b9-4926-80b8-2a1f18caf9f5\") " pod="openshift-insights/insights-runtime-extractor-8kq4p" Jun 03 15:59:23.450301 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.447490 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eeb91613-21b9-4926-80b8-2a1f18caf9f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8kq4p\" (UID: \"eeb91613-21b9-4926-80b8-2a1f18caf9f5\") " pod="openshift-insights/insights-runtime-extractor-8kq4p" Jun 03 15:59:23.450301 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.447574 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49bmx\" (UniqueName: \"kubernetes.io/projected/eeb91613-21b9-4926-80b8-2a1f18caf9f5-kube-api-access-49bmx\") pod \"insights-runtime-extractor-8kq4p\" (UID: \"eeb91613-21b9-4926-80b8-2a1f18caf9f5\") " pod="openshift-insights/insights-runtime-extractor-8kq4p" Jun 03 15:59:23.549073 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.549038 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eeb91613-21b9-4926-80b8-2a1f18caf9f5-data-volume\") pod \"insights-runtime-extractor-8kq4p\" (UID: \"eeb91613-21b9-4926-80b8-2a1f18caf9f5\") " pod="openshift-insights/insights-runtime-extractor-8kq4p" Jun 03 15:59:23.549073 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.549075 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eeb91613-21b9-4926-80b8-2a1f18caf9f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8kq4p\" (UID: \"eeb91613-21b9-4926-80b8-2a1f18caf9f5\") " pod="openshift-insights/insights-runtime-extractor-8kq4p" Jun 03 15:59:23.549282 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.549134 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49bmx\" (UniqueName: \"kubernetes.io/projected/eeb91613-21b9-4926-80b8-2a1f18caf9f5-kube-api-access-49bmx\") pod \"insights-runtime-extractor-8kq4p\" (UID: \"eeb91613-21b9-4926-80b8-2a1f18caf9f5\") " pod="openshift-insights/insights-runtime-extractor-8kq4p" Jun 03 15:59:23.549282 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.549180 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eeb91613-21b9-4926-80b8-2a1f18caf9f5-crio-socket\") pod \"insights-runtime-extractor-8kq4p\" (UID: \"eeb91613-21b9-4926-80b8-2a1f18caf9f5\") " pod="openshift-insights/insights-runtime-extractor-8kq4p" Jun 03 15:59:23.549282 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.549236 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eeb91613-21b9-4926-80b8-2a1f18caf9f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kq4p\" (UID: \"eeb91613-21b9-4926-80b8-2a1f18caf9f5\") " pod="openshift-insights/insights-runtime-extractor-8kq4p" Jun 03 15:59:23.549427 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.549355 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eeb91613-21b9-4926-80b8-2a1f18caf9f5-crio-socket\") pod \"insights-runtime-extractor-8kq4p\" (UID: \"eeb91613-21b9-4926-80b8-2a1f18caf9f5\") " pod="openshift-insights/insights-runtime-extractor-8kq4p" Jun 03 15:59:23.549497 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.549476 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eeb91613-21b9-4926-80b8-2a1f18caf9f5-data-volume\") pod \"insights-runtime-extractor-8kq4p\" (UID: \"eeb91613-21b9-4926-80b8-2a1f18caf9f5\") " pod="openshift-insights/insights-runtime-extractor-8kq4p" Jun 03 15:59:23.549755 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.549729 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eeb91613-21b9-4926-80b8-2a1f18caf9f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8kq4p\" (UID: \"eeb91613-21b9-4926-80b8-2a1f18caf9f5\") " pod="openshift-insights/insights-runtime-extractor-8kq4p" Jun 03 15:59:23.551589 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.551573 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eeb91613-21b9-4926-80b8-2a1f18caf9f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8kq4p\" (UID: \"eeb91613-21b9-4926-80b8-2a1f18caf9f5\") " pod="openshift-insights/insights-runtime-extractor-8kq4p" Jun 03 15:59:23.558540 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.558521 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49bmx\" (UniqueName: \"kubernetes.io/projected/eeb91613-21b9-4926-80b8-2a1f18caf9f5-kube-api-access-49bmx\") pod \"insights-runtime-extractor-8kq4p\" (UID: \"eeb91613-21b9-4926-80b8-2a1f18caf9f5\") " pod="openshift-insights/insights-runtime-extractor-8kq4p" Jun 03 15:59:23.629029 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.628951 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8kq4p" Jun 03 15:59:23.769083 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:23.769049 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8kq4p"] Jun 03 15:59:23.771905 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:59:23.771877 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb91613_21b9_4926_80b8_2a1f18caf9f5.slice/crio-3532984651f20cee797ff0acb077493472e70c186bea5c522277673ebe458dbf WatchSource:0}: Error finding container 3532984651f20cee797ff0acb077493472e70c186bea5c522277673ebe458dbf: Status 404 returned error can't find the container with id 3532984651f20cee797ff0acb077493472e70c186bea5c522277673ebe458dbf Jun 03 15:59:24.280296 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:24.280248 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8kq4p" event={"ID":"eeb91613-21b9-4926-80b8-2a1f18caf9f5","Type":"ContainerStarted","Data":"b4de576e3d1b9847dca6a52954b23b4e706351c7bf15f07034bebb31aec47635"} Jun 03 15:59:24.280296 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:24.280297 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8kq4p" event={"ID":"eeb91613-21b9-4926-80b8-2a1f18caf9f5","Type":"ContainerStarted","Data":"3532984651f20cee797ff0acb077493472e70c186bea5c522277673ebe458dbf"} Jun 03 15:59:25.283616 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:25.283579 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8kq4p" event={"ID":"eeb91613-21b9-4926-80b8-2a1f18caf9f5","Type":"ContainerStarted","Data":"95d639219fcc9d93c9b236127ac3fbd09688baab0a5bb9ed9c21b198296518fa"} Jun 03 15:59:26.328384 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.328355 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl"] Jun 03 15:59:26.331428 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.331409 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" Jun 03 15:59:26.333881 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.333860 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-n8rzf\"" Jun 03 15:59:26.333986 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.333883 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 03 15:59:26.333986 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.333957 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 15:59:26.334856 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.334839 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 03 15:59:26.341228 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.341204 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl"] Jun 03 15:59:26.472158 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.472121 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b3e0b64-02f4-49dc-bcbb-d6163c19e40e-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-lvlfl\" (UID: \"5b3e0b64-02f4-49dc-bcbb-d6163c19e40e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" Jun 03 15:59:26.472158 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.472163 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b3e0b64-02f4-49dc-bcbb-d6163c19e40e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-lvlfl\" (UID: \"5b3e0b64-02f4-49dc-bcbb-d6163c19e40e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" Jun 03 15:59:26.472384 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.472192 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b3e0b64-02f4-49dc-bcbb-d6163c19e40e-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-lvlfl\" (UID: \"5b3e0b64-02f4-49dc-bcbb-d6163c19e40e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" Jun 03 15:59:26.472384 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.472314 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvjdc\" (UniqueName: \"kubernetes.io/projected/5b3e0b64-02f4-49dc-bcbb-d6163c19e40e-kube-api-access-gvjdc\") pod \"prometheus-operator-658bcd8bdf-lvlfl\" (UID: \"5b3e0b64-02f4-49dc-bcbb-d6163c19e40e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" Jun 03 15:59:26.573539 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.573444 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gvjdc\" (UniqueName: \"kubernetes.io/projected/5b3e0b64-02f4-49dc-bcbb-d6163c19e40e-kube-api-access-gvjdc\") pod \"prometheus-operator-658bcd8bdf-lvlfl\" (UID: \"5b3e0b64-02f4-49dc-bcbb-d6163c19e40e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" Jun 03 15:59:26.573695 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.573632 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b3e0b64-02f4-49dc-bcbb-d6163c19e40e-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-lvlfl\" (UID: \"5b3e0b64-02f4-49dc-bcbb-d6163c19e40e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" Jun 03 15:59:26.573695 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.573673 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b3e0b64-02f4-49dc-bcbb-d6163c19e40e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-lvlfl\" (UID: \"5b3e0b64-02f4-49dc-bcbb-d6163c19e40e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" Jun 03 15:59:26.573762 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.573710 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b3e0b64-02f4-49dc-bcbb-d6163c19e40e-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-lvlfl\" (UID: \"5b3e0b64-02f4-49dc-bcbb-d6163c19e40e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" Jun 03 15:59:26.574279 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.574236 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b3e0b64-02f4-49dc-bcbb-d6163c19e40e-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-lvlfl\" (UID: \"5b3e0b64-02f4-49dc-bcbb-d6163c19e40e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" Jun 03 15:59:26.576001 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.575978 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b3e0b64-02f4-49dc-bcbb-d6163c19e40e-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-lvlfl\" (UID: \"5b3e0b64-02f4-49dc-bcbb-d6163c19e40e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" Jun 03 15:59:26.576086 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.576038 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b3e0b64-02f4-49dc-bcbb-d6163c19e40e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-lvlfl\" (UID: \"5b3e0b64-02f4-49dc-bcbb-d6163c19e40e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" Jun 03 15:59:26.581417 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.581397 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvjdc\" (UniqueName: \"kubernetes.io/projected/5b3e0b64-02f4-49dc-bcbb-d6163c19e40e-kube-api-access-gvjdc\") pod \"prometheus-operator-658bcd8bdf-lvlfl\" (UID: \"5b3e0b64-02f4-49dc-bcbb-d6163c19e40e\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" Jun 03 15:59:26.651604 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.651572 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" Jun 03 15:59:26.772306 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:26.772240 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl"] Jun 03 15:59:26.774762 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:59:26.774738 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3e0b64_02f4_49dc_bcbb_d6163c19e40e.slice/crio-b684669fd3a391d15e72980b49404873ff562b920376e9afe282f35dd7bac6cd WatchSource:0}: Error finding container b684669fd3a391d15e72980b49404873ff562b920376e9afe282f35dd7bac6cd: Status 404 returned error can't find the container with id b684669fd3a391d15e72980b49404873ff562b920376e9afe282f35dd7bac6cd Jun 03 15:59:27.291233 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:27.291200 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8kq4p" event={"ID":"eeb91613-21b9-4926-80b8-2a1f18caf9f5","Type":"ContainerStarted","Data":"c0016323cca96e26f96ac0f54f6dff18f71f6a86f7e430844531a4032094bcde"} Jun 03 15:59:27.292292 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:27.292249 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" event={"ID":"5b3e0b64-02f4-49dc-bcbb-d6163c19e40e","Type":"ContainerStarted","Data":"b684669fd3a391d15e72980b49404873ff562b920376e9afe282f35dd7bac6cd"} Jun 03 15:59:27.310011 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:27.309968 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8kq4p" podStartSLOduration=1.8531227000000001 podStartE2EDuration="4.309953196s" podCreationTimestamp="2026-06-03 15:59:23 +0000 UTC" firstStartedPulling="2026-06-03 15:59:23.830545777 +0000 UTC m=+138.497932802" lastFinishedPulling="2026-06-03 15:59:26.287376268 +0000 UTC m=+140.954763298" observedRunningTime="2026-06-03 15:59:27.308119401 +0000 UTC m=+141.975506448" watchObservedRunningTime="2026-06-03 15:59:27.309953196 +0000 UTC m=+141.977340243" Jun 03 15:59:28.300898 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:28.300865 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" event={"ID":"5b3e0b64-02f4-49dc-bcbb-d6163c19e40e","Type":"ContainerStarted","Data":"e94b7cbbc0f92ccc747b54d2adff48ea8199ddd9d734be53171a4a5f35d4c929"} Jun 03 15:59:29.305058 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:29.305024 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" event={"ID":"5b3e0b64-02f4-49dc-bcbb-d6163c19e40e","Type":"ContainerStarted","Data":"59af12de40a2e6d1e357d9aa1e76a0f4baea1316fab2df356124f885fef37d79"} Jun 03 15:59:29.323201 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:29.323154 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lvlfl" podStartSLOduration=1.928998644 podStartE2EDuration="3.323140144s" podCreationTimestamp="2026-06-03 15:59:26 +0000 UTC" firstStartedPulling="2026-06-03 15:59:26.776592175 +0000 UTC m=+141.443979200" lastFinishedPulling="2026-06-03 15:59:28.170733672 +0000 UTC m=+142.838120700" observedRunningTime="2026-06-03 15:59:29.320379177 +0000 UTC m=+143.987766249" watchObservedRunningTime="2026-06-03 15:59:29.323140144 +0000 UTC m=+143.990527191" Jun 03 15:59:31.666393 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.666363 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-8xxff"] Jun 03 15:59:31.671714 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.671697 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.674175 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.674148 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 15:59:31.674581 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.674553 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 15:59:31.674693 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.674553 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ltn59\"" Jun 03 15:59:31.675556 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.675537 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 15:59:31.676724 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.676706 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vqkgq"] Jun 03 15:59:31.680635 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.680616 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-8xxff"] Jun 03 15:59:31.680765 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.680752 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.684243 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.684223 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 15:59:31.684334 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.684248 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 15:59:31.684334 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.684322 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zj7kz\"" Jun 03 15:59:31.684604 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.684588 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 15:59:31.818251 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.815168 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/411f0136-7786-46d4-abc1-3b591215797e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.818251 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.815252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8k8p\" (UniqueName: \"kubernetes.io/projected/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-kube-api-access-h8k8p\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.818251 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.815328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/411f0136-7786-46d4-abc1-3b591215797e-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.818251 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.815365 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-tls\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.818251 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.815417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.818251 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.815446 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/411f0136-7786-46d4-abc1-3b591215797e-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.818251 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.815482 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-sys\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.818251 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.815515 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-wtmp\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.818251 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.815560 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh9gj\" (UniqueName: \"kubernetes.io/projected/411f0136-7786-46d4-abc1-3b591215797e-kube-api-access-vh9gj\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.818251 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.815592 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-metrics-client-ca\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.818251 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.815622 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-textfile\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.818251 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.815675 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.818251 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.815706 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/411f0136-7786-46d4-abc1-3b591215797e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.818251 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.815748 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-root\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.818251 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.815785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/411f0136-7786-46d4-abc1-3b591215797e-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.869244 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.869215 2575 scope.go:117] "RemoveContainer" containerID="5cb5edf8e8b9ab0270c67244dc8d3c523d68f203f84af8be04660fbe459b46ff" Jun 03 15:59:31.869446 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:59:31.869427 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-rmtzs_openshift-console-operator(0eeb520a-4f7b-409d-821b-a549bfa9d1f5)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" podUID="0eeb520a-4f7b-409d-821b-a549bfa9d1f5" Jun 03 15:59:31.916488 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.916409 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-textfile\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.916488 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.916469 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.916679 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.916491 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/411f0136-7786-46d4-abc1-3b591215797e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.916679 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.916521 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-root\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.916679 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.916539 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/411f0136-7786-46d4-abc1-3b591215797e-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.916679 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.916618 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-root\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.916926 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.916691 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/411f0136-7786-46d4-abc1-3b591215797e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.916926 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.916752 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8k8p\" (UniqueName: \"kubernetes.io/projected/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-kube-api-access-h8k8p\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.916926 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.916778 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-textfile\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.916926 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.916800 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/411f0136-7786-46d4-abc1-3b591215797e-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.916926 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.916834 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-tls\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.916926 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.916881 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.916926 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.916911 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/411f0136-7786-46d4-abc1-3b591215797e-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.917238 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.916941 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-sys\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.917238 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.916974 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-wtmp\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.917238 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.917014 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vh9gj\" (UniqueName: \"kubernetes.io/projected/411f0136-7786-46d4-abc1-3b591215797e-kube-api-access-vh9gj\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.917238 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.917040 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-metrics-client-ca\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.917238 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.917062 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.917238 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:59:31.917160 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 15:59:31.917238 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:59:31.917215 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-tls podName:8ec4bf18-3f41-4ad5-90b4-7fb0682893f6 nodeName:}" failed. No retries permitted until 2026-06-03 15:59:32.417196091 +0000 UTC m=+147.084583127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-tls") pod "node-exporter-vqkgq" (UID: "8ec4bf18-3f41-4ad5-90b4-7fb0682893f6") : secret "node-exporter-tls" not found Jun 03 15:59:31.917621 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.917286 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/411f0136-7786-46d4-abc1-3b591215797e-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.917621 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.917366 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-sys\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.917621 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.917383 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/411f0136-7786-46d4-abc1-3b591215797e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.917621 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.917609 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-wtmp\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.917777 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.917663 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-metrics-client-ca\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.917777 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.917689 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/411f0136-7786-46d4-abc1-3b591215797e-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.919318 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.919300 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.919383 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.919324 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/411f0136-7786-46d4-abc1-3b591215797e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.919643 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.919624 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/411f0136-7786-46d4-abc1-3b591215797e-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.925879 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.925858 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8k8p\" (UniqueName: \"kubernetes.io/projected/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-kube-api-access-h8k8p\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:31.926123 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.926107 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh9gj\" (UniqueName: \"kubernetes.io/projected/411f0136-7786-46d4-abc1-3b591215797e-kube-api-access-vh9gj\") pod \"kube-state-metrics-8469c486bb-8xxff\" (UID: \"411f0136-7786-46d4-abc1-3b591215797e\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:31.981188 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:31.981152 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" Jun 03 15:59:32.105893 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.105855 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-8xxff"] Jun 03 15:59:32.108461 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:59:32.108427 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod411f0136_7786_46d4_abc1_3b591215797e.slice/crio-fc5d856eb52f8c7d9cd32b88b73405334947513bd999d7aa717e2ae18971361d WatchSource:0}: Error finding container fc5d856eb52f8c7d9cd32b88b73405334947513bd999d7aa717e2ae18971361d: Status 404 returned error can't find the container with id fc5d856eb52f8c7d9cd32b88b73405334947513bd999d7aa717e2ae18971361d Jun 03 15:59:32.313651 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.313607 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" event={"ID":"411f0136-7786-46d4-abc1-3b591215797e","Type":"ContainerStarted","Data":"fc5d856eb52f8c7d9cd32b88b73405334947513bd999d7aa717e2ae18971361d"} Jun 03 15:59:32.421248 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.421207 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-tls\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:32.423639 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.423615 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ec4bf18-3f41-4ad5-90b4-7fb0682893f6-node-exporter-tls\") pod \"node-exporter-vqkgq\" (UID: \"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6\") " pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:32.589533 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.589453 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vqkgq" Jun 03 15:59:32.597139 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:59:32.597109 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec4bf18_3f41_4ad5_90b4_7fb0682893f6.slice/crio-cd3158fe421135c078b94d02140ba6ab497523b857ccf1995933e48b4d107fb8 WatchSource:0}: Error finding container cd3158fe421135c078b94d02140ba6ab497523b857ccf1995933e48b4d107fb8: Status 404 returned error can't find the container with id cd3158fe421135c078b94d02140ba6ab497523b857ccf1995933e48b4d107fb8 Jun 03 15:59:32.734019 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.733986 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:59:32.738415 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.738391 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.741246 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.740940 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 15:59:32.741246 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.740969 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 15:59:32.741246 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.740940 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 15:59:32.741246 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.741044 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 15:59:32.741246 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.741136 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-69gm5\"" Jun 03 15:59:32.741246 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.741240 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 15:59:32.741605 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.741319 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 15:59:32.741605 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.741329 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 15:59:32.741605 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.741414 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 15:59:32.741753 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.741664 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 15:59:32.753119 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.753095 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:59:32.825863 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.825821 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.826050 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.825874 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.826050 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.825908 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.826050 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.825984 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-web-config\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.826050 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.826031 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cpsr\" (UniqueName: \"kubernetes.io/projected/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-kube-api-access-4cpsr\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.826261 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.826064 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.826261 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.826124 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.826261 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.826164 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.826261 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.826241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-config-out\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.826471 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.826298 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.826471 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.826323 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.826471 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.826353 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.826471 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.826395 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.927933 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.927290 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-config-out\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.927933 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.927339 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.927933 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.927367 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.927933 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.927395 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.927933 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.927437 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.927933 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.927510 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.927933 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.927540 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.927933 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.927572 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.927933 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.927608 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-web-config\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.927933 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.927645 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4cpsr\" (UniqueName: \"kubernetes.io/projected/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-kube-api-access-4cpsr\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.927933 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.927673 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.927933 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.927701 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.927933 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.927724 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.928662 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.928551 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.929225 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.929194 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.931979 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.931633 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.931979 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.931859 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.931979 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.931933 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.932184 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.931987 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-config-out\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.933625 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.933571 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.936404 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.936362 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-web-config\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.936852 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.936525 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.936852 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.936692 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.936852 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.936817 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.937033 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.936928 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:32.939777 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:32.939755 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cpsr\" (UniqueName: \"kubernetes.io/projected/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-kube-api-access-4cpsr\") pod \"alertmanager-main-0\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:33.051624 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:33.051585 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 15:59:33.317932 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:33.317889 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqkgq" event={"ID":"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6","Type":"ContainerStarted","Data":"cd3158fe421135c078b94d02140ba6ab497523b857ccf1995933e48b4d107fb8"} Jun 03 15:59:33.545685 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:33.545651 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 15:59:33.760949 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:59:33.760836 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca89698_526d_45d1_aa57_5c8dbfa1ea81.slice/crio-d86a43d90dd8e1d3a450fcfc659fe559413ef55bb6e105bc830c915078f88904 WatchSource:0}: Error finding container d86a43d90dd8e1d3a450fcfc659fe559413ef55bb6e105bc830c915078f88904: Status 404 returned error can't find the container with id d86a43d90dd8e1d3a450fcfc659fe559413ef55bb6e105bc830c915078f88904 Jun 03 15:59:34.321595 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:34.321545 2575 generic.go:358] "Generic (PLEG): container finished" podID="8ec4bf18-3f41-4ad5-90b4-7fb0682893f6" containerID="f6400f1c0eb36af59cfc0de59a5209f861acf0fdf4f27d43ffde73c66cc98878" exitCode=0 Jun 03 15:59:34.321838 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:34.321632 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqkgq" event={"ID":"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6","Type":"ContainerDied","Data":"f6400f1c0eb36af59cfc0de59a5209f861acf0fdf4f27d43ffde73c66cc98878"} Jun 03 15:59:34.323448 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:34.323422 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" event={"ID":"411f0136-7786-46d4-abc1-3b591215797e","Type":"ContainerStarted","Data":"3b667c34c027d8b1b980b7fdc281e4e1f8a2be9ec35e15dc65f9f6a5f24c5954"} Jun 03 15:59:34.323573 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:34.323455 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" event={"ID":"411f0136-7786-46d4-abc1-3b591215797e","Type":"ContainerStarted","Data":"910efe8973ce763108f4d9f04064b6016e07a42ed24b5952ddfa3332ccce6cac"} Jun 03 15:59:34.323573 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:34.323470 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" event={"ID":"411f0136-7786-46d4-abc1-3b591215797e","Type":"ContainerStarted","Data":"a0309af61a8649e77544503851c6be0a797e7bd3994488d40be4ebc6d2437d31"} Jun 03 15:59:34.324423 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:34.324396 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca89698-526d-45d1-aa57-5c8dbfa1ea81","Type":"ContainerStarted","Data":"d86a43d90dd8e1d3a450fcfc659fe559413ef55bb6e105bc830c915078f88904"} Jun 03 15:59:34.358768 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:34.358718 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-8xxff" podStartSLOduration=2.022599712 podStartE2EDuration="3.358699146s" podCreationTimestamp="2026-06-03 15:59:31 +0000 UTC" firstStartedPulling="2026-06-03 15:59:32.110700832 +0000 UTC m=+146.778087862" lastFinishedPulling="2026-06-03 15:59:33.446800257 +0000 UTC m=+148.114187296" observedRunningTime="2026-06-03 15:59:34.357545794 +0000 UTC m=+149.024932841" watchObservedRunningTime="2026-06-03 15:59:34.358699146 +0000 UTC m=+149.026086195" Jun 03 15:59:35.328546 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:35.328507 2575 generic.go:358] "Generic (PLEG): container finished" podID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerID="b9da8a9c235e04f5009ae9f1d8106a4d50c8f2c02ed7f1d3e9679e8deb216259" exitCode=0 Jun 03 15:59:35.328993 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:35.328590 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca89698-526d-45d1-aa57-5c8dbfa1ea81","Type":"ContainerDied","Data":"b9da8a9c235e04f5009ae9f1d8106a4d50c8f2c02ed7f1d3e9679e8deb216259"} Jun 03 15:59:35.330602 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:35.330575 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqkgq" event={"ID":"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6","Type":"ContainerStarted","Data":"26dc19fc415f1e542ce0f7478b6d47f42af427c9ea1f595d682759a922a5d794"} Jun 03 15:59:35.330688 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:35.330606 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqkgq" event={"ID":"8ec4bf18-3f41-4ad5-90b4-7fb0682893f6","Type":"ContainerStarted","Data":"dea2e1905618f7b201097c754992aec0996369ebb9b94b138f11430fe9fd4e65"} Jun 03 15:59:35.371123 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:35.371068 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vqkgq" podStartSLOduration=3.15987115 podStartE2EDuration="4.371056251s" podCreationTimestamp="2026-06-03 15:59:31 +0000 UTC" firstStartedPulling="2026-06-03 15:59:32.598832649 +0000 UTC m=+147.266219675" lastFinishedPulling="2026-06-03 15:59:33.810017739 +0000 UTC m=+148.477404776" observedRunningTime="2026-06-03 15:59:35.369424801 +0000 UTC m=+150.036811847" watchObservedRunningTime="2026-06-03 15:59:35.371056251 +0000 UTC m=+150.038443297" Jun 03 15:59:35.980647 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:35.980615 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-67948895c-9pl82"] Jun 03 15:59:35.983849 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:35.983828 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:35.987760 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:35.987728 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 15:59:35.987866 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:35.987787 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 15:59:35.988797 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:35.988776 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-74b5pjjhg0gpg\"" Jun 03 15:59:35.988797 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:35.988787 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 15:59:35.988963 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:35.988787 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 15:59:35.988963 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:35.988855 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8d5bz\"" Jun 03 15:59:35.996961 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:35.996934 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67948895c-9pl82"] Jun 03 15:59:36.159765 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.159726 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f6hr\" (UniqueName: \"kubernetes.io/projected/a937ef72-2a2e-4096-ba51-b76552455b32-kube-api-access-9f6hr\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.159765 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.159771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a937ef72-2a2e-4096-ba51-b76552455b32-audit-log\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.159959 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.159824 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a937ef72-2a2e-4096-ba51-b76552455b32-secret-metrics-server-client-certs\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.159959 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.159903 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a937ef72-2a2e-4096-ba51-b76552455b32-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.159959 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.159948 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a937ef72-2a2e-4096-ba51-b76552455b32-client-ca-bundle\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.160086 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.159970 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a937ef72-2a2e-4096-ba51-b76552455b32-secret-metrics-server-tls\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.160086 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.159992 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a937ef72-2a2e-4096-ba51-b76552455b32-metrics-server-audit-profiles\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.261286 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.261190 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a937ef72-2a2e-4096-ba51-b76552455b32-audit-log\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.261286 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.261237 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a937ef72-2a2e-4096-ba51-b76552455b32-secret-metrics-server-client-certs\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.261449 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.261361 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a937ef72-2a2e-4096-ba51-b76552455b32-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.261449 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.261413 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a937ef72-2a2e-4096-ba51-b76552455b32-client-ca-bundle\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.261449 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.261436 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a937ef72-2a2e-4096-ba51-b76552455b32-secret-metrics-server-tls\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.261574 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.261452 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a937ef72-2a2e-4096-ba51-b76552455b32-metrics-server-audit-profiles\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.261574 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.261507 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9f6hr\" (UniqueName: \"kubernetes.io/projected/a937ef72-2a2e-4096-ba51-b76552455b32-kube-api-access-9f6hr\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.261674 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.261661 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a937ef72-2a2e-4096-ba51-b76552455b32-audit-log\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.262100 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.262074 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a937ef72-2a2e-4096-ba51-b76552455b32-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.262375 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.262355 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a937ef72-2a2e-4096-ba51-b76552455b32-metrics-server-audit-profiles\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.263651 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.263622 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a937ef72-2a2e-4096-ba51-b76552455b32-secret-metrics-server-client-certs\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.263777 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.263754 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a937ef72-2a2e-4096-ba51-b76552455b32-secret-metrics-server-tls\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.263833 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.263780 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a937ef72-2a2e-4096-ba51-b76552455b32-client-ca-bundle\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.272140 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.272120 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f6hr\" (UniqueName: \"kubernetes.io/projected/a937ef72-2a2e-4096-ba51-b76552455b32-kube-api-access-9f6hr\") pod \"metrics-server-67948895c-9pl82\" (UID: \"a937ef72-2a2e-4096-ba51-b76552455b32\") " pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.293149 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.293126 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:36.432640 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.432606 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-67948895c-9pl82"] Jun 03 15:59:36.435714 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:59:36.435672 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda937ef72_2a2e_4096_ba51_b76552455b32.slice/crio-ef75eaa9ec28bca32e41602ac4f7a4232c7cf3dacfba51d90842851049d44b12 WatchSource:0}: Error finding container ef75eaa9ec28bca32e41602ac4f7a4232c7cf3dacfba51d90842851049d44b12: Status 404 returned error can't find the container with id ef75eaa9ec28bca32e41602ac4f7a4232c7cf3dacfba51d90842851049d44b12 Jun 03 15:59:36.440229 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.440205 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-7lnl5"] Jun 03 15:59:36.445494 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.445458 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7lnl5" Jun 03 15:59:36.447847 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.447819 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 15:59:36.448015 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.447819 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-9gpr9\"" Jun 03 15:59:36.450579 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.450535 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-7lnl5"] Jun 03 15:59:36.565511 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.565475 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/89f1a473-4cd0-478e-a5b2-5142221e9562-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-7lnl5\" (UID: \"89f1a473-4cd0-478e-a5b2-5142221e9562\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7lnl5" Jun 03 15:59:36.666572 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.666531 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/89f1a473-4cd0-478e-a5b2-5142221e9562-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-7lnl5\" (UID: \"89f1a473-4cd0-478e-a5b2-5142221e9562\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7lnl5" Jun 03 15:59:36.669145 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.669117 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/89f1a473-4cd0-478e-a5b2-5142221e9562-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-7lnl5\" (UID: \"89f1a473-4cd0-478e-a5b2-5142221e9562\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7lnl5" Jun 03 15:59:36.760389 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:36.760328 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7lnl5" Jun 03 15:59:37.177755 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:37.177707 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-7lnl5"] Jun 03 15:59:37.180342 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:59:37.180304 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f1a473_4cd0_478e_a5b2_5142221e9562.slice/crio-1fac43ff6be720152ceff57ce9862e94521b4325eb4d913bc6a8aa2286ddad48 WatchSource:0}: Error finding container 1fac43ff6be720152ceff57ce9862e94521b4325eb4d913bc6a8aa2286ddad48: Status 404 returned error can't find the container with id 1fac43ff6be720152ceff57ce9862e94521b4325eb4d913bc6a8aa2286ddad48 Jun 03 15:59:37.339570 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:37.339490 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca89698-526d-45d1-aa57-5c8dbfa1ea81","Type":"ContainerStarted","Data":"a5761c815577bbbffa699443118cecc199d00e68c265c07cecb95883d8121ba2"} Jun 03 15:59:37.339570 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:37.339534 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca89698-526d-45d1-aa57-5c8dbfa1ea81","Type":"ContainerStarted","Data":"d56a3ed2052f9ea1642ce16cf69b766f95903a0d09889eb031cd85024123b1be"} Jun 03 15:59:37.339570 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:37.339549 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca89698-526d-45d1-aa57-5c8dbfa1ea81","Type":"ContainerStarted","Data":"47c2a7e8f9e08b1e9009c81fe1af8a7101d495441ad19d495d06c8ebfb86e216"} Jun 03 15:59:37.340965 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:37.340933 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67948895c-9pl82" event={"ID":"a937ef72-2a2e-4096-ba51-b76552455b32","Type":"ContainerStarted","Data":"ef75eaa9ec28bca32e41602ac4f7a4232c7cf3dacfba51d90842851049d44b12"} Jun 03 15:59:37.341853 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:37.341827 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7lnl5" event={"ID":"89f1a473-4cd0-478e-a5b2-5142221e9562","Type":"ContainerStarted","Data":"1fac43ff6be720152ceff57ce9862e94521b4325eb4d913bc6a8aa2286ddad48"} Jun 03 15:59:38.350585 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:38.350542 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca89698-526d-45d1-aa57-5c8dbfa1ea81","Type":"ContainerStarted","Data":"4d9701ae63a670f134f60da7a4a259962c350a8407e1dfd4bd5e94f0d94d4956"} Jun 03 15:59:38.350585 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:38.350589 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca89698-526d-45d1-aa57-5c8dbfa1ea81","Type":"ContainerStarted","Data":"eea9efad4a38c0f0daa70b7e7f9da45a943748524994f42d0669e65f4772e18c"} Jun 03 15:59:39.354995 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:39.354951 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7lnl5" event={"ID":"89f1a473-4cd0-478e-a5b2-5142221e9562","Type":"ContainerStarted","Data":"73d996813235fbb587664300a24834ce11c0de852895a683cc02f1d75b61fbcc"} Jun 03 15:59:39.355467 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:39.355104 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7lnl5" Jun 03 15:59:39.358371 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:39.358347 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca89698-526d-45d1-aa57-5c8dbfa1ea81","Type":"ContainerStarted","Data":"c708e21e2f5d4575a858015111b9bbaf1365187af33512b7caf176f38709ba2c"} Jun 03 15:59:39.359811 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:39.359786 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-67948895c-9pl82" event={"ID":"a937ef72-2a2e-4096-ba51-b76552455b32","Type":"ContainerStarted","Data":"5038cc612937898816f06507c64fbea13c5ba6971d4502a0c778ce89f82dc0d4"} Jun 03 15:59:39.365018 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:39.364992 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7lnl5" Jun 03 15:59:39.369825 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:39.369784 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7lnl5" podStartSLOduration=1.6574896369999998 podStartE2EDuration="3.369771672s" podCreationTimestamp="2026-06-03 15:59:36 +0000 UTC" firstStartedPulling="2026-06-03 15:59:37.182366454 +0000 UTC m=+151.849753479" lastFinishedPulling="2026-06-03 15:59:38.894648475 +0000 UTC m=+153.562035514" observedRunningTime="2026-06-03 15:59:39.369255292 +0000 UTC m=+154.036642339" watchObservedRunningTime="2026-06-03 15:59:39.369771672 +0000 UTC m=+154.037158719" Jun 03 15:59:39.398194 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:39.398151 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.268907068 podStartE2EDuration="7.398139181s" podCreationTimestamp="2026-06-03 15:59:32 +0000 UTC" firstStartedPulling="2026-06-03 15:59:33.76297814 +0000 UTC m=+148.430365168" lastFinishedPulling="2026-06-03 15:59:38.892210253 +0000 UTC m=+153.559597281" observedRunningTime="2026-06-03 15:59:39.395954845 +0000 UTC m=+154.063341893" watchObservedRunningTime="2026-06-03 15:59:39.398139181 +0000 UTC m=+154.065526227" Jun 03 15:59:39.435717 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:39.435651 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-67948895c-9pl82" podStartSLOduration=1.981494146 podStartE2EDuration="4.435633676s" podCreationTimestamp="2026-06-03 15:59:35 +0000 UTC" firstStartedPulling="2026-06-03 15:59:36.43806769 +0000 UTC m=+151.105454715" lastFinishedPulling="2026-06-03 15:59:38.892207217 +0000 UTC m=+153.559594245" observedRunningTime="2026-06-03 15:59:39.434870108 +0000 UTC m=+154.102257156" watchObservedRunningTime="2026-06-03 15:59:39.435633676 +0000 UTC m=+154.103020724" Jun 03 15:59:42.194565 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:59:42.194514 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" podUID="72545bb0-dbef-4456-8418-0566192ff7d9" Jun 03 15:59:42.210391 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:59:42.210362 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-7h2s8" podUID="14eb1552-43bf-42ab-9e89-982e0cf1d219" Jun 03 15:59:42.218587 ip-10-0-138-89 kubenswrapper[2575]: E0603 15:59:42.218568 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-v67kr" podUID="4465e033-8e83-4a18-92fc-16596d24a5d3" Jun 03 15:59:42.369795 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:42.369762 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:59:42.369795 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:42.369805 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v67kr" Jun 03 15:59:42.370032 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:42.370000 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7h2s8" Jun 03 15:59:44.869015 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:44.868981 2575 scope.go:117] "RemoveContainer" containerID="5cb5edf8e8b9ab0270c67244dc8d3c523d68f203f84af8be04660fbe459b46ff" Jun 03 15:59:45.380182 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:45.380151 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-rmtzs_0eeb520a-4f7b-409d-821b-a549bfa9d1f5/console-operator/2.log" Jun 03 15:59:45.380376 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:45.380286 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" event={"ID":"0eeb520a-4f7b-409d-821b-a549bfa9d1f5","Type":"ContainerStarted","Data":"8e5dc13915418edb3e92184610211938fa03483645426baaa00d150fc0140749"} Jun 03 15:59:45.380581 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:45.380563 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:59:45.401849 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:45.401799 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" podStartSLOduration=54.29559467 podStartE2EDuration="57.401781924s" podCreationTimestamp="2026-06-03 15:58:48 +0000 UTC" firstStartedPulling="2026-06-03 15:58:48.460442255 +0000 UTC m=+103.127829292" lastFinishedPulling="2026-06-03 15:58:51.56662952 +0000 UTC m=+106.234016546" observedRunningTime="2026-06-03 15:59:45.401309881 +0000 UTC m=+160.068696933" watchObservedRunningTime="2026-06-03 15:59:45.401781924 +0000 UTC m=+160.069168973" Jun 03 15:59:46.276699 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:46.276667 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-rmtzs" Jun 03 15:59:46.458902 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:46.458873 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-b25cv"] Jun 03 15:59:46.462303 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:46.462260 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-b25cv" Jun 03 15:59:46.464547 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:46.464526 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 15:59:46.464547 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:46.464542 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 15:59:46.464671 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:46.464588 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ls8g8\"" Jun 03 15:59:46.470186 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:46.470165 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-b25cv"] Jun 03 15:59:46.555169 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:46.555089 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d8cl\" (UniqueName: \"kubernetes.io/projected/8fa4ef1d-9065-4ba5-8a2a-2d8a0e048289-kube-api-access-5d8cl\") pod \"downloads-c65b8dc4b-b25cv\" (UID: \"8fa4ef1d-9065-4ba5-8a2a-2d8a0e048289\") " pod="openshift-console/downloads-c65b8dc4b-b25cv" Jun 03 15:59:46.655688 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:46.655646 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5d8cl\" (UniqueName: \"kubernetes.io/projected/8fa4ef1d-9065-4ba5-8a2a-2d8a0e048289-kube-api-access-5d8cl\") pod \"downloads-c65b8dc4b-b25cv\" (UID: \"8fa4ef1d-9065-4ba5-8a2a-2d8a0e048289\") " pod="openshift-console/downloads-c65b8dc4b-b25cv" Jun 03 15:59:46.664037 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:46.664003 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d8cl\" (UniqueName: \"kubernetes.io/projected/8fa4ef1d-9065-4ba5-8a2a-2d8a0e048289-kube-api-access-5d8cl\") pod \"downloads-c65b8dc4b-b25cv\" (UID: \"8fa4ef1d-9065-4ba5-8a2a-2d8a0e048289\") " pod="openshift-console/downloads-c65b8dc4b-b25cv" Jun 03 15:59:46.772237 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:46.772203 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-b25cv" Jun 03 15:59:46.898523 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:46.898441 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-b25cv"] Jun 03 15:59:46.900652 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:59:46.900623 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa4ef1d_9065_4ba5_8a2a_2d8a0e048289.slice/crio-713a28046a2ca1b272d27a361b4b708aebac6bf7aaaa168ad59fe7ec2bbe8c0a WatchSource:0}: Error finding container 713a28046a2ca1b272d27a361b4b708aebac6bf7aaaa168ad59fe7ec2bbe8c0a: Status 404 returned error can't find the container with id 713a28046a2ca1b272d27a361b4b708aebac6bf7aaaa168ad59fe7ec2bbe8c0a Jun 03 15:59:47.159728 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:47.159644 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:59:47.159728 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:47.159708 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert\") pod \"ingress-canary-7h2s8\" (UID: \"14eb1552-43bf-42ab-9e89-982e0cf1d219\") " pod="openshift-ingress-canary/ingress-canary-7h2s8" Jun 03 15:59:47.159966 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:47.159737 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:59:47.162059 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:47.162027 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4465e033-8e83-4a18-92fc-16596d24a5d3-metrics-tls\") pod \"dns-default-v67kr\" (UID: \"4465e033-8e83-4a18-92fc-16596d24a5d3\") " pod="openshift-dns/dns-default-v67kr" Jun 03 15:59:47.162167 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:47.162082 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14eb1552-43bf-42ab-9e89-982e0cf1d219-cert\") pod \"ingress-canary-7h2s8\" (UID: \"14eb1552-43bf-42ab-9e89-982e0cf1d219\") " pod="openshift-ingress-canary/ingress-canary-7h2s8" Jun 03 15:59:47.162167 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:47.162143 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls\") pod \"image-registry-6db4ffc696-rnmgh\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:59:47.173949 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:47.173927 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vbxw8\"" Jun 03 15:59:47.173949 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:47.173944 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2c4jd\"" Jun 03 15:59:47.174085 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:47.173927 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-drwlt\"" Jun 03 15:59:47.181683 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:47.181665 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:59:47.181753 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:47.181683 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v67kr" Jun 03 15:59:47.181829 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:47.181813 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7h2s8" Jun 03 15:59:47.342886 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:47.342847 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7h2s8"] Jun 03 15:59:47.350823 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:59:47.350794 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14eb1552_43bf_42ab_9e89_982e0cf1d219.slice/crio-f18656f66cabf340184170876d5ec0de9a72fc30a39e79331b27cd98db4ddd21 WatchSource:0}: Error finding container f18656f66cabf340184170876d5ec0de9a72fc30a39e79331b27cd98db4ddd21: Status 404 returned error can't find the container with id f18656f66cabf340184170876d5ec0de9a72fc30a39e79331b27cd98db4ddd21 Jun 03 15:59:47.387053 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:47.387019 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-b25cv" event={"ID":"8fa4ef1d-9065-4ba5-8a2a-2d8a0e048289","Type":"ContainerStarted","Data":"713a28046a2ca1b272d27a361b4b708aebac6bf7aaaa168ad59fe7ec2bbe8c0a"} Jun 03 15:59:47.388107 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:47.388081 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7h2s8" event={"ID":"14eb1552-43bf-42ab-9e89-982e0cf1d219","Type":"ContainerStarted","Data":"f18656f66cabf340184170876d5ec0de9a72fc30a39e79331b27cd98db4ddd21"} Jun 03 15:59:47.574877 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:47.574765 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v67kr"] Jun 03 15:59:47.578102 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:59:47.577855 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4465e033_8e83_4a18_92fc_16596d24a5d3.slice/crio-1de5f1748ecd287a6e71706ae01d5ffbc44378ea0c64dfac20497a2236fbf9cd WatchSource:0}: Error finding container 1de5f1748ecd287a6e71706ae01d5ffbc44378ea0c64dfac20497a2236fbf9cd: Status 404 returned error can't find the container with id 1de5f1748ecd287a6e71706ae01d5ffbc44378ea0c64dfac20497a2236fbf9cd Jun 03 15:59:47.578847 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:47.578712 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6db4ffc696-rnmgh"] Jun 03 15:59:47.581142 ip-10-0-138-89 kubenswrapper[2575]: W0603 15:59:47.581116 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72545bb0_dbef_4456_8418_0566192ff7d9.slice/crio-3fe7d534acf54af7fb110e08020c9b4b67e7ed89554adbc22f3198b1d8ca4127 WatchSource:0}: Error finding container 3fe7d534acf54af7fb110e08020c9b4b67e7ed89554adbc22f3198b1d8ca4127: Status 404 returned error can't find the container with id 3fe7d534acf54af7fb110e08020c9b4b67e7ed89554adbc22f3198b1d8ca4127 Jun 03 15:59:48.394528 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:48.394494 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" event={"ID":"72545bb0-dbef-4456-8418-0566192ff7d9","Type":"ContainerStarted","Data":"3a4e03cb5cb14ba93567691c043ed40a9803966b6940924ab49921245870d24b"} Jun 03 15:59:48.394979 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:48.394537 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" event={"ID":"72545bb0-dbef-4456-8418-0566192ff7d9","Type":"ContainerStarted","Data":"3fe7d534acf54af7fb110e08020c9b4b67e7ed89554adbc22f3198b1d8ca4127"} Jun 03 15:59:48.394979 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:48.394579 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 15:59:48.396054 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:48.396030 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v67kr" event={"ID":"4465e033-8e83-4a18-92fc-16596d24a5d3","Type":"ContainerStarted","Data":"1de5f1748ecd287a6e71706ae01d5ffbc44378ea0c64dfac20497a2236fbf9cd"} Jun 03 15:59:48.415204 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:48.415152 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" podStartSLOduration=162.415134867 podStartE2EDuration="2m42.415134867s" podCreationTimestamp="2026-06-03 15:57:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:59:48.413398126 +0000 UTC m=+163.080785185" watchObservedRunningTime="2026-06-03 15:59:48.415134867 +0000 UTC m=+163.082521916" Jun 03 15:59:50.404827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:50.404565 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v67kr" event={"ID":"4465e033-8e83-4a18-92fc-16596d24a5d3","Type":"ContainerStarted","Data":"edea60b25d3cb2b1fdb5e65f6383105e0108cf51e704bff60732214b9692d211"} Jun 03 15:59:50.404827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:50.404625 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v67kr" event={"ID":"4465e033-8e83-4a18-92fc-16596d24a5d3","Type":"ContainerStarted","Data":"af45e4dfa8674f31c38daec0cc73392074167aee3fc0e8f998cc3e1f826ea27e"} Jun 03 15:59:50.404827 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:50.404671 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v67kr" Jun 03 15:59:50.406148 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:50.406109 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7h2s8" event={"ID":"14eb1552-43bf-42ab-9e89-982e0cf1d219","Type":"ContainerStarted","Data":"08150623980e7f38daafff97ea7f143c18d0997e7d14ebbb3f6ad9ce6d97d62f"} Jun 03 15:59:50.423561 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:50.423504 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-v67kr" podStartSLOduration=129.190549047 podStartE2EDuration="2m11.423485758s" podCreationTimestamp="2026-06-03 15:57:39 +0000 UTC" firstStartedPulling="2026-06-03 15:59:47.580506192 +0000 UTC m=+162.247893217" lastFinishedPulling="2026-06-03 15:59:49.813442893 +0000 UTC m=+164.480829928" observedRunningTime="2026-06-03 15:59:50.421383603 +0000 UTC m=+165.088770644" watchObservedRunningTime="2026-06-03 15:59:50.423485758 +0000 UTC m=+165.090872805" Jun 03 15:59:50.440086 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:50.439617 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7h2s8" podStartSLOduration=128.974926773 podStartE2EDuration="2m11.439598829s" podCreationTimestamp="2026-06-03 15:57:39 +0000 UTC" firstStartedPulling="2026-06-03 15:59:47.352883494 +0000 UTC m=+162.020270519" lastFinishedPulling="2026-06-03 15:59:49.817555544 +0000 UTC m=+164.484942575" observedRunningTime="2026-06-03 15:59:50.437786363 +0000 UTC m=+165.105173414" watchObservedRunningTime="2026-06-03 15:59:50.439598829 +0000 UTC m=+165.106985880" Jun 03 15:59:56.293726 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:56.293631 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 15:59:56.293726 ip-10-0-138-89 kubenswrapper[2575]: I0603 15:59:56.293684 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 16:00:00.412489 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:00.412461 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v67kr" Jun 03 16:00:03.551508 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.551477 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-76c8d6f84f-7gw6l"] Jun 03 16:00:03.554147 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.554124 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.557679 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.557626 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 16:00:03.557800 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.557702 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2bwhc\"" Jun 03 16:00:03.557800 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.557705 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 16:00:03.557941 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.557846 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 16:00:03.557941 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.557858 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 16:00:03.558073 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.558054 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 16:00:03.562806 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.562781 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 16:00:03.566331 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.566307 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76c8d6f84f-7gw6l"] Jun 03 16:00:03.598843 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.598814 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-service-ca\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.599025 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.598856 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-trusted-ca-bundle\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.599025 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.598884 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srm4b\" (UniqueName: \"kubernetes.io/projected/d1c6040d-6d05-428a-b02f-ad2bf5edc852-kube-api-access-srm4b\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.599025 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.598911 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-oauth-serving-cert\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.599025 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.598953 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-oauth-config\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.599211 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.599023 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-serving-cert\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.599211 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.599160 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-config\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.700434 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.700396 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-config\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.700631 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.700455 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-service-ca\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.700631 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.700487 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-trusted-ca-bundle\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.700631 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.700504 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srm4b\" (UniqueName: \"kubernetes.io/projected/d1c6040d-6d05-428a-b02f-ad2bf5edc852-kube-api-access-srm4b\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.700631 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.700522 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-oauth-serving-cert\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.700631 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.700546 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-oauth-config\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.700901 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.700778 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-serving-cert\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.701399 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.701322 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-config\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.701545 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.701431 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-oauth-serving-cert\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.701679 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.701654 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-service-ca\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.701893 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.701863 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-trusted-ca-bundle\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.703722 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.703700 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-oauth-config\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.703812 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.703709 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-serving-cert\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.708112 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.708092 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srm4b\" (UniqueName: \"kubernetes.io/projected/d1c6040d-6d05-428a-b02f-ad2bf5edc852-kube-api-access-srm4b\") pod \"console-76c8d6f84f-7gw6l\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:03.865650 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:03.865548 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:04.013663 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:04.013638 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76c8d6f84f-7gw6l"] Jun 03 16:00:04.027777 ip-10-0-138-89 kubenswrapper[2575]: W0603 16:00:04.027753 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c6040d_6d05_428a_b02f_ad2bf5edc852.slice/crio-7c6e9da6be05091c1f1153d57552b4946f71cfc7c26851a3ee702b0bd802f0c5 WatchSource:0}: Error finding container 7c6e9da6be05091c1f1153d57552b4946f71cfc7c26851a3ee702b0bd802f0c5: Status 404 returned error can't find the container with id 7c6e9da6be05091c1f1153d57552b4946f71cfc7c26851a3ee702b0bd802f0c5 Jun 03 16:00:04.451902 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:04.451857 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c8d6f84f-7gw6l" event={"ID":"d1c6040d-6d05-428a-b02f-ad2bf5edc852","Type":"ContainerStarted","Data":"7c6e9da6be05091c1f1153d57552b4946f71cfc7c26851a3ee702b0bd802f0c5"} Jun 03 16:00:04.454636 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:04.454603 2575 generic.go:358] "Generic (PLEG): container finished" podID="b8a89d7a-e967-458e-897f-a90a997e5e7b" containerID="bed0060466989108343c2de060ef6e40a24147953a46f4a303f49537b3cbe11a" exitCode=0 Jun 03 16:00:04.454776 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:04.454644 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh" event={"ID":"b8a89d7a-e967-458e-897f-a90a997e5e7b","Type":"ContainerDied","Data":"bed0060466989108343c2de060ef6e40a24147953a46f4a303f49537b3cbe11a"} Jun 03 16:00:04.455092 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:04.455042 2575 scope.go:117] "RemoveContainer" containerID="bed0060466989108343c2de060ef6e40a24147953a46f4a303f49537b3cbe11a" Jun 03 16:00:04.457355 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:04.457325 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-b25cv" event={"ID":"8fa4ef1d-9065-4ba5-8a2a-2d8a0e048289","Type":"ContainerStarted","Data":"5d1e7a98823d0a8ede119c63826602526fa0f10c03cc2e15127ff7df3e00dc01"} Jun 03 16:00:04.458197 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:04.458183 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-b25cv" Jun 03 16:00:04.471552 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:04.471514 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-b25cv" Jun 03 16:00:04.505234 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:04.504687 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-b25cv" podStartSLOduration=1.434673076 podStartE2EDuration="18.504670038s" podCreationTimestamp="2026-06-03 15:59:46 +0000 UTC" firstStartedPulling="2026-06-03 15:59:46.902452429 +0000 UTC m=+161.569839454" lastFinishedPulling="2026-06-03 16:00:03.97244938 +0000 UTC m=+178.639836416" observedRunningTime="2026-06-03 16:00:04.486952258 +0000 UTC m=+179.154339306" watchObservedRunningTime="2026-06-03 16:00:04.504670038 +0000 UTC m=+179.172057088" Jun 03 16:00:05.464131 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:05.463715 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-bfdhh" event={"ID":"b8a89d7a-e967-458e-897f-a90a997e5e7b","Type":"ContainerStarted","Data":"2205bdfd3ec2f5d5bac3a0b8aac5553b4bf8de12c9fb75708bc75813583d4b28"} Jun 03 16:00:07.189176 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:07.189133 2575 patch_prober.go:28] interesting pod/image-registry-6db4ffc696-rnmgh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 16:00:07.189771 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:07.189205 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" podUID="72545bb0-dbef-4456-8418-0566192ff7d9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 16:00:08.476349 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:08.476307 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c8d6f84f-7gw6l" event={"ID":"d1c6040d-6d05-428a-b02f-ad2bf5edc852","Type":"ContainerStarted","Data":"dae53931d883ca3578fb1ba3866e847f0f83242d6770d34ce70c08e8901a1293"} Jun 03 16:00:08.496379 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:08.496332 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-76c8d6f84f-7gw6l" podStartSLOduration=1.541461973 podStartE2EDuration="5.496316766s" podCreationTimestamp="2026-06-03 16:00:03 +0000 UTC" firstStartedPulling="2026-06-03 16:00:04.029703564 +0000 UTC m=+178.697090602" lastFinishedPulling="2026-06-03 16:00:07.984558365 +0000 UTC m=+182.651945395" observedRunningTime="2026-06-03 16:00:08.49398942 +0000 UTC m=+183.161376468" watchObservedRunningTime="2026-06-03 16:00:08.496316766 +0000 UTC m=+183.163703812" Jun 03 16:00:09.405064 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:09.405033 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 16:00:13.685158 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:13.685126 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6db4ffc696-rnmgh"] Jun 03 16:00:13.866509 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:13.866473 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:13.866670 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:13.866520 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:13.873834 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:13.873810 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:14.499665 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:14.499637 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:00:16.298575 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:16.298546 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 16:00:16.303172 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:16.303144 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-67948895c-9pl82" Jun 03 16:00:16.504577 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:16.504540 2575 generic.go:358] "Generic (PLEG): container finished" podID="134d251f-a962-46f6-817f-f4b4b52b4694" containerID="f66ff3e853b96f526f23f3d5e2314751a4d4449eba9f5a4d4ba0dd4dee5e7792" exitCode=0 Jun 03 16:00:16.504740 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:16.504612 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-fjjpr" event={"ID":"134d251f-a962-46f6-817f-f4b4b52b4694","Type":"ContainerDied","Data":"f66ff3e853b96f526f23f3d5e2314751a4d4449eba9f5a4d4ba0dd4dee5e7792"} Jun 03 16:00:16.505037 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:16.505020 2575 scope.go:117] "RemoveContainer" containerID="f66ff3e853b96f526f23f3d5e2314751a4d4449eba9f5a4d4ba0dd4dee5e7792" Jun 03 16:00:17.508690 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:17.508651 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-fjjpr" event={"ID":"134d251f-a962-46f6-817f-f4b4b52b4694","Type":"ContainerStarted","Data":"d8645565784148eab597259903d5ebf775bc83655e3b0fd4f127edd5238f4c1c"} Jun 03 16:00:38.709953 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:38.709895 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" podUID="72545bb0-dbef-4456-8418-0566192ff7d9" containerName="registry" containerID="cri-o://3a4e03cb5cb14ba93567691c043ed40a9803966b6940924ab49921245870d24b" gracePeriod=30 Jun 03 16:00:39.401247 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:39.401213 2575 patch_prober.go:28] interesting pod/image-registry-6db4ffc696-rnmgh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body= Jun 03 16:00:39.401449 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:39.401289 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" podUID="72545bb0-dbef-4456-8418-0566192ff7d9" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" Jun 03 16:00:40.453995 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.453971 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 16:00:40.537016 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.536987 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jdvf\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-kube-api-access-6jdvf\") pod \"72545bb0-dbef-4456-8418-0566192ff7d9\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " Jun 03 16:00:40.537202 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.537028 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls\") pod \"72545bb0-dbef-4456-8418-0566192ff7d9\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " Jun 03 16:00:40.537202 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.537054 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72545bb0-dbef-4456-8418-0566192ff7d9-image-registry-private-configuration\") pod \"72545bb0-dbef-4456-8418-0566192ff7d9\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " Jun 03 16:00:40.537202 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.537083 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72545bb0-dbef-4456-8418-0566192ff7d9-ca-trust-extracted\") pod \"72545bb0-dbef-4456-8418-0566192ff7d9\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " Jun 03 16:00:40.537396 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.537213 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72545bb0-dbef-4456-8418-0566192ff7d9-registry-certificates\") pod \"72545bb0-dbef-4456-8418-0566192ff7d9\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " Jun 03 16:00:40.537396 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.537308 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72545bb0-dbef-4456-8418-0566192ff7d9-trusted-ca\") pod \"72545bb0-dbef-4456-8418-0566192ff7d9\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " Jun 03 16:00:40.537396 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.537342 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72545bb0-dbef-4456-8418-0566192ff7d9-installation-pull-secrets\") pod \"72545bb0-dbef-4456-8418-0566192ff7d9\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " Jun 03 16:00:40.537396 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.537379 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-bound-sa-token\") pod \"72545bb0-dbef-4456-8418-0566192ff7d9\" (UID: \"72545bb0-dbef-4456-8418-0566192ff7d9\") " Jun 03 16:00:40.537697 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.537668 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72545bb0-dbef-4456-8418-0566192ff7d9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "72545bb0-dbef-4456-8418-0566192ff7d9" (UID: "72545bb0-dbef-4456-8418-0566192ff7d9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:00:40.537768 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.537699 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72545bb0-dbef-4456-8418-0566192ff7d9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "72545bb0-dbef-4456-8418-0566192ff7d9" (UID: "72545bb0-dbef-4456-8418-0566192ff7d9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:00:40.539695 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.539654 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72545bb0-dbef-4456-8418-0566192ff7d9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "72545bb0-dbef-4456-8418-0566192ff7d9" (UID: "72545bb0-dbef-4456-8418-0566192ff7d9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:00:40.539875 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.539856 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "72545bb0-dbef-4456-8418-0566192ff7d9" (UID: "72545bb0-dbef-4456-8418-0566192ff7d9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:00:40.539944 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.539888 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "72545bb0-dbef-4456-8418-0566192ff7d9" (UID: "72545bb0-dbef-4456-8418-0566192ff7d9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:00:40.540002 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.539953 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-kube-api-access-6jdvf" (OuterVolumeSpecName: "kube-api-access-6jdvf") pod "72545bb0-dbef-4456-8418-0566192ff7d9" (UID: "72545bb0-dbef-4456-8418-0566192ff7d9"). InnerVolumeSpecName "kube-api-access-6jdvf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:00:40.540063 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.539998 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72545bb0-dbef-4456-8418-0566192ff7d9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "72545bb0-dbef-4456-8418-0566192ff7d9" (UID: "72545bb0-dbef-4456-8418-0566192ff7d9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:00:40.546188 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.546164 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72545bb0-dbef-4456-8418-0566192ff7d9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "72545bb0-dbef-4456-8418-0566192ff7d9" (UID: "72545bb0-dbef-4456-8418-0566192ff7d9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:00:40.579378 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.579352 2575 generic.go:358] "Generic (PLEG): container finished" podID="72545bb0-dbef-4456-8418-0566192ff7d9" containerID="3a4e03cb5cb14ba93567691c043ed40a9803966b6940924ab49921245870d24b" exitCode=0 Jun 03 16:00:40.579516 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.579430 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" Jun 03 16:00:40.579516 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.579445 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" event={"ID":"72545bb0-dbef-4456-8418-0566192ff7d9","Type":"ContainerDied","Data":"3a4e03cb5cb14ba93567691c043ed40a9803966b6940924ab49921245870d24b"} Jun 03 16:00:40.579516 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.579482 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6db4ffc696-rnmgh" event={"ID":"72545bb0-dbef-4456-8418-0566192ff7d9","Type":"ContainerDied","Data":"3fe7d534acf54af7fb110e08020c9b4b67e7ed89554adbc22f3198b1d8ca4127"} Jun 03 16:00:40.579516 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.579497 2575 scope.go:117] "RemoveContainer" containerID="3a4e03cb5cb14ba93567691c043ed40a9803966b6940924ab49921245870d24b" Jun 03 16:00:40.589003 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.588943 2575 scope.go:117] "RemoveContainer" containerID="3a4e03cb5cb14ba93567691c043ed40a9803966b6940924ab49921245870d24b" Jun 03 16:00:40.590286 ip-10-0-138-89 kubenswrapper[2575]: E0603 16:00:40.589443 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a4e03cb5cb14ba93567691c043ed40a9803966b6940924ab49921245870d24b\": container with ID starting with 3a4e03cb5cb14ba93567691c043ed40a9803966b6940924ab49921245870d24b not found: ID does not exist" containerID="3a4e03cb5cb14ba93567691c043ed40a9803966b6940924ab49921245870d24b" Jun 03 16:00:40.590286 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.589489 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4e03cb5cb14ba93567691c043ed40a9803966b6940924ab49921245870d24b"} err="failed to get container status \"3a4e03cb5cb14ba93567691c043ed40a9803966b6940924ab49921245870d24b\": rpc error: code = NotFound desc = could not find container \"3a4e03cb5cb14ba93567691c043ed40a9803966b6940924ab49921245870d24b\": container with ID starting with 3a4e03cb5cb14ba93567691c043ed40a9803966b6940924ab49921245870d24b not found: ID does not exist" Jun 03 16:00:40.600886 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.600863 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6db4ffc696-rnmgh"] Jun 03 16:00:40.605260 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.605236 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6db4ffc696-rnmgh"] Jun 03 16:00:40.638570 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.638546 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72545bb0-dbef-4456-8418-0566192ff7d9-trusted-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:40.638570 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.638571 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72545bb0-dbef-4456-8418-0566192ff7d9-installation-pull-secrets\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:40.638732 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.638583 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-bound-sa-token\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:40.638732 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.638593 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jdvf\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-kube-api-access-6jdvf\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:40.638732 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.638602 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72545bb0-dbef-4456-8418-0566192ff7d9-registry-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:40.638732 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.638613 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72545bb0-dbef-4456-8418-0566192ff7d9-image-registry-private-configuration\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:40.638732 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.638622 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72545bb0-dbef-4456-8418-0566192ff7d9-ca-trust-extracted\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:40.638732 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:40.638632 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72545bb0-dbef-4456-8418-0566192ff7d9-registry-certificates\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:41.873392 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:41.873360 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72545bb0-dbef-4456-8418-0566192ff7d9" path="/var/lib/kubelet/pods/72545bb0-dbef-4456-8418-0566192ff7d9/volumes" Jun 03 16:00:51.966092 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:51.966049 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 16:00:51.966713 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:51.966481 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="alertmanager" containerID="cri-o://47c2a7e8f9e08b1e9009c81fe1af8a7101d495441ad19d495d06c8ebfb86e216" gracePeriod=120 Jun 03 16:00:51.966713 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:51.966558 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="kube-rbac-proxy-metric" containerID="cri-o://4d9701ae63a670f134f60da7a4a259962c350a8407e1dfd4bd5e94f0d94d4956" gracePeriod=120 Jun 03 16:00:51.966713 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:51.966597 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="prom-label-proxy" containerID="cri-o://c708e21e2f5d4575a858015111b9bbaf1365187af33512b7caf176f38709ba2c" gracePeriod=120 Jun 03 16:00:51.966713 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:51.966611 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="kube-rbac-proxy-web" containerID="cri-o://a5761c815577bbbffa699443118cecc199d00e68c265c07cecb95883d8121ba2" gracePeriod=120 Jun 03 16:00:51.966713 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:51.966633 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="config-reloader" containerID="cri-o://d56a3ed2052f9ea1642ce16cf69b766f95903a0d09889eb031cd85024123b1be" gracePeriod=120 Jun 03 16:00:51.966713 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:51.966679 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="kube-rbac-proxy" containerID="cri-o://eea9efad4a38c0f0daa70b7e7f9da45a943748524994f42d0669e65f4772e18c" gracePeriod=120 Jun 03 16:00:52.616369 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:52.616334 2575 generic.go:358] "Generic (PLEG): container finished" podID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerID="c708e21e2f5d4575a858015111b9bbaf1365187af33512b7caf176f38709ba2c" exitCode=0 Jun 03 16:00:52.616369 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:52.616361 2575 generic.go:358] "Generic (PLEG): container finished" podID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerID="4d9701ae63a670f134f60da7a4a259962c350a8407e1dfd4bd5e94f0d94d4956" exitCode=0 Jun 03 16:00:52.616369 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:52.616367 2575 generic.go:358] "Generic (PLEG): container finished" podID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerID="eea9efad4a38c0f0daa70b7e7f9da45a943748524994f42d0669e65f4772e18c" exitCode=0 Jun 03 16:00:52.616369 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:52.616372 2575 generic.go:358] "Generic (PLEG): container finished" podID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerID="d56a3ed2052f9ea1642ce16cf69b766f95903a0d09889eb031cd85024123b1be" exitCode=0 Jun 03 16:00:52.616631 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:52.616379 2575 generic.go:358] "Generic (PLEG): container finished" podID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerID="47c2a7e8f9e08b1e9009c81fe1af8a7101d495441ad19d495d06c8ebfb86e216" exitCode=0 Jun 03 16:00:52.616631 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:52.616402 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca89698-526d-45d1-aa57-5c8dbfa1ea81","Type":"ContainerDied","Data":"c708e21e2f5d4575a858015111b9bbaf1365187af33512b7caf176f38709ba2c"} Jun 03 16:00:52.616631 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:52.616433 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca89698-526d-45d1-aa57-5c8dbfa1ea81","Type":"ContainerDied","Data":"4d9701ae63a670f134f60da7a4a259962c350a8407e1dfd4bd5e94f0d94d4956"} Jun 03 16:00:52.616631 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:52.616447 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca89698-526d-45d1-aa57-5c8dbfa1ea81","Type":"ContainerDied","Data":"eea9efad4a38c0f0daa70b7e7f9da45a943748524994f42d0669e65f4772e18c"} Jun 03 16:00:52.616631 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:52.616459 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca89698-526d-45d1-aa57-5c8dbfa1ea81","Type":"ContainerDied","Data":"d56a3ed2052f9ea1642ce16cf69b766f95903a0d09889eb031cd85024123b1be"} Jun 03 16:00:52.616631 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:52.616471 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca89698-526d-45d1-aa57-5c8dbfa1ea81","Type":"ContainerDied","Data":"47c2a7e8f9e08b1e9009c81fe1af8a7101d495441ad19d495d06c8ebfb86e216"} Jun 03 16:00:53.210574 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.210552 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.247410 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.247380 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy-web\") pod \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " Jun 03 16:00:53.247578 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.247430 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-web-config\") pod \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " Jun 03 16:00:53.247578 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.247463 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-config-out\") pod \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " Jun 03 16:00:53.247578 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.247492 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cpsr\" (UniqueName: \"kubernetes.io/projected/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-kube-api-access-4cpsr\") pod \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " Jun 03 16:00:53.247578 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.247521 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-main-tls\") pod \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " Jun 03 16:00:53.247578 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.247554 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-alertmanager-main-db\") pod \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " Jun 03 16:00:53.247578 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.247576 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-tls-assets\") pod \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " Jun 03 16:00:53.247874 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.247609 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-config-volume\") pod \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " Jun 03 16:00:53.247874 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.247648 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy\") pod \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " Jun 03 16:00:53.247874 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.247687 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " Jun 03 16:00:53.247874 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.247733 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-cluster-tls-config\") pod \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " Jun 03 16:00:53.247874 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.247766 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-metrics-client-ca\") pod \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " Jun 03 16:00:53.247874 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.247811 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-alertmanager-trusted-ca-bundle\") pod \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\" (UID: \"0ca89698-526d-45d1-aa57-5c8dbfa1ea81\") " Jun 03 16:00:53.248688 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.248404 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0ca89698-526d-45d1-aa57-5c8dbfa1ea81" (UID: "0ca89698-526d-45d1-aa57-5c8dbfa1ea81"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:00:53.249349 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.249035 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0ca89698-526d-45d1-aa57-5c8dbfa1ea81" (UID: "0ca89698-526d-45d1-aa57-5c8dbfa1ea81"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:00:53.251392 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.251190 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0ca89698-526d-45d1-aa57-5c8dbfa1ea81" (UID: "0ca89698-526d-45d1-aa57-5c8dbfa1ea81"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:00:53.251531 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.251502 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0ca89698-526d-45d1-aa57-5c8dbfa1ea81" (UID: "0ca89698-526d-45d1-aa57-5c8dbfa1ea81"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:00:53.251596 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.251557 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0ca89698-526d-45d1-aa57-5c8dbfa1ea81" (UID: "0ca89698-526d-45d1-aa57-5c8dbfa1ea81"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:00:53.251919 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.251877 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-config-out" (OuterVolumeSpecName: "config-out") pod "0ca89698-526d-45d1-aa57-5c8dbfa1ea81" (UID: "0ca89698-526d-45d1-aa57-5c8dbfa1ea81"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:00:53.255395 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.254436 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-config-volume" (OuterVolumeSpecName: "config-volume") pod "0ca89698-526d-45d1-aa57-5c8dbfa1ea81" (UID: "0ca89698-526d-45d1-aa57-5c8dbfa1ea81"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:00:53.255772 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.255733 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0ca89698-526d-45d1-aa57-5c8dbfa1ea81" (UID: "0ca89698-526d-45d1-aa57-5c8dbfa1ea81"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:00:53.259666 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.259639 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0ca89698-526d-45d1-aa57-5c8dbfa1ea81" (UID: "0ca89698-526d-45d1-aa57-5c8dbfa1ea81"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:00:53.259859 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.259819 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-kube-api-access-4cpsr" (OuterVolumeSpecName: "kube-api-access-4cpsr") pod "0ca89698-526d-45d1-aa57-5c8dbfa1ea81" (UID: "0ca89698-526d-45d1-aa57-5c8dbfa1ea81"). InnerVolumeSpecName "kube-api-access-4cpsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:00:53.261339 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.261296 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0ca89698-526d-45d1-aa57-5c8dbfa1ea81" (UID: "0ca89698-526d-45d1-aa57-5c8dbfa1ea81"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:00:53.262671 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.262642 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0ca89698-526d-45d1-aa57-5c8dbfa1ea81" (UID: "0ca89698-526d-45d1-aa57-5c8dbfa1ea81"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:00:53.266843 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.266819 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-web-config" (OuterVolumeSpecName: "web-config") pod "0ca89698-526d-45d1-aa57-5c8dbfa1ea81" (UID: "0ca89698-526d-45d1-aa57-5c8dbfa1ea81"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:00:53.348575 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.348498 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-alertmanager-main-db\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:53.348575 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.348525 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-tls-assets\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:53.348575 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.348536 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-config-volume\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:53.348575 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.348547 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:53.348575 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.348558 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:53.348575 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.348568 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-cluster-tls-config\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:53.348575 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.348580 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-metrics-client-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:53.348893 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.348588 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:53.348893 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.348598 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:53.348893 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.348607 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-web-config\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:53.348893 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.348615 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-config-out\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:53.348893 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.348623 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cpsr\" (UniqueName: \"kubernetes.io/projected/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-kube-api-access-4cpsr\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:53.348893 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.348631 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ca89698-526d-45d1-aa57-5c8dbfa1ea81-secret-alertmanager-main-tls\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:00:53.622581 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.622494 2575 generic.go:358] "Generic (PLEG): container finished" podID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerID="a5761c815577bbbffa699443118cecc199d00e68c265c07cecb95883d8121ba2" exitCode=0 Jun 03 16:00:53.622726 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.622571 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca89698-526d-45d1-aa57-5c8dbfa1ea81","Type":"ContainerDied","Data":"a5761c815577bbbffa699443118cecc199d00e68c265c07cecb95883d8121ba2"} Jun 03 16:00:53.622726 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.622604 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.622726 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.622620 2575 scope.go:117] "RemoveContainer" containerID="c708e21e2f5d4575a858015111b9bbaf1365187af33512b7caf176f38709ba2c" Jun 03 16:00:53.622726 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.622609 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ca89698-526d-45d1-aa57-5c8dbfa1ea81","Type":"ContainerDied","Data":"d86a43d90dd8e1d3a450fcfc659fe559413ef55bb6e105bc830c915078f88904"} Jun 03 16:00:53.630519 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.630498 2575 scope.go:117] "RemoveContainer" containerID="4d9701ae63a670f134f60da7a4a259962c350a8407e1dfd4bd5e94f0d94d4956" Jun 03 16:00:53.638392 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.638370 2575 scope.go:117] "RemoveContainer" containerID="eea9efad4a38c0f0daa70b7e7f9da45a943748524994f42d0669e65f4772e18c" Jun 03 16:00:53.645390 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.645361 2575 scope.go:117] "RemoveContainer" containerID="a5761c815577bbbffa699443118cecc199d00e68c265c07cecb95883d8121ba2" Jun 03 16:00:53.646433 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.646330 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 16:00:53.649644 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.649624 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 16:00:53.653789 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.653773 2575 scope.go:117] "RemoveContainer" containerID="d56a3ed2052f9ea1642ce16cf69b766f95903a0d09889eb031cd85024123b1be" Jun 03 16:00:53.661137 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.661117 2575 scope.go:117] "RemoveContainer" containerID="47c2a7e8f9e08b1e9009c81fe1af8a7101d495441ad19d495d06c8ebfb86e216" Jun 03 16:00:53.669486 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.669459 2575 scope.go:117] "RemoveContainer" containerID="b9da8a9c235e04f5009ae9f1d8106a4d50c8f2c02ed7f1d3e9679e8deb216259" Jun 03 16:00:53.680216 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.680181 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 16:00:53.680856 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.680836 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="kube-rbac-proxy" Jun 03 16:00:53.680906 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.680860 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="kube-rbac-proxy" Jun 03 16:00:53.680906 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.680876 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="config-reloader" Jun 03 16:00:53.680906 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.680885 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="config-reloader" Jun 03 16:00:53.680906 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.680902 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="kube-rbac-proxy-web" Jun 03 16:00:53.681046 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.680910 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="kube-rbac-proxy-web" Jun 03 16:00:53.681046 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.680936 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="kube-rbac-proxy-metric" Jun 03 16:00:53.681046 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.680944 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="kube-rbac-proxy-metric" Jun 03 16:00:53.681046 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.680956 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72545bb0-dbef-4456-8418-0566192ff7d9" containerName="registry" Jun 03 16:00:53.681046 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.680964 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="72545bb0-dbef-4456-8418-0566192ff7d9" containerName="registry" Jun 03 16:00:53.681046 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.680982 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="init-config-reloader" Jun 03 16:00:53.681046 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.680990 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="init-config-reloader" Jun 03 16:00:53.681046 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.680999 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="alertmanager" Jun 03 16:00:53.681046 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.681007 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="alertmanager" Jun 03 16:00:53.681046 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.681015 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="prom-label-proxy" Jun 03 16:00:53.681046 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.681028 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="prom-label-proxy" Jun 03 16:00:53.681468 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.681189 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="config-reloader" Jun 03 16:00:53.681468 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.681220 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="kube-rbac-proxy" Jun 03 16:00:53.681468 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.681241 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="kube-rbac-proxy-web" Jun 03 16:00:53.681468 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.681258 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="alertmanager" Jun 03 16:00:53.681468 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.681286 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="kube-rbac-proxy-metric" Jun 03 16:00:53.681468 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.681298 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="72545bb0-dbef-4456-8418-0566192ff7d9" containerName="registry" Jun 03 16:00:53.681468 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.681304 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" containerName="prom-label-proxy" Jun 03 16:00:53.686577 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.686556 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.687587 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.687560 2575 scope.go:117] "RemoveContainer" containerID="c708e21e2f5d4575a858015111b9bbaf1365187af33512b7caf176f38709ba2c" Jun 03 16:00:53.687945 ip-10-0-138-89 kubenswrapper[2575]: E0603 16:00:53.687895 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c708e21e2f5d4575a858015111b9bbaf1365187af33512b7caf176f38709ba2c\": container with ID starting with c708e21e2f5d4575a858015111b9bbaf1365187af33512b7caf176f38709ba2c not found: ID does not exist" containerID="c708e21e2f5d4575a858015111b9bbaf1365187af33512b7caf176f38709ba2c" Jun 03 16:00:53.688088 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.687956 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c708e21e2f5d4575a858015111b9bbaf1365187af33512b7caf176f38709ba2c"} err="failed to get container status \"c708e21e2f5d4575a858015111b9bbaf1365187af33512b7caf176f38709ba2c\": rpc error: code = NotFound desc = could not find container \"c708e21e2f5d4575a858015111b9bbaf1365187af33512b7caf176f38709ba2c\": container with ID starting with c708e21e2f5d4575a858015111b9bbaf1365187af33512b7caf176f38709ba2c not found: ID does not exist" Jun 03 16:00:53.688088 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.687984 2575 scope.go:117] "RemoveContainer" containerID="4d9701ae63a670f134f60da7a4a259962c350a8407e1dfd4bd5e94f0d94d4956" Jun 03 16:00:53.688629 ip-10-0-138-89 kubenswrapper[2575]: E0603 16:00:53.688534 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d9701ae63a670f134f60da7a4a259962c350a8407e1dfd4bd5e94f0d94d4956\": container with ID starting with 4d9701ae63a670f134f60da7a4a259962c350a8407e1dfd4bd5e94f0d94d4956 not found: ID does not exist" containerID="4d9701ae63a670f134f60da7a4a259962c350a8407e1dfd4bd5e94f0d94d4956" Jun 03 16:00:53.688629 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.688564 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d9701ae63a670f134f60da7a4a259962c350a8407e1dfd4bd5e94f0d94d4956"} err="failed to get container status \"4d9701ae63a670f134f60da7a4a259962c350a8407e1dfd4bd5e94f0d94d4956\": rpc error: code = NotFound desc = could not find container \"4d9701ae63a670f134f60da7a4a259962c350a8407e1dfd4bd5e94f0d94d4956\": container with ID starting with 4d9701ae63a670f134f60da7a4a259962c350a8407e1dfd4bd5e94f0d94d4956 not found: ID does not exist" Jun 03 16:00:53.688629 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.688587 2575 scope.go:117] "RemoveContainer" containerID="eea9efad4a38c0f0daa70b7e7f9da45a943748524994f42d0669e65f4772e18c" Jun 03 16:00:53.688888 ip-10-0-138-89 kubenswrapper[2575]: E0603 16:00:53.688860 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eea9efad4a38c0f0daa70b7e7f9da45a943748524994f42d0669e65f4772e18c\": container with ID starting with eea9efad4a38c0f0daa70b7e7f9da45a943748524994f42d0669e65f4772e18c not found: ID does not exist" containerID="eea9efad4a38c0f0daa70b7e7f9da45a943748524994f42d0669e65f4772e18c" Jun 03 16:00:53.688969 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.688887 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eea9efad4a38c0f0daa70b7e7f9da45a943748524994f42d0669e65f4772e18c"} err="failed to get container status \"eea9efad4a38c0f0daa70b7e7f9da45a943748524994f42d0669e65f4772e18c\": rpc error: code = NotFound desc = could not find container \"eea9efad4a38c0f0daa70b7e7f9da45a943748524994f42d0669e65f4772e18c\": container with ID starting with eea9efad4a38c0f0daa70b7e7f9da45a943748524994f42d0669e65f4772e18c not found: ID does not exist" Jun 03 16:00:53.688969 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.688908 2575 scope.go:117] "RemoveContainer" containerID="a5761c815577bbbffa699443118cecc199d00e68c265c07cecb95883d8121ba2" Jun 03 16:00:53.689277 ip-10-0-138-89 kubenswrapper[2575]: E0603 16:00:53.689239 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5761c815577bbbffa699443118cecc199d00e68c265c07cecb95883d8121ba2\": container with ID starting with a5761c815577bbbffa699443118cecc199d00e68c265c07cecb95883d8121ba2 not found: ID does not exist" containerID="a5761c815577bbbffa699443118cecc199d00e68c265c07cecb95883d8121ba2" Jun 03 16:00:53.689379 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.689290 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5761c815577bbbffa699443118cecc199d00e68c265c07cecb95883d8121ba2"} err="failed to get container status \"a5761c815577bbbffa699443118cecc199d00e68c265c07cecb95883d8121ba2\": rpc error: code = NotFound desc = could not find container \"a5761c815577bbbffa699443118cecc199d00e68c265c07cecb95883d8121ba2\": container with ID starting with a5761c815577bbbffa699443118cecc199d00e68c265c07cecb95883d8121ba2 not found: ID does not exist" Jun 03 16:00:53.689379 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.689312 2575 scope.go:117] "RemoveContainer" containerID="d56a3ed2052f9ea1642ce16cf69b766f95903a0d09889eb031cd85024123b1be" Jun 03 16:00:53.689731 ip-10-0-138-89 kubenswrapper[2575]: E0603 16:00:53.689673 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d56a3ed2052f9ea1642ce16cf69b766f95903a0d09889eb031cd85024123b1be\": container with ID starting with d56a3ed2052f9ea1642ce16cf69b766f95903a0d09889eb031cd85024123b1be not found: ID does not exist" containerID="d56a3ed2052f9ea1642ce16cf69b766f95903a0d09889eb031cd85024123b1be" Jun 03 16:00:53.689731 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.689702 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 16:00:53.689731 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.689719 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 16:00:53.690016 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.689962 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 16:00:53.690177 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.690074 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-69gm5\"" Jun 03 16:00:53.690177 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.690151 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 16:00:53.690405 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.689710 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d56a3ed2052f9ea1642ce16cf69b766f95903a0d09889eb031cd85024123b1be"} err="failed to get container status \"d56a3ed2052f9ea1642ce16cf69b766f95903a0d09889eb031cd85024123b1be\": rpc error: code = NotFound desc = could not find container \"d56a3ed2052f9ea1642ce16cf69b766f95903a0d09889eb031cd85024123b1be\": container with ID starting with d56a3ed2052f9ea1642ce16cf69b766f95903a0d09889eb031cd85024123b1be not found: ID does not exist" Jun 03 16:00:53.690405 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.690245 2575 scope.go:117] "RemoveContainer" containerID="47c2a7e8f9e08b1e9009c81fe1af8a7101d495441ad19d495d06c8ebfb86e216" Jun 03 16:00:53.690622 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.690410 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 16:00:53.690622 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.690455 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 16:00:53.690622 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.690410 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 16:00:53.690872 ip-10-0-138-89 kubenswrapper[2575]: E0603 16:00:53.690621 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47c2a7e8f9e08b1e9009c81fe1af8a7101d495441ad19d495d06c8ebfb86e216\": container with ID starting with 47c2a7e8f9e08b1e9009c81fe1af8a7101d495441ad19d495d06c8ebfb86e216 not found: ID does not exist" containerID="47c2a7e8f9e08b1e9009c81fe1af8a7101d495441ad19d495d06c8ebfb86e216" Jun 03 16:00:53.690872 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.690648 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47c2a7e8f9e08b1e9009c81fe1af8a7101d495441ad19d495d06c8ebfb86e216"} err="failed to get container status \"47c2a7e8f9e08b1e9009c81fe1af8a7101d495441ad19d495d06c8ebfb86e216\": rpc error: code = NotFound desc = could not find container \"47c2a7e8f9e08b1e9009c81fe1af8a7101d495441ad19d495d06c8ebfb86e216\": container with ID starting with 47c2a7e8f9e08b1e9009c81fe1af8a7101d495441ad19d495d06c8ebfb86e216 not found: ID does not exist" Jun 03 16:00:53.690872 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.690667 2575 scope.go:117] "RemoveContainer" containerID="b9da8a9c235e04f5009ae9f1d8106a4d50c8f2c02ed7f1d3e9679e8deb216259" Jun 03 16:00:53.690872 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.690858 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 16:00:53.691172 ip-10-0-138-89 kubenswrapper[2575]: E0603 16:00:53.690905 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9da8a9c235e04f5009ae9f1d8106a4d50c8f2c02ed7f1d3e9679e8deb216259\": container with ID starting with b9da8a9c235e04f5009ae9f1d8106a4d50c8f2c02ed7f1d3e9679e8deb216259 not found: ID does not exist" containerID="b9da8a9c235e04f5009ae9f1d8106a4d50c8f2c02ed7f1d3e9679e8deb216259" Jun 03 16:00:53.691172 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.690967 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 16:00:53.691172 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.690932 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9da8a9c235e04f5009ae9f1d8106a4d50c8f2c02ed7f1d3e9679e8deb216259"} err="failed to get container status \"b9da8a9c235e04f5009ae9f1d8106a4d50c8f2c02ed7f1d3e9679e8deb216259\": rpc error: code = NotFound desc = could not find container \"b9da8a9c235e04f5009ae9f1d8106a4d50c8f2c02ed7f1d3e9679e8deb216259\": container with ID starting with b9da8a9c235e04f5009ae9f1d8106a4d50c8f2c02ed7f1d3e9679e8deb216259 not found: ID does not exist" Jun 03 16:00:53.694482 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.694462 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 16:00:53.751656 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.751621 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.751656 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.751653 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-web-config\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.751971 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.751673 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/782785e3-9d4e-4d9a-b3de-84561cc79c66-tls-assets\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.751971 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.751693 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/782785e3-9d4e-4d9a-b3de-84561cc79c66-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.751971 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.751779 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.751971 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.751822 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/782785e3-9d4e-4d9a-b3de-84561cc79c66-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.751971 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.751862 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kslk\" (UniqueName: \"kubernetes.io/projected/782785e3-9d4e-4d9a-b3de-84561cc79c66-kube-api-access-5kslk\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.751971 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.751901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/782785e3-9d4e-4d9a-b3de-84561cc79c66-config-out\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.751971 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.751927 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.751971 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.751956 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.752308 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.751999 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.752308 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.752036 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/782785e3-9d4e-4d9a-b3de-84561cc79c66-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.752308 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.752070 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-config-volume\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.852606 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.852573 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.852606 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.852611 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-web-config\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.852846 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.852631 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/782785e3-9d4e-4d9a-b3de-84561cc79c66-tls-assets\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.852846 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.852650 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/782785e3-9d4e-4d9a-b3de-84561cc79c66-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.852846 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.852676 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.852846 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.852702 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/782785e3-9d4e-4d9a-b3de-84561cc79c66-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.852846 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.852720 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5kslk\" (UniqueName: \"kubernetes.io/projected/782785e3-9d4e-4d9a-b3de-84561cc79c66-kube-api-access-5kslk\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.852846 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.852743 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/782785e3-9d4e-4d9a-b3de-84561cc79c66-config-out\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.852846 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.852760 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.852846 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.852782 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.852846 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.852808 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.852846 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.852843 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/782785e3-9d4e-4d9a-b3de-84561cc79c66-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.853361 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.852876 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-config-volume\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.853361 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.853127 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/782785e3-9d4e-4d9a-b3de-84561cc79c66-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.853830 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.853804 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/782785e3-9d4e-4d9a-b3de-84561cc79c66-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.854373 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.854343 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/782785e3-9d4e-4d9a-b3de-84561cc79c66-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.855740 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.855716 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/782785e3-9d4e-4d9a-b3de-84561cc79c66-config-out\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.856354 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.855884 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.856354 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.856020 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.856354 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.856047 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.856354 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.856258 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/782785e3-9d4e-4d9a-b3de-84561cc79c66-tls-assets\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.856354 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.856311 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.856939 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.856921 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-web-config\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.857198 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.857182 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.857504 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.857490 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/782785e3-9d4e-4d9a-b3de-84561cc79c66-config-volume\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.859818 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.859798 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kslk\" (UniqueName: \"kubernetes.io/projected/782785e3-9d4e-4d9a-b3de-84561cc79c66-kube-api-access-5kslk\") pod \"alertmanager-main-0\" (UID: \"782785e3-9d4e-4d9a-b3de-84561cc79c66\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:53.873205 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.873148 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ca89698-526d-45d1-aa57-5c8dbfa1ea81" path="/var/lib/kubelet/pods/0ca89698-526d-45d1-aa57-5c8dbfa1ea81/volumes" Jun 03 16:00:53.999826 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:53.999788 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 16:00:54.132691 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:54.132624 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 16:00:54.134986 ip-10-0-138-89 kubenswrapper[2575]: W0603 16:00:54.134956 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod782785e3_9d4e_4d9a_b3de_84561cc79c66.slice/crio-97fec5e085f68db076df1b3d82b8d32664677540e46a49c6afefe9aff4143069 WatchSource:0}: Error finding container 97fec5e085f68db076df1b3d82b8d32664677540e46a49c6afefe9aff4143069: Status 404 returned error can't find the container with id 97fec5e085f68db076df1b3d82b8d32664677540e46a49c6afefe9aff4143069 Jun 03 16:00:54.627697 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:54.627665 2575 generic.go:358] "Generic (PLEG): container finished" podID="782785e3-9d4e-4d9a-b3de-84561cc79c66" containerID="c744998bb99b95530e5637ab8864670253e2bad860e2b179d286341ede92e5ed" exitCode=0 Jun 03 16:00:54.628120 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:54.627756 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"782785e3-9d4e-4d9a-b3de-84561cc79c66","Type":"ContainerDied","Data":"c744998bb99b95530e5637ab8864670253e2bad860e2b179d286341ede92e5ed"} Jun 03 16:00:54.628120 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:54.627790 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"782785e3-9d4e-4d9a-b3de-84561cc79c66","Type":"ContainerStarted","Data":"97fec5e085f68db076df1b3d82b8d32664677540e46a49c6afefe9aff4143069"} Jun 03 16:00:55.634301 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:55.634244 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"782785e3-9d4e-4d9a-b3de-84561cc79c66","Type":"ContainerStarted","Data":"54b871586058b7604b1e9bef0b3e4a19375be39e06552eaade3755d76519cb58"} Jun 03 16:00:55.634301 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:55.634303 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"782785e3-9d4e-4d9a-b3de-84561cc79c66","Type":"ContainerStarted","Data":"fafe5a3c882e37021ae73ab42a99385543f98e2428713224453c8c27fb475b46"} Jun 03 16:00:55.634707 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:55.634313 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"782785e3-9d4e-4d9a-b3de-84561cc79c66","Type":"ContainerStarted","Data":"7fef960345c8ec819b885c05de3af9932fbd5ccaa549697163780b1f3c914d11"} Jun 03 16:00:55.634707 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:55.634325 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"782785e3-9d4e-4d9a-b3de-84561cc79c66","Type":"ContainerStarted","Data":"72f48cc7c4b95daa848a7e076bc9aae792c76dc21c67fa20eb014647223d4744"} Jun 03 16:00:55.634707 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:55.634332 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"782785e3-9d4e-4d9a-b3de-84561cc79c66","Type":"ContainerStarted","Data":"d2bc9c3b13718b198089b4a343ea05c0e565a32b0715b34b2d99175231d019f8"} Jun 03 16:00:55.634707 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:55.634340 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"782785e3-9d4e-4d9a-b3de-84561cc79c66","Type":"ContainerStarted","Data":"e23a750c50ef72cdef6509cd8abd67b2f1bbe091c0d0d130ae0326ecdab509b4"} Jun 03 16:00:55.659458 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:00:55.659409 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.659396297 podStartE2EDuration="2.659396297s" podCreationTimestamp="2026-06-03 16:00:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:00:55.657803146 +0000 UTC m=+230.325190192" watchObservedRunningTime="2026-06-03 16:00:55.659396297 +0000 UTC m=+230.326783344" Jun 03 16:01:15.863648 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:15.863609 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76c8d6f84f-7gw6l"] Jun 03 16:01:40.887113 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:40.887036 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-76c8d6f84f-7gw6l" podUID="d1c6040d-6d05-428a-b02f-ad2bf5edc852" containerName="console" containerID="cri-o://dae53931d883ca3578fb1ba3866e847f0f83242d6770d34ce70c08e8901a1293" gracePeriod=15 Jun 03 16:01:41.128305 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.128283 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76c8d6f84f-7gw6l_d1c6040d-6d05-428a-b02f-ad2bf5edc852/console/0.log" Jun 03 16:01:41.128431 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.128342 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:01:41.147421 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.147350 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-oauth-serving-cert\") pod \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " Jun 03 16:01:41.147623 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.147603 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-config\") pod \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " Jun 03 16:01:41.147957 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.147934 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-serving-cert\") pod \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " Jun 03 16:01:41.148142 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.148124 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srm4b\" (UniqueName: \"kubernetes.io/projected/d1c6040d-6d05-428a-b02f-ad2bf5edc852-kube-api-access-srm4b\") pod \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " Jun 03 16:01:41.148302 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.148285 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-trusted-ca-bundle\") pod \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " Jun 03 16:01:41.148488 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.147704 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d1c6040d-6d05-428a-b02f-ad2bf5edc852" (UID: "d1c6040d-6d05-428a-b02f-ad2bf5edc852"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:01:41.148562 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.148061 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-config" (OuterVolumeSpecName: "console-config") pod "d1c6040d-6d05-428a-b02f-ad2bf5edc852" (UID: "d1c6040d-6d05-428a-b02f-ad2bf5edc852"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:01:41.148667 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.148650 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-service-ca\") pod \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " Jun 03 16:01:41.148792 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.148767 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-oauth-config\") pod \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\" (UID: \"d1c6040d-6d05-428a-b02f-ad2bf5edc852\") " Jun 03 16:01:41.148900 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.148667 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d1c6040d-6d05-428a-b02f-ad2bf5edc852" (UID: "d1c6040d-6d05-428a-b02f-ad2bf5edc852"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:01:41.149112 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.149091 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-trusted-ca-bundle\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:01:41.149162 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.149120 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-oauth-serving-cert\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:01:41.149162 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.149134 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-config\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:01:41.149336 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.149304 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-service-ca" (OuterVolumeSpecName: "service-ca") pod "d1c6040d-6d05-428a-b02f-ad2bf5edc852" (UID: "d1c6040d-6d05-428a-b02f-ad2bf5edc852"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:01:41.150558 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.150535 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d1c6040d-6d05-428a-b02f-ad2bf5edc852" (UID: "d1c6040d-6d05-428a-b02f-ad2bf5edc852"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:01:41.150678 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.150661 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1c6040d-6d05-428a-b02f-ad2bf5edc852-kube-api-access-srm4b" (OuterVolumeSpecName: "kube-api-access-srm4b") pod "d1c6040d-6d05-428a-b02f-ad2bf5edc852" (UID: "d1c6040d-6d05-428a-b02f-ad2bf5edc852"). InnerVolumeSpecName "kube-api-access-srm4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:01:41.151106 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.151082 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d1c6040d-6d05-428a-b02f-ad2bf5edc852" (UID: "d1c6040d-6d05-428a-b02f-ad2bf5edc852"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:01:41.249804 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.249756 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c6040d-6d05-428a-b02f-ad2bf5edc852-service-ca\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:01:41.249804 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.249800 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-oauth-config\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:01:41.249804 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.249811 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d1c6040d-6d05-428a-b02f-ad2bf5edc852-console-serving-cert\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:01:41.249804 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.249820 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srm4b\" (UniqueName: \"kubernetes.io/projected/d1c6040d-6d05-428a-b02f-ad2bf5edc852-kube-api-access-srm4b\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:01:41.766858 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.766830 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76c8d6f84f-7gw6l_d1c6040d-6d05-428a-b02f-ad2bf5edc852/console/0.log" Jun 03 16:01:41.767050 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.766867 2575 generic.go:358] "Generic (PLEG): container finished" podID="d1c6040d-6d05-428a-b02f-ad2bf5edc852" containerID="dae53931d883ca3578fb1ba3866e847f0f83242d6770d34ce70c08e8901a1293" exitCode=2 Jun 03 16:01:41.767050 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.766945 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c8d6f84f-7gw6l" Jun 03 16:01:41.767050 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.766949 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c8d6f84f-7gw6l" event={"ID":"d1c6040d-6d05-428a-b02f-ad2bf5edc852","Type":"ContainerDied","Data":"dae53931d883ca3578fb1ba3866e847f0f83242d6770d34ce70c08e8901a1293"} Jun 03 16:01:41.767050 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.767004 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c8d6f84f-7gw6l" event={"ID":"d1c6040d-6d05-428a-b02f-ad2bf5edc852","Type":"ContainerDied","Data":"7c6e9da6be05091c1f1153d57552b4946f71cfc7c26851a3ee702b0bd802f0c5"} Jun 03 16:01:41.767050 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.767020 2575 scope.go:117] "RemoveContainer" containerID="dae53931d883ca3578fb1ba3866e847f0f83242d6770d34ce70c08e8901a1293" Jun 03 16:01:41.775473 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.775456 2575 scope.go:117] "RemoveContainer" containerID="dae53931d883ca3578fb1ba3866e847f0f83242d6770d34ce70c08e8901a1293" Jun 03 16:01:41.775716 ip-10-0-138-89 kubenswrapper[2575]: E0603 16:01:41.775697 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dae53931d883ca3578fb1ba3866e847f0f83242d6770d34ce70c08e8901a1293\": container with ID starting with dae53931d883ca3578fb1ba3866e847f0f83242d6770d34ce70c08e8901a1293 not found: ID does not exist" containerID="dae53931d883ca3578fb1ba3866e847f0f83242d6770d34ce70c08e8901a1293" Jun 03 16:01:41.775803 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.775722 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dae53931d883ca3578fb1ba3866e847f0f83242d6770d34ce70c08e8901a1293"} err="failed to get container status \"dae53931d883ca3578fb1ba3866e847f0f83242d6770d34ce70c08e8901a1293\": rpc error: code = NotFound desc = could not find container \"dae53931d883ca3578fb1ba3866e847f0f83242d6770d34ce70c08e8901a1293\": container with ID starting with dae53931d883ca3578fb1ba3866e847f0f83242d6770d34ce70c08e8901a1293 not found: ID does not exist" Jun 03 16:01:41.787841 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.787817 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76c8d6f84f-7gw6l"] Jun 03 16:01:41.790351 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.790326 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76c8d6f84f-7gw6l"] Jun 03 16:01:41.872767 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:01:41.872738 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1c6040d-6d05-428a-b02f-ad2bf5edc852" path="/var/lib/kubelet/pods/d1c6040d-6d05-428a-b02f-ad2bf5edc852/volumes" Jun 03 16:02:05.791973 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:05.791940 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-rmtzs_0eeb520a-4f7b-409d-821b-a549bfa9d1f5/console-operator/2.log" Jun 03 16:02:05.792926 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:05.792892 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-rmtzs_0eeb520a-4f7b-409d-821b-a549bfa9d1f5/console-operator/2.log" Jun 03 16:02:05.798770 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:05.798749 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/ovn-acl-logging/0.log" Jun 03 16:02:05.799665 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:05.799642 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/ovn-acl-logging/0.log" Jun 03 16:02:05.802350 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:05.802329 2575 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 16:02:25.144582 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.144545 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8"] Jun 03 16:02:25.146212 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.144856 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1c6040d-6d05-428a-b02f-ad2bf5edc852" containerName="console" Jun 03 16:02:25.146212 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.144866 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1c6040d-6d05-428a-b02f-ad2bf5edc852" containerName="console" Jun 03 16:02:25.146212 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.144920 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="d1c6040d-6d05-428a-b02f-ad2bf5edc852" containerName="console" Jun 03 16:02:25.147228 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.147211 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" Jun 03 16:02:25.149552 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.149525 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 16:02:25.150452 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.150433 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 16:02:25.150537 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.150483 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f7t8h\"" Jun 03 16:02:25.158030 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.157999 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8"] Jun 03 16:02:25.215241 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.215202 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l68gn\" (UniqueName: \"kubernetes.io/projected/54054f76-7175-48e7-9105-7714b798c779-kube-api-access-l68gn\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8\" (UID: \"54054f76-7175-48e7-9105-7714b798c779\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" Jun 03 16:02:25.215455 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.215326 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54054f76-7175-48e7-9105-7714b798c779-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8\" (UID: \"54054f76-7175-48e7-9105-7714b798c779\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" Jun 03 16:02:25.215455 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.215367 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54054f76-7175-48e7-9105-7714b798c779-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8\" (UID: \"54054f76-7175-48e7-9105-7714b798c779\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" Jun 03 16:02:25.316386 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.316347 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54054f76-7175-48e7-9105-7714b798c779-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8\" (UID: \"54054f76-7175-48e7-9105-7714b798c779\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" Jun 03 16:02:25.316556 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.316395 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54054f76-7175-48e7-9105-7714b798c779-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8\" (UID: \"54054f76-7175-48e7-9105-7714b798c779\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" Jun 03 16:02:25.316556 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.316429 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l68gn\" (UniqueName: \"kubernetes.io/projected/54054f76-7175-48e7-9105-7714b798c779-kube-api-access-l68gn\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8\" (UID: \"54054f76-7175-48e7-9105-7714b798c779\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" Jun 03 16:02:25.316748 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.316724 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54054f76-7175-48e7-9105-7714b798c779-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8\" (UID: \"54054f76-7175-48e7-9105-7714b798c779\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" Jun 03 16:02:25.316812 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.316777 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54054f76-7175-48e7-9105-7714b798c779-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8\" (UID: \"54054f76-7175-48e7-9105-7714b798c779\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" Jun 03 16:02:25.324592 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.324563 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l68gn\" (UniqueName: \"kubernetes.io/projected/54054f76-7175-48e7-9105-7714b798c779-kube-api-access-l68gn\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8\" (UID: \"54054f76-7175-48e7-9105-7714b798c779\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" Jun 03 16:02:25.456765 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.456674 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" Jun 03 16:02:25.578042 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.577996 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8"] Jun 03 16:02:25.583779 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.583759 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:02:25.889724 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:25.889684 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" event={"ID":"54054f76-7175-48e7-9105-7714b798c779","Type":"ContainerStarted","Data":"65b6bc187d32c4c1fe5583be27a9b341990460cc14bcdfbf9940ef2eef3c41f4"} Jun 03 16:02:34.918159 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:34.918125 2575 generic.go:358] "Generic (PLEG): container finished" podID="54054f76-7175-48e7-9105-7714b798c779" containerID="a83ab7149ecf81c80db6026e780e915bd76236bbfd2c2be38ad721af362ffb39" exitCode=0 Jun 03 16:02:34.918614 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:34.918217 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" event={"ID":"54054f76-7175-48e7-9105-7714b798c779","Type":"ContainerDied","Data":"a83ab7149ecf81c80db6026e780e915bd76236bbfd2c2be38ad721af362ffb39"} Jun 03 16:02:38.930355 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:38.930321 2575 generic.go:358] "Generic (PLEG): container finished" podID="54054f76-7175-48e7-9105-7714b798c779" containerID="234da76eff433b4de17308b4731680f83630a4a873c2c88e002bbb7f20084ac5" exitCode=0 Jun 03 16:02:38.930778 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:38.930378 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" event={"ID":"54054f76-7175-48e7-9105-7714b798c779","Type":"ContainerDied","Data":"234da76eff433b4de17308b4731680f83630a4a873c2c88e002bbb7f20084ac5"} Jun 03 16:02:46.954618 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:46.954578 2575 generic.go:358] "Generic (PLEG): container finished" podID="54054f76-7175-48e7-9105-7714b798c779" containerID="e3c2d2176c0b00aa34b5c09072f8fa8bce11e010785026be7ef171a4a09f6036" exitCode=0 Jun 03 16:02:46.954991 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:46.954656 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" event={"ID":"54054f76-7175-48e7-9105-7714b798c779","Type":"ContainerDied","Data":"e3c2d2176c0b00aa34b5c09072f8fa8bce11e010785026be7ef171a4a09f6036"} Jun 03 16:02:48.075765 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:48.075742 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" Jun 03 16:02:48.212519 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:48.212429 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l68gn\" (UniqueName: \"kubernetes.io/projected/54054f76-7175-48e7-9105-7714b798c779-kube-api-access-l68gn\") pod \"54054f76-7175-48e7-9105-7714b798c779\" (UID: \"54054f76-7175-48e7-9105-7714b798c779\") " Jun 03 16:02:48.212519 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:48.212466 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54054f76-7175-48e7-9105-7714b798c779-bundle\") pod \"54054f76-7175-48e7-9105-7714b798c779\" (UID: \"54054f76-7175-48e7-9105-7714b798c779\") " Jun 03 16:02:48.212733 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:48.212613 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54054f76-7175-48e7-9105-7714b798c779-util\") pod \"54054f76-7175-48e7-9105-7714b798c779\" (UID: \"54054f76-7175-48e7-9105-7714b798c779\") " Jun 03 16:02:48.213260 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:48.213233 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54054f76-7175-48e7-9105-7714b798c779-bundle" (OuterVolumeSpecName: "bundle") pod "54054f76-7175-48e7-9105-7714b798c779" (UID: "54054f76-7175-48e7-9105-7714b798c779"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:02:48.214781 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:48.214760 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54054f76-7175-48e7-9105-7714b798c779-kube-api-access-l68gn" (OuterVolumeSpecName: "kube-api-access-l68gn") pod "54054f76-7175-48e7-9105-7714b798c779" (UID: "54054f76-7175-48e7-9105-7714b798c779"). InnerVolumeSpecName "kube-api-access-l68gn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:02:48.216569 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:48.216549 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54054f76-7175-48e7-9105-7714b798c779-util" (OuterVolumeSpecName: "util") pod "54054f76-7175-48e7-9105-7714b798c779" (UID: "54054f76-7175-48e7-9105-7714b798c779"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:02:48.313929 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:48.313895 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54054f76-7175-48e7-9105-7714b798c779-util\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:02:48.313929 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:48.313926 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l68gn\" (UniqueName: \"kubernetes.io/projected/54054f76-7175-48e7-9105-7714b798c779-kube-api-access-l68gn\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:02:48.313929 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:48.313937 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54054f76-7175-48e7-9105-7714b798c779-bundle\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:02:48.961957 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:48.961931 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" Jun 03 16:02:48.962127 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:48.961927 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9krz8" event={"ID":"54054f76-7175-48e7-9105-7714b798c779","Type":"ContainerDied","Data":"65b6bc187d32c4c1fe5583be27a9b341990460cc14bcdfbf9940ef2eef3c41f4"} Jun 03 16:02:48.962127 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:48.962039 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65b6bc187d32c4c1fe5583be27a9b341990460cc14bcdfbf9940ef2eef3c41f4" Jun 03 16:02:53.134377 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.134345 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-8t6sz"] Jun 03 16:02:53.134737 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.134651 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54054f76-7175-48e7-9105-7714b798c779" containerName="util" Jun 03 16:02:53.134737 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.134662 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="54054f76-7175-48e7-9105-7714b798c779" containerName="util" Jun 03 16:02:53.134737 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.134669 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54054f76-7175-48e7-9105-7714b798c779" containerName="extract" Jun 03 16:02:53.134737 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.134675 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="54054f76-7175-48e7-9105-7714b798c779" containerName="extract" Jun 03 16:02:53.134737 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.134686 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54054f76-7175-48e7-9105-7714b798c779" containerName="pull" Jun 03 16:02:53.134737 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.134693 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="54054f76-7175-48e7-9105-7714b798c779" containerName="pull" Jun 03 16:02:53.134737 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.134740 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="54054f76-7175-48e7-9105-7714b798c779" containerName="extract" Jun 03 16:02:53.136493 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.136477 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-8t6sz" Jun 03 16:02:53.142038 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.142012 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:02:53.142173 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.142011 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-dv8pl\"" Jun 03 16:02:53.142173 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.142046 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 16:02:53.146771 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.146742 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-8t6sz"] Jun 03 16:02:53.253599 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.253559 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkxtm\" (UniqueName: \"kubernetes.io/projected/463d209a-f3ab-4a80-9f9a-9c011ca7aba3-kube-api-access-zkxtm\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-8t6sz\" (UID: \"463d209a-f3ab-4a80-9f9a-9c011ca7aba3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-8t6sz" Jun 03 16:02:53.253599 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.253599 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/463d209a-f3ab-4a80-9f9a-9c011ca7aba3-tmp\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-8t6sz\" (UID: \"463d209a-f3ab-4a80-9f9a-9c011ca7aba3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-8t6sz" Jun 03 16:02:53.354804 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.354768 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkxtm\" (UniqueName: \"kubernetes.io/projected/463d209a-f3ab-4a80-9f9a-9c011ca7aba3-kube-api-access-zkxtm\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-8t6sz\" (UID: \"463d209a-f3ab-4a80-9f9a-9c011ca7aba3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-8t6sz" Jun 03 16:02:53.354804 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.354807 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/463d209a-f3ab-4a80-9f9a-9c011ca7aba3-tmp\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-8t6sz\" (UID: \"463d209a-f3ab-4a80-9f9a-9c011ca7aba3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-8t6sz" Jun 03 16:02:53.355166 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.355151 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/463d209a-f3ab-4a80-9f9a-9c011ca7aba3-tmp\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-8t6sz\" (UID: \"463d209a-f3ab-4a80-9f9a-9c011ca7aba3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-8t6sz" Jun 03 16:02:53.363079 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.363056 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkxtm\" (UniqueName: \"kubernetes.io/projected/463d209a-f3ab-4a80-9f9a-9c011ca7aba3-kube-api-access-zkxtm\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-8t6sz\" (UID: \"463d209a-f3ab-4a80-9f9a-9c011ca7aba3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-8t6sz" Jun 03 16:02:53.452777 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.452671 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-8t6sz" Jun 03 16:02:53.586005 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.585972 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-8t6sz"] Jun 03 16:02:53.590598 ip-10-0-138-89 kubenswrapper[2575]: W0603 16:02:53.590567 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod463d209a_f3ab_4a80_9f9a_9c011ca7aba3.slice/crio-23dc1dc231393eded71479fb9a24b19c8b7bc9f5cd599bee499c4625e59eb9d1 WatchSource:0}: Error finding container 23dc1dc231393eded71479fb9a24b19c8b7bc9f5cd599bee499c4625e59eb9d1: Status 404 returned error can't find the container with id 23dc1dc231393eded71479fb9a24b19c8b7bc9f5cd599bee499c4625e59eb9d1 Jun 03 16:02:53.976236 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:53.976199 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-8t6sz" event={"ID":"463d209a-f3ab-4a80-9f9a-9c011ca7aba3","Type":"ContainerStarted","Data":"23dc1dc231393eded71479fb9a24b19c8b7bc9f5cd599bee499c4625e59eb9d1"} Jun 03 16:02:55.985717 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:55.985678 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-8t6sz" event={"ID":"463d209a-f3ab-4a80-9f9a-9c011ca7aba3","Type":"ContainerStarted","Data":"654249badfc779d3e696e611fdd474bb607c87504849a431895edc3958dc64a3"} Jun 03 16:02:56.004972 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:56.004923 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-8t6sz" podStartSLOduration=1.404666687 podStartE2EDuration="3.0049088s" podCreationTimestamp="2026-06-03 16:02:53 +0000 UTC" firstStartedPulling="2026-06-03 16:02:53.592942604 +0000 UTC m=+348.260329629" lastFinishedPulling="2026-06-03 16:02:55.193184714 +0000 UTC m=+349.860571742" observedRunningTime="2026-06-03 16:02:56.002942122 +0000 UTC m=+350.670329169" watchObservedRunningTime="2026-06-03 16:02:56.0049088 +0000 UTC m=+350.672295847" Jun 03 16:02:58.437637 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:58.437599 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-7tkj7"] Jun 03 16:02:58.440256 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:58.440238 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-7tkj7" Jun 03 16:02:58.442709 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:58.442688 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 16:02:58.443690 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:58.443667 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4rxxb\"" Jun 03 16:02:58.443777 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:58.443735 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 16:02:58.448176 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:58.448154 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-7tkj7"] Jun 03 16:02:58.499142 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:58.499109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5d2w\" (UniqueName: \"kubernetes.io/projected/afe5b82c-8893-4d6a-8354-0e422c42b903-kube-api-access-h5d2w\") pod \"cert-manager-webhook-587ccfb98-7tkj7\" (UID: \"afe5b82c-8893-4d6a-8354-0e422c42b903\") " pod="cert-manager/cert-manager-webhook-587ccfb98-7tkj7" Jun 03 16:02:58.499142 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:58.499144 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afe5b82c-8893-4d6a-8354-0e422c42b903-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-7tkj7\" (UID: \"afe5b82c-8893-4d6a-8354-0e422c42b903\") " pod="cert-manager/cert-manager-webhook-587ccfb98-7tkj7" Jun 03 16:02:58.600492 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:58.600453 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5d2w\" (UniqueName: \"kubernetes.io/projected/afe5b82c-8893-4d6a-8354-0e422c42b903-kube-api-access-h5d2w\") pod \"cert-manager-webhook-587ccfb98-7tkj7\" (UID: \"afe5b82c-8893-4d6a-8354-0e422c42b903\") " pod="cert-manager/cert-manager-webhook-587ccfb98-7tkj7" Jun 03 16:02:58.600492 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:58.600492 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afe5b82c-8893-4d6a-8354-0e422c42b903-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-7tkj7\" (UID: \"afe5b82c-8893-4d6a-8354-0e422c42b903\") " pod="cert-manager/cert-manager-webhook-587ccfb98-7tkj7" Jun 03 16:02:58.608455 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:58.608427 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afe5b82c-8893-4d6a-8354-0e422c42b903-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-7tkj7\" (UID: \"afe5b82c-8893-4d6a-8354-0e422c42b903\") " pod="cert-manager/cert-manager-webhook-587ccfb98-7tkj7" Jun 03 16:02:58.608840 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:58.608824 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5d2w\" (UniqueName: \"kubernetes.io/projected/afe5b82c-8893-4d6a-8354-0e422c42b903-kube-api-access-h5d2w\") pod \"cert-manager-webhook-587ccfb98-7tkj7\" (UID: \"afe5b82c-8893-4d6a-8354-0e422c42b903\") " pod="cert-manager/cert-manager-webhook-587ccfb98-7tkj7" Jun 03 16:02:58.757500 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:58.757402 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-7tkj7" Jun 03 16:02:58.878573 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:58.878546 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-7tkj7"] Jun 03 16:02:58.880802 ip-10-0-138-89 kubenswrapper[2575]: W0603 16:02:58.880776 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafe5b82c_8893_4d6a_8354_0e422c42b903.slice/crio-9733307b870d12ddfac02b0aeb7e41d7403a9f147f4276f2398b3d3c14d2deee WatchSource:0}: Error finding container 9733307b870d12ddfac02b0aeb7e41d7403a9f147f4276f2398b3d3c14d2deee: Status 404 returned error can't find the container with id 9733307b870d12ddfac02b0aeb7e41d7403a9f147f4276f2398b3d3c14d2deee Jun 03 16:02:58.995815 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:02:58.995778 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-7tkj7" event={"ID":"afe5b82c-8893-4d6a-8354-0e422c42b903","Type":"ContainerStarted","Data":"9733307b870d12ddfac02b0aeb7e41d7403a9f147f4276f2398b3d3c14d2deee"} Jun 03 16:03:02.006526 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:02.006489 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-7tkj7" event={"ID":"afe5b82c-8893-4d6a-8354-0e422c42b903","Type":"ContainerStarted","Data":"88c4639e35dd1b46cd5a56cbfb73becbfca12b01b162d1ea95f59f0fb5815b3a"} Jun 03 16:03:02.006992 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:02.006597 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-7tkj7" Jun 03 16:03:02.023530 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:02.023482 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-7tkj7" podStartSLOduration=1.5947156599999999 podStartE2EDuration="4.0234695s" podCreationTimestamp="2026-06-03 16:02:58 +0000 UTC" firstStartedPulling="2026-06-03 16:02:58.882563905 +0000 UTC m=+353.549950929" lastFinishedPulling="2026-06-03 16:03:01.311317741 +0000 UTC m=+355.978704769" observedRunningTime="2026-06-03 16:03:02.021432619 +0000 UTC m=+356.688819678" watchObservedRunningTime="2026-06-03 16:03:02.0234695 +0000 UTC m=+356.690856547" Jun 03 16:03:03.915035 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:03.914995 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kgd8c"] Jun 03 16:03:03.917327 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:03.917301 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-kgd8c" Jun 03 16:03:03.922608 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:03.919866 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-m5cc6\"" Jun 03 16:03:03.928509 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:03.928485 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kgd8c"] Jun 03 16:03:04.048284 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:04.048229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/124ba901-5019-4f94-a97b-915581f225cd-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kgd8c\" (UID: \"124ba901-5019-4f94-a97b-915581f225cd\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kgd8c" Jun 03 16:03:04.048447 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:04.048291 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd2hm\" (UniqueName: \"kubernetes.io/projected/124ba901-5019-4f94-a97b-915581f225cd-kube-api-access-cd2hm\") pod \"cert-manager-cainjector-68b757865b-kgd8c\" (UID: \"124ba901-5019-4f94-a97b-915581f225cd\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kgd8c" Jun 03 16:03:04.149676 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:04.149639 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cd2hm\" (UniqueName: \"kubernetes.io/projected/124ba901-5019-4f94-a97b-915581f225cd-kube-api-access-cd2hm\") pod \"cert-manager-cainjector-68b757865b-kgd8c\" (UID: \"124ba901-5019-4f94-a97b-915581f225cd\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kgd8c" Jun 03 16:03:04.149838 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:04.149756 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/124ba901-5019-4f94-a97b-915581f225cd-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kgd8c\" (UID: \"124ba901-5019-4f94-a97b-915581f225cd\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kgd8c" Jun 03 16:03:04.160315 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:04.160280 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/124ba901-5019-4f94-a97b-915581f225cd-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kgd8c\" (UID: \"124ba901-5019-4f94-a97b-915581f225cd\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kgd8c" Jun 03 16:03:04.160873 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:04.160855 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd2hm\" (UniqueName: \"kubernetes.io/projected/124ba901-5019-4f94-a97b-915581f225cd-kube-api-access-cd2hm\") pod \"cert-manager-cainjector-68b757865b-kgd8c\" (UID: \"124ba901-5019-4f94-a97b-915581f225cd\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kgd8c" Jun 03 16:03:04.231598 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:04.231517 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-kgd8c" Jun 03 16:03:04.353793 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:04.353713 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kgd8c"] Jun 03 16:03:04.356029 ip-10-0-138-89 kubenswrapper[2575]: W0603 16:03:04.356002 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod124ba901_5019_4f94_a97b_915581f225cd.slice/crio-d2cb4374d880fcdf1f9c63d581fae2d6d8f4146a9be7625ce03e5806d5342d64 WatchSource:0}: Error finding container d2cb4374d880fcdf1f9c63d581fae2d6d8f4146a9be7625ce03e5806d5342d64: Status 404 returned error can't find the container with id d2cb4374d880fcdf1f9c63d581fae2d6d8f4146a9be7625ce03e5806d5342d64 Jun 03 16:03:05.016524 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:05.016488 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-kgd8c" event={"ID":"124ba901-5019-4f94-a97b-915581f225cd","Type":"ContainerStarted","Data":"9141f1b0052864f7dc9080da2f7f71398cf9e83d31062e40475d70d3905ed20d"} Jun 03 16:03:05.016524 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:05.016526 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-kgd8c" event={"ID":"124ba901-5019-4f94-a97b-915581f225cd","Type":"ContainerStarted","Data":"d2cb4374d880fcdf1f9c63d581fae2d6d8f4146a9be7625ce03e5806d5342d64"} Jun 03 16:03:05.032546 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:05.032501 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-kgd8c" podStartSLOduration=2.032485915 podStartE2EDuration="2.032485915s" podCreationTimestamp="2026-06-03 16:03:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:03:05.030388385 +0000 UTC m=+359.697775455" watchObservedRunningTime="2026-06-03 16:03:05.032485915 +0000 UTC m=+359.699872961" Jun 03 16:03:08.011854 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:08.011826 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-7tkj7" Jun 03 16:03:16.444021 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:16.443986 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-xshvm"] Jun 03 16:03:16.465800 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:16.465770 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-xshvm"] Jun 03 16:03:16.465944 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:16.465880 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-xshvm" Jun 03 16:03:16.468116 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:16.468093 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-225ql\"" Jun 03 16:03:16.556678 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:16.556642 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glhxf\" (UniqueName: \"kubernetes.io/projected/4432ce2e-6129-4ca2-9b06-d962aea3b478-kube-api-access-glhxf\") pod \"cert-manager-79c8d999ff-xshvm\" (UID: \"4432ce2e-6129-4ca2-9b06-d962aea3b478\") " pod="cert-manager/cert-manager-79c8d999ff-xshvm" Jun 03 16:03:16.556837 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:16.556686 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4432ce2e-6129-4ca2-9b06-d962aea3b478-bound-sa-token\") pod \"cert-manager-79c8d999ff-xshvm\" (UID: \"4432ce2e-6129-4ca2-9b06-d962aea3b478\") " pod="cert-manager/cert-manager-79c8d999ff-xshvm" Jun 03 16:03:16.657075 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:16.657038 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glhxf\" (UniqueName: \"kubernetes.io/projected/4432ce2e-6129-4ca2-9b06-d962aea3b478-kube-api-access-glhxf\") pod \"cert-manager-79c8d999ff-xshvm\" (UID: \"4432ce2e-6129-4ca2-9b06-d962aea3b478\") " pod="cert-manager/cert-manager-79c8d999ff-xshvm" Jun 03 16:03:16.657244 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:16.657089 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4432ce2e-6129-4ca2-9b06-d962aea3b478-bound-sa-token\") pod \"cert-manager-79c8d999ff-xshvm\" (UID: \"4432ce2e-6129-4ca2-9b06-d962aea3b478\") " pod="cert-manager/cert-manager-79c8d999ff-xshvm" Jun 03 16:03:16.665002 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:16.664976 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4432ce2e-6129-4ca2-9b06-d962aea3b478-bound-sa-token\") pod \"cert-manager-79c8d999ff-xshvm\" (UID: \"4432ce2e-6129-4ca2-9b06-d962aea3b478\") " pod="cert-manager/cert-manager-79c8d999ff-xshvm" Jun 03 16:03:16.677712 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:16.677682 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glhxf\" (UniqueName: \"kubernetes.io/projected/4432ce2e-6129-4ca2-9b06-d962aea3b478-kube-api-access-glhxf\") pod \"cert-manager-79c8d999ff-xshvm\" (UID: \"4432ce2e-6129-4ca2-9b06-d962aea3b478\") " pod="cert-manager/cert-manager-79c8d999ff-xshvm" Jun 03 16:03:16.774742 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:16.774706 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-xshvm" Jun 03 16:03:16.899092 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:16.899056 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-xshvm"] Jun 03 16:03:16.902596 ip-10-0-138-89 kubenswrapper[2575]: W0603 16:03:16.902566 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4432ce2e_6129_4ca2_9b06_d962aea3b478.slice/crio-652cc99b558ede01a85b2c242f52fa7ea282bd559ef52c578cac10516b534e3f WatchSource:0}: Error finding container 652cc99b558ede01a85b2c242f52fa7ea282bd559ef52c578cac10516b534e3f: Status 404 returned error can't find the container with id 652cc99b558ede01a85b2c242f52fa7ea282bd559ef52c578cac10516b534e3f Jun 03 16:03:17.058332 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:17.058236 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-xshvm" event={"ID":"4432ce2e-6129-4ca2-9b06-d962aea3b478","Type":"ContainerStarted","Data":"eae65093a2c219fafbb491279f6d19ab4afdfb53c34b2822e998fff368f47324"} Jun 03 16:03:17.058332 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:17.058298 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-xshvm" event={"ID":"4432ce2e-6129-4ca2-9b06-d962aea3b478","Type":"ContainerStarted","Data":"652cc99b558ede01a85b2c242f52fa7ea282bd559ef52c578cac10516b534e3f"} Jun 03 16:03:17.073467 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:17.073422 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-xshvm" podStartSLOduration=1.073407737 podStartE2EDuration="1.073407737s" podCreationTimestamp="2026-06-03 16:03:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:03:17.072699866 +0000 UTC m=+371.740086943" watchObservedRunningTime="2026-06-03 16:03:17.073407737 +0000 UTC m=+371.740794766" Jun 03 16:03:18.182859 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:18.182825 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb"] Jun 03 16:03:18.200381 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:18.200348 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb"] Jun 03 16:03:18.200540 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:18.200486 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" Jun 03 16:03:18.202892 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:18.202869 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 16:03:18.203752 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:18.203723 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f7t8h\"" Jun 03 16:03:18.203865 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:18.203757 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 16:03:18.268496 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:18.268465 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb6f76b6-27d3-42a1-a43c-13ba84119be4-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb\" (UID: \"fb6f76b6-27d3-42a1-a43c-13ba84119be4\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" Jun 03 16:03:18.268661 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:18.268515 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb6f76b6-27d3-42a1-a43c-13ba84119be4-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb\" (UID: \"fb6f76b6-27d3-42a1-a43c-13ba84119be4\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" Jun 03 16:03:18.268661 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:18.268583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn6jx\" (UniqueName: \"kubernetes.io/projected/fb6f76b6-27d3-42a1-a43c-13ba84119be4-kube-api-access-bn6jx\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb\" (UID: \"fb6f76b6-27d3-42a1-a43c-13ba84119be4\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" Jun 03 16:03:18.369325 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:18.369286 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb6f76b6-27d3-42a1-a43c-13ba84119be4-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb\" (UID: \"fb6f76b6-27d3-42a1-a43c-13ba84119be4\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" Jun 03 16:03:18.369490 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:18.369357 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb6f76b6-27d3-42a1-a43c-13ba84119be4-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb\" (UID: \"fb6f76b6-27d3-42a1-a43c-13ba84119be4\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" Jun 03 16:03:18.369490 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:18.369399 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bn6jx\" (UniqueName: \"kubernetes.io/projected/fb6f76b6-27d3-42a1-a43c-13ba84119be4-kube-api-access-bn6jx\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb\" (UID: \"fb6f76b6-27d3-42a1-a43c-13ba84119be4\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" Jun 03 16:03:18.369661 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:18.369643 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb6f76b6-27d3-42a1-a43c-13ba84119be4-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb\" (UID: \"fb6f76b6-27d3-42a1-a43c-13ba84119be4\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" Jun 03 16:03:18.369741 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:18.369721 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb6f76b6-27d3-42a1-a43c-13ba84119be4-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb\" (UID: \"fb6f76b6-27d3-42a1-a43c-13ba84119be4\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" Jun 03 16:03:18.377568 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:18.377548 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn6jx\" (UniqueName: \"kubernetes.io/projected/fb6f76b6-27d3-42a1-a43c-13ba84119be4-kube-api-access-bn6jx\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb\" (UID: \"fb6f76b6-27d3-42a1-a43c-13ba84119be4\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" Jun 03 16:03:18.511578 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:18.511499 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" Jun 03 16:03:18.641328 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:18.641301 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb"] Jun 03 16:03:18.643754 ip-10-0-138-89 kubenswrapper[2575]: W0603 16:03:18.643720 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb6f76b6_27d3_42a1_a43c_13ba84119be4.slice/crio-81e02912f0b2c5faf715f66052a4205a94f1ace27673abaee714bf0d5cee656c WatchSource:0}: Error finding container 81e02912f0b2c5faf715f66052a4205a94f1ace27673abaee714bf0d5cee656c: Status 404 returned error can't find the container with id 81e02912f0b2c5faf715f66052a4205a94f1ace27673abaee714bf0d5cee656c Jun 03 16:03:19.066747 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:19.066715 2575 generic.go:358] "Generic (PLEG): container finished" podID="fb6f76b6-27d3-42a1-a43c-13ba84119be4" containerID="f7a8feaf5034efc02f9c090c621e346cd52ea0cbc2bbec76d1f2814faf3f1a97" exitCode=0 Jun 03 16:03:19.066927 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:19.066796 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" event={"ID":"fb6f76b6-27d3-42a1-a43c-13ba84119be4","Type":"ContainerDied","Data":"f7a8feaf5034efc02f9c090c621e346cd52ea0cbc2bbec76d1f2814faf3f1a97"} Jun 03 16:03:19.066927 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:19.066823 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" event={"ID":"fb6f76b6-27d3-42a1-a43c-13ba84119be4","Type":"ContainerStarted","Data":"81e02912f0b2c5faf715f66052a4205a94f1ace27673abaee714bf0d5cee656c"} Jun 03 16:03:24.085667 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:24.085622 2575 generic.go:358] "Generic (PLEG): container finished" podID="fb6f76b6-27d3-42a1-a43c-13ba84119be4" containerID="10ab4fd08371e5f44d7232ea8144a3ded8aeb0a57182845d12dc0e6bcc62f40b" exitCode=0 Jun 03 16:03:24.086200 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:24.085673 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" event={"ID":"fb6f76b6-27d3-42a1-a43c-13ba84119be4","Type":"ContainerDied","Data":"10ab4fd08371e5f44d7232ea8144a3ded8aeb0a57182845d12dc0e6bcc62f40b"} Jun 03 16:03:25.090916 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:25.090879 2575 generic.go:358] "Generic (PLEG): container finished" podID="fb6f76b6-27d3-42a1-a43c-13ba84119be4" containerID="93ffd10c2e8a0e29d0fff185ce1d5957271fe39b8b411aee78c46b9711ef8321" exitCode=0 Jun 03 16:03:25.091288 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:25.090955 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" event={"ID":"fb6f76b6-27d3-42a1-a43c-13ba84119be4","Type":"ContainerDied","Data":"93ffd10c2e8a0e29d0fff185ce1d5957271fe39b8b411aee78c46b9711ef8321"} Jun 03 16:03:26.220461 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:26.220438 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" Jun 03 16:03:26.229133 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:26.229111 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb6f76b6-27d3-42a1-a43c-13ba84119be4-bundle\") pod \"fb6f76b6-27d3-42a1-a43c-13ba84119be4\" (UID: \"fb6f76b6-27d3-42a1-a43c-13ba84119be4\") " Jun 03 16:03:26.229211 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:26.229155 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb6f76b6-27d3-42a1-a43c-13ba84119be4-util\") pod \"fb6f76b6-27d3-42a1-a43c-13ba84119be4\" (UID: \"fb6f76b6-27d3-42a1-a43c-13ba84119be4\") " Jun 03 16:03:26.229211 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:26.229181 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bn6jx\" (UniqueName: \"kubernetes.io/projected/fb6f76b6-27d3-42a1-a43c-13ba84119be4-kube-api-access-bn6jx\") pod \"fb6f76b6-27d3-42a1-a43c-13ba84119be4\" (UID: \"fb6f76b6-27d3-42a1-a43c-13ba84119be4\") " Jun 03 16:03:26.229576 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:26.229532 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb6f76b6-27d3-42a1-a43c-13ba84119be4-bundle" (OuterVolumeSpecName: "bundle") pod "fb6f76b6-27d3-42a1-a43c-13ba84119be4" (UID: "fb6f76b6-27d3-42a1-a43c-13ba84119be4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:03:26.231179 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:26.231161 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb6f76b6-27d3-42a1-a43c-13ba84119be4-kube-api-access-bn6jx" (OuterVolumeSpecName: "kube-api-access-bn6jx") pod "fb6f76b6-27d3-42a1-a43c-13ba84119be4" (UID: "fb6f76b6-27d3-42a1-a43c-13ba84119be4"). InnerVolumeSpecName "kube-api-access-bn6jx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:03:26.233631 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:26.233593 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb6f76b6-27d3-42a1-a43c-13ba84119be4-util" (OuterVolumeSpecName: "util") pod "fb6f76b6-27d3-42a1-a43c-13ba84119be4" (UID: "fb6f76b6-27d3-42a1-a43c-13ba84119be4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:03:26.329771 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:26.329735 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb6f76b6-27d3-42a1-a43c-13ba84119be4-bundle\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:03:26.329771 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:26.329765 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb6f76b6-27d3-42a1-a43c-13ba84119be4-util\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:03:26.329771 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:26.329776 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bn6jx\" (UniqueName: \"kubernetes.io/projected/fb6f76b6-27d3-42a1-a43c-13ba84119be4-kube-api-access-bn6jx\") on node \"ip-10-0-138-89.ec2.internal\" DevicePath \"\"" Jun 03 16:03:27.099571 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:27.099533 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" event={"ID":"fb6f76b6-27d3-42a1-a43c-13ba84119be4","Type":"ContainerDied","Data":"81e02912f0b2c5faf715f66052a4205a94f1ace27673abaee714bf0d5cee656c"} Jun 03 16:03:27.099571 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:27.099569 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81e02912f0b2c5faf715f66052a4205a94f1ace27673abaee714bf0d5cee656c" Jun 03 16:03:27.099571 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:27.099542 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebrfkb" Jun 03 16:03:58.276325 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.276292 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr"] Jun 03 16:03:58.276781 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.276614 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb6f76b6-27d3-42a1-a43c-13ba84119be4" containerName="extract" Jun 03 16:03:58.276781 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.276628 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb6f76b6-27d3-42a1-a43c-13ba84119be4" containerName="extract" Jun 03 16:03:58.276781 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.276643 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb6f76b6-27d3-42a1-a43c-13ba84119be4" containerName="pull" Jun 03 16:03:58.276781 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.276648 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb6f76b6-27d3-42a1-a43c-13ba84119be4" containerName="pull" Jun 03 16:03:58.276781 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.276663 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb6f76b6-27d3-42a1-a43c-13ba84119be4" containerName="util" Jun 03 16:03:58.276781 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.276669 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb6f76b6-27d3-42a1-a43c-13ba84119be4" containerName="util" Jun 03 16:03:58.276781 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.276715 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb6f76b6-27d3-42a1-a43c-13ba84119be4" containerName="extract" Jun 03 16:03:58.283795 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.283774 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr" Jun 03 16:03:58.286182 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.286158 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jun 03 16:03:58.286314 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.286201 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 16:03:58.286314 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.286257 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jun 03 16:03:58.286314 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.286304 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 16:03:58.287113 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.287094 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-2vd6t\"" Jun 03 16:03:58.290216 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.290189 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr"] Jun 03 16:03:58.398046 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.398015 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12bc05e3-18bf-437d-977a-1f955b48b1b8-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr\" (UID: \"12bc05e3-18bf-437d-977a-1f955b48b1b8\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr" Jun 03 16:03:58.398206 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.398073 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njjzx\" (UniqueName: \"kubernetes.io/projected/12bc05e3-18bf-437d-977a-1f955b48b1b8-kube-api-access-njjzx\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr\" (UID: \"12bc05e3-18bf-437d-977a-1f955b48b1b8\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr" Jun 03 16:03:58.398249 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.398197 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/12bc05e3-18bf-437d-977a-1f955b48b1b8-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr\" (UID: \"12bc05e3-18bf-437d-977a-1f955b48b1b8\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr" Jun 03 16:03:58.498618 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.498580 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njjzx\" (UniqueName: \"kubernetes.io/projected/12bc05e3-18bf-437d-977a-1f955b48b1b8-kube-api-access-njjzx\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr\" (UID: \"12bc05e3-18bf-437d-977a-1f955b48b1b8\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr" Jun 03 16:03:58.498787 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.498682 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/12bc05e3-18bf-437d-977a-1f955b48b1b8-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr\" (UID: \"12bc05e3-18bf-437d-977a-1f955b48b1b8\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr" Jun 03 16:03:58.498787 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.498718 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12bc05e3-18bf-437d-977a-1f955b48b1b8-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr\" (UID: \"12bc05e3-18bf-437d-977a-1f955b48b1b8\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr" Jun 03 16:03:58.499392 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.499359 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/12bc05e3-18bf-437d-977a-1f955b48b1b8-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr\" (UID: \"12bc05e3-18bf-437d-977a-1f955b48b1b8\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr" Jun 03 16:03:58.500975 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.500954 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12bc05e3-18bf-437d-977a-1f955b48b1b8-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr\" (UID: \"12bc05e3-18bf-437d-977a-1f955b48b1b8\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr" Jun 03 16:03:58.506630 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.506606 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njjzx\" (UniqueName: \"kubernetes.io/projected/12bc05e3-18bf-437d-977a-1f955b48b1b8-kube-api-access-njjzx\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr\" (UID: \"12bc05e3-18bf-437d-977a-1f955b48b1b8\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr" Jun 03 16:03:58.594330 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.594225 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr" Jun 03 16:03:58.722752 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:58.722727 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr"] Jun 03 16:03:58.725186 ip-10-0-138-89 kubenswrapper[2575]: W0603 16:03:58.725158 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12bc05e3_18bf_437d_977a_1f955b48b1b8.slice/crio-c479d84ee65b97db6122b28bfbe91e33739bfccc2e695abdb8fcfd7c84db481d WatchSource:0}: Error finding container c479d84ee65b97db6122b28bfbe91e33739bfccc2e695abdb8fcfd7c84db481d: Status 404 returned error can't find the container with id c479d84ee65b97db6122b28bfbe91e33739bfccc2e695abdb8fcfd7c84db481d Jun 03 16:03:59.208085 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:03:59.208051 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr" event={"ID":"12bc05e3-18bf-437d-977a-1f955b48b1b8","Type":"ContainerStarted","Data":"c479d84ee65b97db6122b28bfbe91e33739bfccc2e695abdb8fcfd7c84db481d"} Jun 03 16:04:02.220114 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:02.220075 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr" event={"ID":"12bc05e3-18bf-437d-977a-1f955b48b1b8","Type":"ContainerStarted","Data":"55d089de3e3cb1c83fa18387e2d3229e9ae97d820b20d13de8c053e6252ef6ce"} Jun 03 16:04:02.220614 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:02.220217 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr" Jun 03 16:04:02.240597 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:02.240536 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr" podStartSLOduration=1.787245907 podStartE2EDuration="4.240518869s" podCreationTimestamp="2026-06-03 16:03:58 +0000 UTC" firstStartedPulling="2026-06-03 16:03:58.727110883 +0000 UTC m=+413.394497922" lastFinishedPulling="2026-06-03 16:04:01.180383857 +0000 UTC m=+415.847770884" observedRunningTime="2026-06-03 16:04:02.23790983 +0000 UTC m=+416.905296878" watchObservedRunningTime="2026-06-03 16:04:02.240518869 +0000 UTC m=+416.907905917" Jun 03 16:04:18.230761 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:18.230725 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr" Jun 03 16:04:56.414149 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.414114 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5868c44749-pvlmk"] Jun 03 16:04:56.417564 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.417539 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.419812 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.419785 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 16:04:56.419942 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.419889 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2bwhc\"" Jun 03 16:04:56.420921 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.420904 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 16:04:56.421039 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.420910 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 16:04:56.421107 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.421071 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 16:04:56.421323 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.421303 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 16:04:56.425218 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.425043 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 16:04:56.426908 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.426854 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5868c44749-pvlmk"] Jun 03 16:04:56.466188 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.466147 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9bdf639-8ac2-492a-835b-3ba340d3506a-console-config\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.466388 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.466203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9bdf639-8ac2-492a-835b-3ba340d3506a-oauth-serving-cert\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.466388 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.466246 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9bdf639-8ac2-492a-835b-3ba340d3506a-console-oauth-config\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.466388 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.466316 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9bdf639-8ac2-492a-835b-3ba340d3506a-service-ca\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.466388 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.466355 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fgzf\" (UniqueName: \"kubernetes.io/projected/f9bdf639-8ac2-492a-835b-3ba340d3506a-kube-api-access-7fgzf\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.466551 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.466393 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9bdf639-8ac2-492a-835b-3ba340d3506a-trusted-ca-bundle\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.466551 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.466413 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9bdf639-8ac2-492a-835b-3ba340d3506a-console-serving-cert\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.567228 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.567199 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9bdf639-8ac2-492a-835b-3ba340d3506a-trusted-ca-bundle\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.567424 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.567234 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9bdf639-8ac2-492a-835b-3ba340d3506a-console-serving-cert\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.567424 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.567289 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9bdf639-8ac2-492a-835b-3ba340d3506a-console-config\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.567424 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.567320 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9bdf639-8ac2-492a-835b-3ba340d3506a-oauth-serving-cert\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.567424 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.567352 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9bdf639-8ac2-492a-835b-3ba340d3506a-console-oauth-config\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.567424 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.567381 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9bdf639-8ac2-492a-835b-3ba340d3506a-service-ca\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.567424 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.567419 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fgzf\" (UniqueName: \"kubernetes.io/projected/f9bdf639-8ac2-492a-835b-3ba340d3506a-kube-api-access-7fgzf\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.568105 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.568075 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f9bdf639-8ac2-492a-835b-3ba340d3506a-console-config\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.568225 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.568115 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f9bdf639-8ac2-492a-835b-3ba340d3506a-oauth-serving-cert\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.568225 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.568181 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f9bdf639-8ac2-492a-835b-3ba340d3506a-service-ca\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.568345 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.568224 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9bdf639-8ac2-492a-835b-3ba340d3506a-trusted-ca-bundle\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.569882 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.569858 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f9bdf639-8ac2-492a-835b-3ba340d3506a-console-oauth-config\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.569980 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.569910 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f9bdf639-8ac2-492a-835b-3ba340d3506a-console-serving-cert\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.577054 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.577031 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fgzf\" (UniqueName: \"kubernetes.io/projected/f9bdf639-8ac2-492a-835b-3ba340d3506a-kube-api-access-7fgzf\") pod \"console-5868c44749-pvlmk\" (UID: \"f9bdf639-8ac2-492a-835b-3ba340d3506a\") " pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.728971 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.728888 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:04:56.858164 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:56.858031 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5868c44749-pvlmk"] Jun 03 16:04:56.861093 ip-10-0-138-89 kubenswrapper[2575]: W0603 16:04:56.861068 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9bdf639_8ac2_492a_835b_3ba340d3506a.slice/crio-d9f3ce209e889a97209860188be85a3657df1cfd3391d1d1633138236e8c7f87 WatchSource:0}: Error finding container d9f3ce209e889a97209860188be85a3657df1cfd3391d1d1633138236e8c7f87: Status 404 returned error can't find the container with id d9f3ce209e889a97209860188be85a3657df1cfd3391d1d1633138236e8c7f87 Jun 03 16:04:57.409626 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:57.409581 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5868c44749-pvlmk" event={"ID":"f9bdf639-8ac2-492a-835b-3ba340d3506a","Type":"ContainerStarted","Data":"029ce5da878122cc6ce243be5b3fdac4f26bf256a363d009dcb14a2abd8c364a"} Jun 03 16:04:57.409626 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:57.409620 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5868c44749-pvlmk" event={"ID":"f9bdf639-8ac2-492a-835b-3ba340d3506a","Type":"ContainerStarted","Data":"d9f3ce209e889a97209860188be85a3657df1cfd3391d1d1633138236e8c7f87"} Jun 03 16:04:57.429373 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:04:57.429324 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5868c44749-pvlmk" podStartSLOduration=1.429308988 podStartE2EDuration="1.429308988s" podCreationTimestamp="2026-06-03 16:04:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:04:57.427708774 +0000 UTC m=+472.095095822" watchObservedRunningTime="2026-06-03 16:04:57.429308988 +0000 UTC m=+472.096696035" Jun 03 16:05:06.729530 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:05:06.729488 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:05:06.729963 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:05:06.729649 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:05:06.734246 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:05:06.734224 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:05:07.447417 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:05:07.447390 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5868c44749-pvlmk" Jun 03 16:07:05.821895 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:07:05.821863 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-rmtzs_0eeb520a-4f7b-409d-821b-a549bfa9d1f5/console-operator/2.log" Jun 03 16:07:05.823367 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:07:05.823343 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-rmtzs_0eeb520a-4f7b-409d-821b-a549bfa9d1f5/console-operator/2.log" Jun 03 16:07:05.827566 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:07:05.827542 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/ovn-acl-logging/0.log" Jun 03 16:07:05.829075 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:07:05.829058 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/ovn-acl-logging/0.log" Jun 03 16:11:31.985670 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:11:31.985643 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr_12bc05e3-18bf-437d-977a-1f955b48b1b8/manager/0.log" Jun 03 16:11:32.472195 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:11:32.472164 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr_12bc05e3-18bf-437d-977a-1f955b48b1b8/manager/0.log" Jun 03 16:11:32.977109 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:11:32.977079 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-p2wrr_12bc05e3-18bf-437d-977a-1f955b48b1b8/manager/0.log" Jun 03 16:12:05.846620 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:05.846546 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-rmtzs_0eeb520a-4f7b-409d-821b-a549bfa9d1f5/console-operator/2.log" Jun 03 16:12:05.849418 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:05.849396 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-rmtzs_0eeb520a-4f7b-409d-821b-a549bfa9d1f5/console-operator/2.log" Jun 03 16:12:05.853068 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:05.853045 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/ovn-acl-logging/0.log" Jun 03 16:12:05.855525 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:05.855506 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/ovn-acl-logging/0.log" Jun 03 16:12:13.256673 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:13.256633 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mnc5j/must-gather-p2hcv"] Jun 03 16:12:13.260049 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:13.260032 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mnc5j/must-gather-p2hcv" Jun 03 16:12:13.263526 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:13.263507 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mnc5j\"/\"openshift-service-ca.crt\"" Jun 03 16:12:13.263748 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:13.263726 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mnc5j\"/\"default-dockercfg-wrfwr\"" Jun 03 16:12:13.263856 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:13.263798 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mnc5j\"/\"kube-root-ca.crt\"" Jun 03 16:12:13.271693 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:13.271671 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mnc5j/must-gather-p2hcv"] Jun 03 16:12:13.335105 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:13.335068 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a82c7d58-8ff3-4c8c-80d9-0539163f5b17-must-gather-output\") pod \"must-gather-p2hcv\" (UID: \"a82c7d58-8ff3-4c8c-80d9-0539163f5b17\") " pod="openshift-must-gather-mnc5j/must-gather-p2hcv" Jun 03 16:12:13.335297 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:13.335112 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l982q\" (UniqueName: \"kubernetes.io/projected/a82c7d58-8ff3-4c8c-80d9-0539163f5b17-kube-api-access-l982q\") pod \"must-gather-p2hcv\" (UID: \"a82c7d58-8ff3-4c8c-80d9-0539163f5b17\") " pod="openshift-must-gather-mnc5j/must-gather-p2hcv" Jun 03 16:12:13.436595 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:13.436552 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a82c7d58-8ff3-4c8c-80d9-0539163f5b17-must-gather-output\") pod \"must-gather-p2hcv\" (UID: \"a82c7d58-8ff3-4c8c-80d9-0539163f5b17\") " pod="openshift-must-gather-mnc5j/must-gather-p2hcv" Jun 03 16:12:13.436789 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:13.436604 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l982q\" (UniqueName: \"kubernetes.io/projected/a82c7d58-8ff3-4c8c-80d9-0539163f5b17-kube-api-access-l982q\") pod \"must-gather-p2hcv\" (UID: \"a82c7d58-8ff3-4c8c-80d9-0539163f5b17\") " pod="openshift-must-gather-mnc5j/must-gather-p2hcv" Jun 03 16:12:13.436947 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:13.436925 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a82c7d58-8ff3-4c8c-80d9-0539163f5b17-must-gather-output\") pod \"must-gather-p2hcv\" (UID: \"a82c7d58-8ff3-4c8c-80d9-0539163f5b17\") " pod="openshift-must-gather-mnc5j/must-gather-p2hcv" Jun 03 16:12:13.444045 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:13.444021 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l982q\" (UniqueName: \"kubernetes.io/projected/a82c7d58-8ff3-4c8c-80d9-0539163f5b17-kube-api-access-l982q\") pod \"must-gather-p2hcv\" (UID: \"a82c7d58-8ff3-4c8c-80d9-0539163f5b17\") " pod="openshift-must-gather-mnc5j/must-gather-p2hcv" Jun 03 16:12:13.569345 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:13.569303 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mnc5j/must-gather-p2hcv" Jun 03 16:12:13.699638 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:13.699612 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mnc5j/must-gather-p2hcv"] Jun 03 16:12:13.702349 ip-10-0-138-89 kubenswrapper[2575]: W0603 16:12:13.702315 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda82c7d58_8ff3_4c8c_80d9_0539163f5b17.slice/crio-5be350128eb783a5366cb6f4d32525fd0a07ca470235622ead9f699fc88310cf WatchSource:0}: Error finding container 5be350128eb783a5366cb6f4d32525fd0a07ca470235622ead9f699fc88310cf: Status 404 returned error can't find the container with id 5be350128eb783a5366cb6f4d32525fd0a07ca470235622ead9f699fc88310cf Jun 03 16:12:13.703988 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:13.703971 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:12:13.864472 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:13.864384 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mnc5j/must-gather-p2hcv" event={"ID":"a82c7d58-8ff3-4c8c-80d9-0539163f5b17","Type":"ContainerStarted","Data":"5be350128eb783a5366cb6f4d32525fd0a07ca470235622ead9f699fc88310cf"} Jun 03 16:12:14.869945 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:14.869901 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mnc5j/must-gather-p2hcv" event={"ID":"a82c7d58-8ff3-4c8c-80d9-0539163f5b17","Type":"ContainerStarted","Data":"bf2f713bcd021bbc38dce618550e7b5f11346a240b4975b36afb717fed88e607"} Jun 03 16:12:14.869945 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:14.869946 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mnc5j/must-gather-p2hcv" event={"ID":"a82c7d58-8ff3-4c8c-80d9-0539163f5b17","Type":"ContainerStarted","Data":"8f770d254d44cc79cf77afd728ce0fba8ce05006655546252b5c4a157a0faa87"} Jun 03 16:12:14.885085 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:14.884979 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mnc5j/must-gather-p2hcv" podStartSLOduration=0.966033071 podStartE2EDuration="1.884960723s" podCreationTimestamp="2026-06-03 16:12:13 +0000 UTC" firstStartedPulling="2026-06-03 16:12:13.704127723 +0000 UTC m=+908.371514747" lastFinishedPulling="2026-06-03 16:12:14.623055374 +0000 UTC m=+909.290442399" observedRunningTime="2026-06-03 16:12:14.884535737 +0000 UTC m=+909.551922786" watchObservedRunningTime="2026-06-03 16:12:14.884960723 +0000 UTC m=+909.552347770" Jun 03 16:12:15.947905 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:15.947875 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dhw9d_8005fb8c-13cc-491f-bdb3-80744ed6306c/global-pull-secret-syncer/0.log" Jun 03 16:12:16.152240 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:16.152205 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cmm55_983ee38c-b506-4ac9-b241-37b0292bad9d/konnectivity-agent/0.log" Jun 03 16:12:16.220042 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:16.219967 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-89.ec2.internal_d78abd18259f21ae1cd5ff6d8347d3c9/haproxy/0.log" Jun 03 16:12:18.985831 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:18.985799 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_782785e3-9d4e-4d9a-b3de-84561cc79c66/alertmanager/0.log" Jun 03 16:12:19.032484 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:19.032455 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_782785e3-9d4e-4d9a-b3de-84561cc79c66/config-reloader/0.log" Jun 03 16:12:19.064954 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:19.064918 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_782785e3-9d4e-4d9a-b3de-84561cc79c66/kube-rbac-proxy-web/0.log" Jun 03 16:12:19.112223 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:19.112170 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_782785e3-9d4e-4d9a-b3de-84561cc79c66/kube-rbac-proxy/0.log" Jun 03 16:12:19.152160 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:19.152125 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_782785e3-9d4e-4d9a-b3de-84561cc79c66/kube-rbac-proxy-metric/0.log" Jun 03 16:12:19.183923 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:19.183892 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_782785e3-9d4e-4d9a-b3de-84561cc79c66/prom-label-proxy/0.log" Jun 03 16:12:19.206684 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:19.206655 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_782785e3-9d4e-4d9a-b3de-84561cc79c66/init-config-reloader/0.log" Jun 03 16:12:19.248680 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:19.248590 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-dmml9_953f9708-f510-4a1e-a7e7-107ae6f5f46e/cluster-monitoring-operator/0.log" Jun 03 16:12:19.276311 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:19.276255 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-8xxff_411f0136-7786-46d4-abc1-3b591215797e/kube-state-metrics/0.log" Jun 03 16:12:19.297428 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:19.297391 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-8xxff_411f0136-7786-46d4-abc1-3b591215797e/kube-rbac-proxy-main/0.log" Jun 03 16:12:19.324822 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:19.324788 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-8xxff_411f0136-7786-46d4-abc1-3b591215797e/kube-rbac-proxy-self/0.log" Jun 03 16:12:19.353869 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:19.353843 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-67948895c-9pl82_a937ef72-2a2e-4096-ba51-b76552455b32/metrics-server/0.log" Jun 03 16:12:19.377074 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:19.377049 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-7lnl5_89f1a473-4cd0-478e-a5b2-5142221e9562/monitoring-plugin/0.log" Jun 03 16:12:19.578563 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:19.578534 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vqkgq_8ec4bf18-3f41-4ad5-90b4-7fb0682893f6/node-exporter/0.log" Jun 03 16:12:19.603759 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:19.603729 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vqkgq_8ec4bf18-3f41-4ad5-90b4-7fb0682893f6/kube-rbac-proxy/0.log" Jun 03 16:12:19.632101 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:19.632072 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vqkgq_8ec4bf18-3f41-4ad5-90b4-7fb0682893f6/init-textfile/0.log" Jun 03 16:12:19.884338 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:19.884250 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-lvlfl_5b3e0b64-02f4-49dc-bcbb-d6163c19e40e/prometheus-operator/0.log" Jun 03 16:12:19.900864 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:19.900832 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-lvlfl_5b3e0b64-02f4-49dc-bcbb-d6163c19e40e/kube-rbac-proxy/0.log" Jun 03 16:12:21.664548 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:21.664521 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-rmtzs_0eeb520a-4f7b-409d-821b-a549bfa9d1f5/console-operator/2.log" Jun 03 16:12:21.672942 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:21.672916 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-rmtzs_0eeb520a-4f7b-409d-821b-a549bfa9d1f5/console-operator/3.log" Jun 03 16:12:22.019612 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:22.019580 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5868c44749-pvlmk_f9bdf639-8ac2-492a-835b-3ba340d3506a/console/0.log" Jun 03 16:12:22.051336 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:22.051306 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-b25cv_8fa4ef1d-9065-4ba5-8a2a-2d8a0e048289/download-server/0.log" Jun 03 16:12:22.858722 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:22.858691 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj"] Jun 03 16:12:22.863759 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:22.863719 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:22.871857 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:22.871830 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj"] Jun 03 16:12:22.930816 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:22.930777 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5b85\" (UniqueName: \"kubernetes.io/projected/0114d941-d051-478c-a970-2d17d79cbce9-kube-api-access-x5b85\") pod \"perf-node-gather-daemonset-9mphj\" (UID: \"0114d941-d051-478c-a970-2d17d79cbce9\") " pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:22.930998 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:22.930834 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0114d941-d051-478c-a970-2d17d79cbce9-podres\") pod \"perf-node-gather-daemonset-9mphj\" (UID: \"0114d941-d051-478c-a970-2d17d79cbce9\") " pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:22.930998 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:22.930910 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0114d941-d051-478c-a970-2d17d79cbce9-lib-modules\") pod \"perf-node-gather-daemonset-9mphj\" (UID: \"0114d941-d051-478c-a970-2d17d79cbce9\") " pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:22.930998 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:22.930943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0114d941-d051-478c-a970-2d17d79cbce9-proc\") pod \"perf-node-gather-daemonset-9mphj\" (UID: \"0114d941-d051-478c-a970-2d17d79cbce9\") " pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:22.930998 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:22.930982 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0114d941-d051-478c-a970-2d17d79cbce9-sys\") pod \"perf-node-gather-daemonset-9mphj\" (UID: \"0114d941-d051-478c-a970-2d17d79cbce9\") " pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:23.032347 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.032319 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0114d941-d051-478c-a970-2d17d79cbce9-lib-modules\") pod \"perf-node-gather-daemonset-9mphj\" (UID: \"0114d941-d051-478c-a970-2d17d79cbce9\") " pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:23.032347 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.032358 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0114d941-d051-478c-a970-2d17d79cbce9-proc\") pod \"perf-node-gather-daemonset-9mphj\" (UID: \"0114d941-d051-478c-a970-2d17d79cbce9\") " pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:23.032544 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.032392 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0114d941-d051-478c-a970-2d17d79cbce9-sys\") pod \"perf-node-gather-daemonset-9mphj\" (UID: \"0114d941-d051-478c-a970-2d17d79cbce9\") " pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:23.032544 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.032447 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5b85\" (UniqueName: \"kubernetes.io/projected/0114d941-d051-478c-a970-2d17d79cbce9-kube-api-access-x5b85\") pod \"perf-node-gather-daemonset-9mphj\" (UID: \"0114d941-d051-478c-a970-2d17d79cbce9\") " pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:23.032544 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.032481 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0114d941-d051-478c-a970-2d17d79cbce9-podres\") pod \"perf-node-gather-daemonset-9mphj\" (UID: \"0114d941-d051-478c-a970-2d17d79cbce9\") " pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:23.032544 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.032500 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0114d941-d051-478c-a970-2d17d79cbce9-lib-modules\") pod \"perf-node-gather-daemonset-9mphj\" (UID: \"0114d941-d051-478c-a970-2d17d79cbce9\") " pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:23.032544 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.032509 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0114d941-d051-478c-a970-2d17d79cbce9-proc\") pod \"perf-node-gather-daemonset-9mphj\" (UID: \"0114d941-d051-478c-a970-2d17d79cbce9\") " pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:23.032698 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.032574 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0114d941-d051-478c-a970-2d17d79cbce9-podres\") pod \"perf-node-gather-daemonset-9mphj\" (UID: \"0114d941-d051-478c-a970-2d17d79cbce9\") " pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:23.032698 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.032509 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0114d941-d051-478c-a970-2d17d79cbce9-sys\") pod \"perf-node-gather-daemonset-9mphj\" (UID: \"0114d941-d051-478c-a970-2d17d79cbce9\") " pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:23.040336 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.040310 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5b85\" (UniqueName: \"kubernetes.io/projected/0114d941-d051-478c-a970-2d17d79cbce9-kube-api-access-x5b85\") pod \"perf-node-gather-daemonset-9mphj\" (UID: \"0114d941-d051-478c-a970-2d17d79cbce9\") " pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:23.122761 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.122677 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v67kr_4465e033-8e83-4a18-92fc-16596d24a5d3/dns/0.log" Jun 03 16:12:23.141915 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.141887 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v67kr_4465e033-8e83-4a18-92fc-16596d24a5d3/kube-rbac-proxy/0.log" Jun 03 16:12:23.163138 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.163116 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-96gss_e98840fb-b4bc-48f4-b044-c91aa26a528b/dns-node-resolver/0.log" Jun 03 16:12:23.176938 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.176912 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:23.324349 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.324317 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj"] Jun 03 16:12:23.327893 ip-10-0-138-89 kubenswrapper[2575]: W0603 16:12:23.327851 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0114d941_d051_478c_a970_2d17d79cbce9.slice/crio-ba68a9532fbb51b2eec14db29751a0c02d6f9148c7c485a11bfa62e7422a73bf WatchSource:0}: Error finding container ba68a9532fbb51b2eec14db29751a0c02d6f9148c7c485a11bfa62e7422a73bf: Status 404 returned error can't find the container with id ba68a9532fbb51b2eec14db29751a0c02d6f9148c7c485a11bfa62e7422a73bf Jun 03 16:12:23.681370 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.681340 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rx47m_773fe981-eb8d-4ad7-8434-78168e05801d/node-ca/0.log" Jun 03 16:12:23.916904 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.916864 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" event={"ID":"0114d941-d051-478c-a970-2d17d79cbce9","Type":"ContainerStarted","Data":"8726a7e36b3df56f8af968069bde655555d134829eca83b9f81a6ef716dd2de1"} Jun 03 16:12:23.916904 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.916912 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" event={"ID":"0114d941-d051-478c-a970-2d17d79cbce9","Type":"ContainerStarted","Data":"ba68a9532fbb51b2eec14db29751a0c02d6f9148c7c485a11bfa62e7422a73bf"} Jun 03 16:12:23.917358 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.916945 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:23.934135 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:23.934075 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" podStartSLOduration=1.934054976 podStartE2EDuration="1.934054976s" podCreationTimestamp="2026-06-03 16:12:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:12:23.931119579 +0000 UTC m=+918.598506638" watchObservedRunningTime="2026-06-03 16:12:23.934054976 +0000 UTC m=+918.601442024" Jun 03 16:12:24.646468 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:24.646436 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7h2s8_14eb1552-43bf-42ab-9e89-982e0cf1d219/serve-healthcheck-canary/0.log" Jun 03 16:12:25.012528 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:25.012432 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-fjjpr_134d251f-a962-46f6-817f-f4b4b52b4694/insights-operator/1.log" Jun 03 16:12:25.013066 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:25.013039 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-fjjpr_134d251f-a962-46f6-817f-f4b4b52b4694/insights-operator/0.log" Jun 03 16:12:25.035626 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:25.035540 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8kq4p_eeb91613-21b9-4926-80b8-2a1f18caf9f5/kube-rbac-proxy/0.log" Jun 03 16:12:25.055452 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:25.055429 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8kq4p_eeb91613-21b9-4926-80b8-2a1f18caf9f5/exporter/0.log" Jun 03 16:12:25.074785 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:25.074763 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8kq4p_eeb91613-21b9-4926-80b8-2a1f18caf9f5/extractor/0.log" Jun 03 16:12:29.587933 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:29.587903 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-dthrj_6a701f60-2c8a-49d6-b8ea-f038a36d10d0/migrator/0.log" Jun 03 16:12:29.606469 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:29.606438 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-dthrj_6a701f60-2c8a-49d6-b8ea-f038a36d10d0/graceful-termination/0.log" Jun 03 16:12:29.933083 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:29.933001 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mnc5j/perf-node-gather-daemonset-9mphj" Jun 03 16:12:31.002105 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:31.002069 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wsfnl_fa4ea0e6-081d-4f6f-a5db-f66831a07a15/kube-multus-additional-cni-plugins/0.log" Jun 03 16:12:31.034401 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:31.034373 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wsfnl_fa4ea0e6-081d-4f6f-a5db-f66831a07a15/egress-router-binary-copy/0.log" Jun 03 16:12:31.056517 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:31.056480 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wsfnl_fa4ea0e6-081d-4f6f-a5db-f66831a07a15/cni-plugins/0.log" Jun 03 16:12:31.082986 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:31.082952 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wsfnl_fa4ea0e6-081d-4f6f-a5db-f66831a07a15/bond-cni-plugin/0.log" Jun 03 16:12:31.125457 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:31.125422 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wsfnl_fa4ea0e6-081d-4f6f-a5db-f66831a07a15/routeoverride-cni/0.log" Jun 03 16:12:31.154441 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:31.154418 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wsfnl_fa4ea0e6-081d-4f6f-a5db-f66831a07a15/whereabouts-cni-bincopy/0.log" Jun 03 16:12:31.178793 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:31.178766 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wsfnl_fa4ea0e6-081d-4f6f-a5db-f66831a07a15/whereabouts-cni/0.log" Jun 03 16:12:31.218983 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:31.218954 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qf7wr_42d28413-02d0-4f2f-adc2-4c08b3f0419d/kube-multus/0.log" Jun 03 16:12:31.317013 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:31.316980 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6h6md_6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd/network-metrics-daemon/0.log" Jun 03 16:12:31.338083 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:31.338037 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6h6md_6f8532b6-914d-42d8-bc0e-ab5a82f5c3bd/kube-rbac-proxy/0.log" Jun 03 16:12:32.838547 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:32.838509 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/ovn-controller/0.log" Jun 03 16:12:32.854236 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:32.854205 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/ovn-acl-logging/0.log" Jun 03 16:12:32.862456 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:32.862433 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/ovn-acl-logging/1.log" Jun 03 16:12:32.882242 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:32.882223 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/kube-rbac-proxy-node/0.log" Jun 03 16:12:32.917458 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:32.917426 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 16:12:32.934732 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:32.934705 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/northd/0.log" Jun 03 16:12:32.956615 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:32.956587 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/nbdb/0.log" Jun 03 16:12:32.975301 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:32.975256 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/sbdb/0.log" Jun 03 16:12:33.177221 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:33.177137 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfbq8_cd98e600-3aa6-4647-be14-6b3a72074ed7/ovnkube-controller/0.log" Jun 03 16:12:34.232817 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:34.232772 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hm4zx_b55f5a62-2148-45e4-a39e-c1dcd628aa44/network-check-target-container/0.log" Jun 03 16:12:35.030410 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:35.030367 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-r6t4v_499fcfa6-bfea-4f27-8adc-a52a14c799b7/iptables-alerter/0.log" Jun 03 16:12:35.609592 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:35.609557 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-22mgv_7a911b23-c625-4075-9942-eee0e418c89b/tuned/0.log" Jun 03 16:12:37.286993 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:37.286964 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-755bbf9bfb-z6lr6_0cb1e9a5-783d-4fae-ac90-c2df2ac201b4/cluster-samples-operator/0.log" Jun 03 16:12:37.303113 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:37.303089 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-755bbf9bfb-z6lr6_0cb1e9a5-783d-4fae-ac90-c2df2ac201b4/cluster-samples-operator-watch/0.log" Jun 03 16:12:38.188919 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:38.188886 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-69877444c-bfdhh_b8a89d7a-e967-458e-897f-a90a997e5e7b/service-ca-operator/1.log" Jun 03 16:12:38.190644 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:38.190618 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-69877444c-bfdhh_b8a89d7a-e967-458e-897f-a90a997e5e7b/service-ca-operator/0.log" Jun 03 16:12:38.972625 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:38.972594 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-qkbgd_790580c1-afa7-4c35-853d-4fd9f45561cd/csi-driver/0.log" Jun 03 16:12:38.997810 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:38.997783 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-qkbgd_790580c1-afa7-4c35-853d-4fd9f45561cd/csi-node-driver-registrar/0.log" Jun 03 16:12:39.021008 ip-10-0-138-89 kubenswrapper[2575]: I0603 16:12:39.020978 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-qkbgd_790580c1-afa7-4c35-853d-4fd9f45561cd/csi-liveness-probe/0.log"