Jun 02 13:35:23.567783 ip-10-0-130-124 systemd[1]: Starting Kubernetes Kubelet... Jun 02 13:35:24.026340 ip-10-0-130-124 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 13:35:24.026340 ip-10-0-130-124 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 13:35:24.026340 ip-10-0-130-124 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 13:35:24.026340 ip-10-0-130-124 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 13:35:24.026340 ip-10-0-130-124 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 13:35:24.027335 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.027242 2578 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 13:35:24.030632 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030617 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 13:35:24.030632 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030631 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030635 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030640 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030644 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030647 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030649 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030652 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030655 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030658 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030660 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030663 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030666 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030668 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030670 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030673 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030676 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030678 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030681 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030689 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030691 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 13:35:24.030694 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030694 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030697 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030700 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030703 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030705 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030708 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030711 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030713 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030716 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030719 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030721 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030724 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030726 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030732 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030735 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030737 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030740 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030742 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030745 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030748 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 13:35:24.031164 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030751 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030754 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030756 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030758 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030760 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030763 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030766 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030768 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030770 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030773 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030775 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030777 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030780 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030782 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030785 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030788 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030791 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030794 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030796 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 13:35:24.031669 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030799 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030801 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030804 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030806 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030809 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030811 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030815 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030817 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030820 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030822 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030825 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030827 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030833 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030835 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030838 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030840 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030842 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030845 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030847 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030850 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 13:35:24.032121 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030853 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030857 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030860 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030863 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030865 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.030868 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031252 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031258 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031261 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031265 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031268 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031271 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031273 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031276 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031278 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031281 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031283 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031286 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031288 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 13:35:24.032635 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031292 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031295 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031298 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031300 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031303 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031306 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031308 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031311 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031314 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031316 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031318 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031321 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031323 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031326 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031328 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031331 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031333 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031336 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031338 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031341 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 13:35:24.033103 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031343 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031346 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031348 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031351 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031353 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031356 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031358 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031376 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031380 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031384 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031388 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031391 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031394 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031397 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031400 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031402 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031404 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031407 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031410 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031413 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 13:35:24.033657 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031415 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031418 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031421 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031423 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031426 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031428 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031435 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031437 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031440 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031442 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031445 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031447 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031453 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031456 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031459 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031462 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031465 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031468 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031470 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031473 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 13:35:24.034153 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031475 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031478 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031480 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031483 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031486 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031488 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031491 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031494 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031497 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031499 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031502 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031505 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.031507 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032171 2578 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032180 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032186 2578 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032191 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032199 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032204 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032208 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 13:35:24.034682 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032213 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032216 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032218 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032222 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032226 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032229 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032232 2578 flags.go:64] FLAG: --cgroup-root="" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032235 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032237 2578 flags.go:64] FLAG: --client-ca-file="" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032240 2578 flags.go:64] FLAG: --cloud-config="" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032243 2578 flags.go:64] FLAG: --cloud-provider="external" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032246 2578 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032250 2578 flags.go:64] FLAG: --cluster-domain="" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032253 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032256 2578 flags.go:64] FLAG: --config-dir="" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032259 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032262 2578 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032266 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032269 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032272 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032275 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032277 2578 flags.go:64] FLAG: --contention-profiling="false" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032280 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032283 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032287 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 13:35:24.035190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032290 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032294 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032297 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032299 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032302 2578 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032307 2578 flags.go:64] FLAG: --enable-server="true" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032310 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032314 2578 flags.go:64] FLAG: --event-burst="100" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032317 2578 flags.go:64] FLAG: --event-qps="50" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032320 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032324 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032326 2578 flags.go:64] FLAG: --eviction-hard="" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032330 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032333 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032336 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032339 2578 flags.go:64] FLAG: --eviction-soft="" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032342 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032345 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032347 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032350 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032353 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032356 2578 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032358 2578 flags.go:64] FLAG: --feature-gates="" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032375 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032378 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 13:35:24.035817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032381 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032384 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032387 2578 flags.go:64] FLAG: --healthz-port="10248" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032390 2578 flags.go:64] FLAG: --help="false" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032393 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032396 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032399 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032403 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032406 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032410 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032412 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032415 2578 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032419 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032422 2578 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032425 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032428 2578 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032431 2578 flags.go:64] FLAG: --kube-reserved="" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032434 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032437 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032440 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032442 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032445 2578 flags.go:64] FLAG: --lock-file="" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032448 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032450 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 13:35:24.036453 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032454 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032459 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032461 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032464 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032467 2578 flags.go:64] FLAG: --logging-format="text" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032470 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032473 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032476 2578 flags.go:64] FLAG: --manifest-url="" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032478 2578 flags.go:64] FLAG: --manifest-url-header="" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032482 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032485 2578 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032490 2578 flags.go:64] FLAG: --max-pods="110" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032492 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032495 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032498 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032501 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032504 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032508 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032511 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032518 2578 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032522 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032525 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032528 2578 flags.go:64] FLAG: --pod-cidr="" Jun 02 13:35:24.037032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032531 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032536 2578 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032539 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032542 2578 flags.go:64] FLAG: --pods-per-core="0" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032545 2578 flags.go:64] FLAG: --port="10250" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032548 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032551 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0261aeff41f082ad9" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032554 2578 flags.go:64] FLAG: --qos-reserved="" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032557 2578 flags.go:64] FLAG: --read-only-port="10255" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032560 2578 flags.go:64] FLAG: --register-node="true" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032563 2578 flags.go:64] FLAG: --register-schedulable="true" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032565 2578 flags.go:64] FLAG: --register-with-taints="" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032569 2578 flags.go:64] FLAG: --registry-burst="10" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032571 2578 flags.go:64] FLAG: --registry-qps="5" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032574 2578 flags.go:64] FLAG: --reserved-cpus="" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032577 2578 flags.go:64] FLAG: --reserved-memory="" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032581 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032584 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032587 2578 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032589 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032592 2578 flags.go:64] FLAG: --runonce="false" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032595 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032597 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032600 2578 flags.go:64] FLAG: --seccomp-default="false" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032603 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032607 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 13:35:24.037600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032618 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032622 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032624 2578 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032627 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032631 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032635 2578 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032637 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032640 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032643 2578 flags.go:64] FLAG: --system-cgroups="" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032646 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032651 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032654 2578 flags.go:64] FLAG: --tls-cert-file="" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032657 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032663 2578 flags.go:64] FLAG: --tls-min-version="" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032666 2578 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032669 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032672 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032674 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032677 2578 flags.go:64] FLAG: --v="2" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032681 2578 flags.go:64] FLAG: --version="false" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032685 2578 flags.go:64] FLAG: --vmodule="" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032690 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.032693 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032800 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 13:35:24.038228 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032804 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032806 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032809 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032812 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032815 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032817 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032820 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032824 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032827 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032830 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032833 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032835 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032839 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032841 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032844 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032846 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032849 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032851 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032854 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032856 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032858 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 13:35:24.038854 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032861 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032863 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032866 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032868 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032871 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032873 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032875 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032878 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032880 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032883 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032885 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032887 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032890 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032892 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032895 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032897 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032899 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032902 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032908 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032911 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 13:35:24.039454 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032913 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032920 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032923 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032926 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032929 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032932 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032934 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032937 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032939 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032942 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032944 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032947 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032949 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032951 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032954 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032956 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032959 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032961 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032964 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 13:35:24.040027 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032966 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032969 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032971 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032974 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032977 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032979 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032982 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032984 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032987 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032989 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032992 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032996 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.032999 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.033001 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.033004 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.033009 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.033014 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.033016 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.033019 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 13:35:24.040768 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.033022 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 13:35:24.041234 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.033025 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 13:35:24.041234 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.033027 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 13:35:24.041234 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.033030 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 13:35:24.041234 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.033034 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 13:35:24.041234 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.033038 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 13:35:24.041234 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.033601 2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 13:35:24.041234 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.040421 2578 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 13:35:24.041234 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.040442 2578 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 13:35:24.041234 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040709 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 13:35:24.041234 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040850 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 13:35:24.041234 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040854 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 02 13:35:24.041234 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040857 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 13:35:24.041234 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040861 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 13:35:24.041234 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040864 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 13:35:24.041234 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040867 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 13:35:24.041234 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040870 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040873 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040875 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040878 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040881 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040884 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040887 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040889 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040892 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040895 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040897 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040900 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040902 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040905 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040908 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040910 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040913 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040916 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040918 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040921 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 13:35:24.041676 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040923 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040927 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040931 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040934 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040937 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040940 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040944 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040947 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040949 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040952 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040955 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040957 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040960 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040962 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040965 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040968 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040970 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040973 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040976 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 13:35:24.042167 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040978 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040981 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040983 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040985 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040988 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040991 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040993 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040995 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.040998 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041000 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041002 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041006 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041008 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041011 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041013 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041016 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041018 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041022 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041026 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041029 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 13:35:24.042652 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041033 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041035 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041038 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041041 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041043 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041046 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041048 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041051 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041053 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041056 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041059 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041061 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041064 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041066 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041068 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041071 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041074 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041076 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041079 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 13:35:24.043128 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041082 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 13:35:24.043614 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.041087 2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 13:35:24.043614 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041200 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 13:35:24.043614 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041204 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 13:35:24.043614 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041207 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 13:35:24.043614 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041210 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 13:35:24.043614 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041212 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 13:35:24.043614 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041215 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 13:35:24.043614 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041218 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 13:35:24.043614 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041221 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 13:35:24.043614 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041223 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 13:35:24.043614 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041225 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 13:35:24.043614 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041228 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 13:35:24.043614 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041231 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 13:35:24.043614 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041233 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 13:35:24.043614 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041236 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 13:35:24.043614 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041239 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041241 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041244 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041246 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041249 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041251 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041254 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041257 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041259 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041261 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041264 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041267 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041270 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041272 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041275 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041277 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041280 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041282 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041285 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 13:35:24.044011 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041287 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041290 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041292 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041295 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041297 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041299 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041302 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041304 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041307 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041309 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041312 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041314 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041317 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041319 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041322 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041324 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041326 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041328 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041331 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041333 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 13:35:24.044486 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041335 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041338 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041341 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041344 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041346 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041349 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041351 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041353 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041356 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041358 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041360 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041377 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041380 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041382 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041385 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041387 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041390 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041392 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041394 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041397 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 13:35:24.044997 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041399 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 13:35:24.045498 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041402 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 13:35:24.045498 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041405 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 13:35:24.045498 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041407 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 13:35:24.045498 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041410 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 13:35:24.045498 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041414 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 13:35:24.045498 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041417 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 13:35:24.045498 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041420 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 13:35:24.045498 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041423 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 13:35:24.045498 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041425 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 13:35:24.045498 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041428 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 13:35:24.045498 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041430 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 13:35:24.045498 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:24.041433 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 13:35:24.045498 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.041437 2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 13:35:24.045498 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.041540 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 13:35:24.046156 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.046142 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 13:35:24.047050 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.047039 2578 server.go:1019] "Starting client certificate rotation" Jun 02 13:35:24.047153 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.047138 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 13:35:24.047190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.047175 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 13:35:24.069472 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.069454 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 13:35:24.072962 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.072936 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 13:35:24.091409 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.091390 2578 log.go:25] "Validated CRI v1 runtime API" Jun 02 13:35:24.097117 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.097102 2578 log.go:25] "Validated CRI v1 image API" Jun 02 13:35:24.099432 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.099418 2578 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 13:35:24.102839 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.102816 2578 fs.go:135] Filesystem UUIDs: map[71c45dbf-82f3-4268-a265-0ac7dccd405e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e1ec85be-f3ad-4670-a50b-61ce3f3cfa5b:/dev/nvme0n1p4] Jun 02 13:35:24.102904 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.102840 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 13:35:24.106874 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.106831 2578 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 13:35:24.108791 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.108658 2578 manager.go:217] Machine: {Timestamp:2026-06-02 13:35:24.107806187 +0000 UTC m=+0.415170765 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3126655 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24597935d7333a748c0ca7f66bf752 SystemUUID:ec245979-35d7-333a-748c-0ca7f66bf752 BootID:d6f2e4cb-d54e-4979-85ae-16d66b599662 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a8:a6:f8:31:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a8:a6:f8:31:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:ef:b6:e9:09:f0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 13:35:24.109772 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.109760 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 13:35:24.109867 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.109855 2578 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 13:35:24.113450 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.113426 2578 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 13:35:24.113596 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.113454 2578 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-124.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 13:35:24.113639 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.113606 2578 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 13:35:24.113639 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.113614 2578 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 13:35:24.113639 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.113621 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 13:35:24.114046 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.114036 2578 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 13:35:24.114838 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.114828 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 02 13:35:24.114950 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.114941 2578 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 13:35:24.117216 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.117207 2578 kubelet.go:491] "Attempting to sync node with API server" Jun 02 13:35:24.117255 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.117221 2578 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 13:35:24.117255 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.117232 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 13:35:24.117255 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.117241 2578 kubelet.go:397] "Adding apiserver pod source" Jun 02 13:35:24.117255 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.117249 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 13:35:24.118336 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.118324 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 13:35:24.118391 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.118343 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 13:35:24.121600 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.121584 2578 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 13:35:24.123622 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.123609 2578 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 13:35:24.125680 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.125666 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 13:35:24.125680 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.125683 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 13:35:24.125809 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.125689 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 13:35:24.125809 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.125695 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 13:35:24.125809 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.125704 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 13:35:24.125809 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.125709 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 13:35:24.125809 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.125715 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 13:35:24.125809 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.125720 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 13:35:24.125809 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.125727 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 13:35:24.125809 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.125733 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 13:35:24.125809 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.125740 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 13:35:24.125809 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.125746 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 13:35:24.126873 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.126863 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 13:35:24.126873 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.126873 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 13:35:24.129594 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.129568 2578 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 13:35:24.129683 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.129599 2578 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 13:35:24.130090 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.130070 2578 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-124.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 13:35:24.130292 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.130281 2578 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 13:35:24.130329 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.130321 2578 server.go:1295] "Started kubelet" Jun 02 13:35:24.130455 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.130401 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 13:35:24.130549 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.130477 2578 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 13:35:24.130586 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.130552 2578 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 13:35:24.131187 ip-10-0-130-124 systemd[1]: Started Kubernetes Kubelet. Jun 02 13:35:24.131806 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.131712 2578 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 13:35:24.132424 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.132410 2578 server.go:317] "Adding debug handlers to kubelet server" Jun 02 13:35:24.137772 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.137758 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 13:35:24.137834 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.137771 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 13:35:24.137834 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.137814 2578 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 13:35:24.137834 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.137828 2578 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 13:35:24.137930 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.137866 2578 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 13:35:24.137990 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.137972 2578 reconstruct.go:97] "Volume reconstruction finished" Jun 02 13:35:24.137990 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.137988 2578 reconciler.go:26] "Reconciler: start to sync state" Jun 02 13:35:24.138595 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.138564 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-124.ec2.internal\" not found" Jun 02 13:35:24.140267 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.140025 2578 factory.go:55] Registering systemd factory Jun 02 13:35:24.140267 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.140042 2578 factory.go:223] Registration of the systemd container factory successfully Jun 02 13:35:24.140267 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.140258 2578 factory.go:153] Registering CRI-O factory Jun 02 13:35:24.140267 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.140267 2578 factory.go:223] Registration of the crio container factory successfully Jun 02 13:35:24.140514 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.140315 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 13:35:24.140514 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.140331 2578 factory.go:103] Registering Raw factory Jun 02 13:35:24.140514 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.140344 2578 manager.go:1196] Started watching for new ooms in manager Jun 02 13:35:24.141359 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.141343 2578 manager.go:319] Starting recovery of all containers Jun 02 13:35:24.141459 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.141399 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 13:35:24.148941 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.148906 2578 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 13:35:24.152607 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.149037 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-124.ec2.internal.18b547073e4a3729 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-124.ec2.internal,UID:ip-10-0-130-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-124.ec2.internal,},FirstTimestamp:2026-06-02 13:35:24.130293545 +0000 UTC m=+0.437658121,LastTimestamp:2026-06-02 13:35:24.130293545 +0000 UTC m=+0.437658121,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-124.ec2.internal,}" Jun 02 13:35:24.156618 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.156602 2578 manager.go:324] Recovery completed Jun 02 13:35:24.160532 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.160515 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 13:35:24.162570 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.162547 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasSufficientMemory" Jun 02 13:35:24.162638 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.162583 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 13:35:24.162638 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.162594 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasSufficientPID" Jun 02 13:35:24.163056 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.163042 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 13:35:24.163118 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.163057 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 13:35:24.163118 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.163104 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 02 13:35:24.164416 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.164334 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-124.ec2.internal.18b547074036b8e1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-124.ec2.internal,UID:ip-10-0-130-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-124.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-124.ec2.internal,},FirstTimestamp:2026-06-02 13:35:24.162570465 +0000 UTC m=+0.469935040,LastTimestamp:2026-06-02 13:35:24.162570465 +0000 UTC m=+0.469935040,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-124.ec2.internal,}" Jun 02 13:35:24.165511 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.165497 2578 policy_none.go:49] "None policy: Start" Jun 02 13:35:24.165578 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.165517 2578 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 13:35:24.165578 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.165531 2578 state_mem.go:35] "Initializing new in-memory state store" Jun 02 13:35:24.173797 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.173739 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-124.ec2.internal.18b5470740370095 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-124.ec2.internal,UID:ip-10-0-130-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-124.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-124.ec2.internal,},FirstTimestamp:2026-06-02 13:35:24.162588821 +0000 UTC m=+0.469953400,LastTimestamp:2026-06-02 13:35:24.162588821 +0000 UTC m=+0.469953400,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-124.ec2.internal,}" Jun 02 13:35:24.181440 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.181330 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-124.ec2.internal.18b54707403726c2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-124.ec2.internal,UID:ip-10-0-130-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-124.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-124.ec2.internal,},FirstTimestamp:2026-06-02 13:35:24.162598594 +0000 UTC m=+0.469963169,LastTimestamp:2026-06-02 13:35:24.162598594 +0000 UTC m=+0.469963169,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-124.ec2.internal,}" Jun 02 13:35:24.192763 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.192743 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kpl76" Jun 02 13:35:24.197944 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.197925 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kpl76" Jun 02 13:35:24.215199 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.200170 2578 manager.go:341] "Starting Device Plugin manager" Jun 02 13:35:24.215199 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.200196 2578 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 13:35:24.215199 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.200207 2578 server.go:85] "Starting device plugin registration server" Jun 02 13:35:24.215199 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.200460 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 13:35:24.215199 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.200471 2578 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 13:35:24.215199 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.200574 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 13:35:24.215199 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.200652 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 13:35:24.215199 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.200660 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 13:35:24.215199 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.201215 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 13:35:24.215199 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.201251 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-124.ec2.internal\" not found" Jun 02 13:35:24.242609 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.242573 2578 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 13:35:24.243920 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.243906 2578 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 13:35:24.244006 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.243934 2578 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 13:35:24.244006 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.243958 2578 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 13:35:24.244006 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.243967 2578 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 13:35:24.244135 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.244065 2578 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 13:35:24.245572 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.245548 2578 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 13:35:24.301157 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.301135 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 13:35:24.302057 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.302042 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasSufficientMemory" Jun 02 13:35:24.302128 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.302070 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 13:35:24.302128 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.302079 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasSufficientPID" Jun 02 13:35:24.302128 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.302101 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.311326 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.311309 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.311384 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.311332 2578 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-124.ec2.internal\": node \"ip-10-0-130-124.ec2.internal\" not found" Jun 02 13:35:24.330594 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.330571 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-124.ec2.internal\" not found" Jun 02 13:35:24.344492 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.344472 2578 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-124.ec2.internal"] Jun 02 13:35:24.344567 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.344530 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 13:35:24.345338 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.345315 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasSufficientMemory" Jun 02 13:35:24.345338 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.345339 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 13:35:24.345488 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.345350 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasSufficientPID" Jun 02 13:35:24.346631 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.346618 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 13:35:24.346790 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.346777 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.346844 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.346817 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 13:35:24.347319 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.347301 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasSufficientMemory" Jun 02 13:35:24.347319 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.347314 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasSufficientMemory" Jun 02 13:35:24.347482 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.347332 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 13:35:24.347482 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.347334 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 13:35:24.347482 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.347342 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasSufficientPID" Jun 02 13:35:24.347482 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.347346 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasSufficientPID" Jun 02 13:35:24.348461 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.348446 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.348538 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.348477 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 13:35:24.349161 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.349142 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasSufficientMemory" Jun 02 13:35:24.349232 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.349174 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 13:35:24.349232 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.349189 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeHasSufficientPID" Jun 02 13:35:24.363976 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.363955 2578 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-124.ec2.internal\" not found" node="ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.367151 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.367128 2578 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-124.ec2.internal\" not found" node="ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.431194 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.431156 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-124.ec2.internal\" not found" Jun 02 13:35:24.439466 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.439445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8f19974dc12d938533399d61084bdb2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal\" (UID: \"a8f19974dc12d938533399d61084bdb2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.439550 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.439472 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8f19974dc12d938533399d61084bdb2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal\" (UID: \"a8f19974dc12d938533399d61084bdb2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.439550 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.439491 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51cf72cd0e936b57f6d1dce1f14e8f86-config\") pod \"kube-apiserver-proxy-ip-10-0-130-124.ec2.internal\" (UID: \"51cf72cd0e936b57f6d1dce1f14e8f86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.531825 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.531791 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-124.ec2.internal\" not found" Jun 02 13:35:24.540101 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.540079 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8f19974dc12d938533399d61084bdb2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal\" (UID: \"a8f19974dc12d938533399d61084bdb2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.540186 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.540106 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8f19974dc12d938533399d61084bdb2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal\" (UID: \"a8f19974dc12d938533399d61084bdb2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.540186 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.540123 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51cf72cd0e936b57f6d1dce1f14e8f86-config\") pod \"kube-apiserver-proxy-ip-10-0-130-124.ec2.internal\" (UID: \"51cf72cd0e936b57f6d1dce1f14e8f86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.540186 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.540156 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51cf72cd0e936b57f6d1dce1f14e8f86-config\") pod \"kube-apiserver-proxy-ip-10-0-130-124.ec2.internal\" (UID: \"51cf72cd0e936b57f6d1dce1f14e8f86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.540302 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.540182 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a8f19974dc12d938533399d61084bdb2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal\" (UID: \"a8f19974dc12d938533399d61084bdb2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.540302 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.540185 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8f19974dc12d938533399d61084bdb2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal\" (UID: \"a8f19974dc12d938533399d61084bdb2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.632564 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.632495 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-124.ec2.internal\" not found" Jun 02 13:35:24.666946 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.666921 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.670535 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:24.670517 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-124.ec2.internal" Jun 02 13:35:24.733407 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.733222 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-124.ec2.internal\" not found" Jun 02 13:35:24.833811 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.833786 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-124.ec2.internal\" not found" Jun 02 13:35:24.934403 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:24.934308 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-124.ec2.internal\" not found" Jun 02 13:35:25.034856 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:25.034831 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-124.ec2.internal\" not found" Jun 02 13:35:25.048433 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.048407 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 13:35:25.048590 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.048567 2578 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 13:35:25.134997 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:25.134960 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-124.ec2.internal\" not found" Jun 02 13:35:25.137902 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.137879 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 13:35:25.141867 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.141850 2578 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 13:35:25.148833 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.148809 2578 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 13:35:25.150699 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:25.150677 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51cf72cd0e936b57f6d1dce1f14e8f86.slice/crio-df4ddcfce7c6f0a9d8bec8f2745208c6af5cae6f5d0112fc4945c65234a3cfea WatchSource:0}: Error finding container df4ddcfce7c6f0a9d8bec8f2745208c6af5cae6f5d0112fc4945c65234a3cfea: Status 404 returned error can't find the container with id df4ddcfce7c6f0a9d8bec8f2745208c6af5cae6f5d0112fc4945c65234a3cfea Jun 02 13:35:25.150878 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:25.150859 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f19974dc12d938533399d61084bdb2.slice/crio-e74ef0764edf4026c8dbe43d745108ce2991600d8e0292ea8a79ac0bad37b6ea WatchSource:0}: Error finding container e74ef0764edf4026c8dbe43d745108ce2991600d8e0292ea8a79ac0bad37b6ea: Status 404 returned error can't find the container with id e74ef0764edf4026c8dbe43d745108ce2991600d8e0292ea8a79ac0bad37b6ea Jun 02 13:35:25.154759 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.154744 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 13:35:25.200294 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.200161 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 13:30:24 +0000 UTC" deadline="2028-01-15 16:54:34.297844145 +0000 UTC" Jun 02 13:35:25.200294 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.200203 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14211h19m9.097644245s" Jun 02 13:35:25.221444 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.221419 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p7wqt" Jun 02 13:35:25.228543 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.228523 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p7wqt" Jun 02 13:35:25.235798 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:25.235782 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-124.ec2.internal\" not found" Jun 02 13:35:25.248789 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.248739 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal" event={"ID":"a8f19974dc12d938533399d61084bdb2","Type":"ContainerStarted","Data":"e74ef0764edf4026c8dbe43d745108ce2991600d8e0292ea8a79ac0bad37b6ea"} Jun 02 13:35:25.249724 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.249700 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-124.ec2.internal" event={"ID":"51cf72cd0e936b57f6d1dce1f14e8f86","Type":"ContainerStarted","Data":"df4ddcfce7c6f0a9d8bec8f2745208c6af5cae6f5d0112fc4945c65234a3cfea"} Jun 02 13:35:25.335944 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:25.335911 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-124.ec2.internal\" not found" Jun 02 13:35:25.341643 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.341620 2578 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 13:35:25.438664 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.438634 2578 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal" Jun 02 13:35:25.449454 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.449432 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 13:35:25.451585 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.451542 2578 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-124.ec2.internal" Jun 02 13:35:25.459110 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.459093 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 13:35:25.697314 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:25.697281 2578 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 13:35:26.118045 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.118015 2578 apiserver.go:52] "Watching apiserver" Jun 02 13:35:26.126470 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.126440 2578 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 13:35:26.126884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.126855 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-lvq7r","openshift-network-diagnostics/network-check-target-rck6h","openshift-network-operator/iptables-alerter-sxmj2","openshift-ovn-kubernetes/ovnkube-node-ck8pc","kube-system/konnectivity-agent-qpfnp","kube-system/kube-apiserver-proxy-ip-10-0-130-124.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk","openshift-cluster-node-tuning-operator/tuned-7rw8k","openshift-image-registry/node-ca-nkl7l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal","openshift-multus/multus-additional-cni-plugins-99k8j","openshift-multus/multus-fn2z4","openshift-dns/node-resolver-nlnt5"] Jun 02 13:35:26.130186 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.130165 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.132400 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.132250 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:26.132400 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.132350 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 13:35:26.132584 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:26.132405 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rck6h" podUID="9c643b49-721f-4cf7-8bb3-d7348acc04f3" Jun 02 13:35:26.132584 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.132525 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 13:35:26.132722 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.132707 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 13:35:26.132805 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.132777 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rts6x\"" Jun 02 13:35:26.134432 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.134404 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sxmj2" Jun 02 13:35:26.136642 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.136623 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 13:35:26.136965 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.136948 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-76j99\"" Jun 02 13:35:26.137191 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.137173 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 13:35:26.137283 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.137210 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 13:35:26.138920 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.138901 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.139445 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.139003 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qpfnp" Jun 02 13:35:26.141149 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.141132 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:26.141268 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:26.141212 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:26.141268 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.141259 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 13:35:26.141499 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.141477 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 13:35:26.142762 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.142739 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 13:35:26.142854 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.142762 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 13:35:26.142950 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.142930 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 13:35:26.143347 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.143327 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 13:35:26.143425 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.143345 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-svr9h\"" Jun 02 13:35:26.143797 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.143781 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 13:35:26.143952 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.143934 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 13:35:26.144011 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.143996 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pxt7x\"" Jun 02 13:35:26.146470 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.146449 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.146569 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.146534 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nkl7l" Jun 02 13:35:26.148526 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee5c0940-9302-4e41-b978-7e2d26e5f929-host-slash\") pod \"iptables-alerter-sxmj2\" (UID: \"ee5c0940-9302-4e41-b978-7e2d26e5f929\") " pod="openshift-network-operator/iptables-alerter-sxmj2" Jun 02 13:35:26.148628 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdvx2\" (UniqueName: \"kubernetes.io/projected/ee5c0940-9302-4e41-b978-7e2d26e5f929-kube-api-access-sdvx2\") pod \"iptables-alerter-sxmj2\" (UID: \"ee5c0940-9302-4e41-b978-7e2d26e5f929\") " pod="openshift-network-operator/iptables-alerter-sxmj2" Jun 02 13:35:26.148628 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148565 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-socket-dir\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.148628 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148592 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-sys-fs\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.148628 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148618 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee5c0940-9302-4e41-b978-7e2d26e5f929-iptables-alerter-script\") pod \"iptables-alerter-sxmj2\" (UID: \"ee5c0940-9302-4e41-b978-7e2d26e5f929\") " pod="openshift-network-operator/iptables-alerter-sxmj2" Jun 02 13:35:26.148628 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148624 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 13:35:26.148874 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-systemd-units\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.148874 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148674 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-kubelet\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.148874 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148719 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-run-ovn\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.148874 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-cni-netd\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.148874 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148776 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-env-overrides\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.148874 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148799 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c0e798ef-026f-4d2d-bbbf-8e52bda3bf94-konnectivity-ca\") pod \"konnectivity-agent-qpfnp\" (UID: \"c0e798ef-026f-4d2d-bbbf-8e52bda3bf94\") " pod="kube-system/konnectivity-agent-qpfnp" Jun 02 13:35:26.148874 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148823 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.148874 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148838 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 13:35:26.148874 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148841 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 13:35:26.148874 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-registration-dir\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148894 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-device-dir\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148909 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2zs4h\"" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148922 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-log-socket\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148944 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-cni-bin\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148960 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.148996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-ovnkube-script-lib\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.149020 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-etc-openvswitch\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.149043 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-node-log\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.149048 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hp2mf\"" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.149066 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.149091 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-ovnkube-config\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.149114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsxkj\" (UniqueName: \"kubernetes.io/projected/cc5bda26-742f-4ea7-a266-9c97e87606b9-kube-api-access-hsxkj\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.149130 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.149137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-run-netns\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.149161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-run-ovn-kubernetes\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.149186 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-ovn-node-metrics-cert\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.149344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.149209 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2vwt\" (UniqueName: \"kubernetes.io/projected/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-kube-api-access-k2vwt\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.150004 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.149232 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8d4k\" (UniqueName: \"kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k\") pod \"network-check-target-rck6h\" (UID: \"9c643b49-721f-4cf7-8bb3-d7348acc04f3\") " pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:26.150004 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.149255 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-slash\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.150004 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.149277 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-run-systemd\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.150004 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.149301 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-var-lib-openvswitch\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.150004 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.149323 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-run-openvswitch\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.150004 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.149350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c0e798ef-026f-4d2d-bbbf-8e52bda3bf94-agent-certs\") pod \"konnectivity-agent-qpfnp\" (UID: \"c0e798ef-026f-4d2d-bbbf-8e52bda3bf94\") " pod="kube-system/konnectivity-agent-qpfnp" Jun 02 13:35:26.150824 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.150420 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.152501 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.152480 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ncds7\"" Jun 02 13:35:26.152608 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.152503 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 13:35:26.152822 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.152733 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 13:35:26.152822 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.152755 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 13:35:26.152822 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.152745 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 13:35:26.152955 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.152850 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 13:35:26.155165 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.155149 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.155260 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.155189 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nlnt5" Jun 02 13:35:26.158437 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.157288 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zfzsl\"" Jun 02 13:35:26.158437 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.157311 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 13:35:26.158437 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.157753 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 13:35:26.158437 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.157772 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9x2vr\"" Jun 02 13:35:26.158437 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.157774 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 13:35:26.229675 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.229639 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 13:30:25 +0000 UTC" deadline="2027-11-12 11:48:31.365202401 +0000 UTC" Jun 02 13:35:26.229675 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.229665 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12670h13m5.13553956s" Jun 02 13:35:26.238700 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.238668 2578 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 13:35:26.250334 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/037c8b1f-f090-4b5a-972c-f681ef9bcff6-tmp-dir\") pod \"node-resolver-nlnt5\" (UID: \"037c8b1f-f090-4b5a-972c-f681ef9bcff6\") " pod="openshift-dns/node-resolver-nlnt5" Jun 02 13:35:26.250498 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250348 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-sysconfig\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.250498 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250390 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-tuned\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.250498 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250413 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-multus-cni-dir\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.250498 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/037c8b1f-f090-4b5a-972c-f681ef9bcff6-hosts-file\") pod \"node-resolver-nlnt5\" (UID: \"037c8b1f-f090-4b5a-972c-f681ef9bcff6\") " pod="openshift-dns/node-resolver-nlnt5" Jun 02 13:35:26.250498 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs\") pod \"network-metrics-daemon-lvq7r\" (UID: \"ed3b2b23-30df-4e74-8662-a29c58704801\") " pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:26.250755 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250545 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-run\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.250755 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250577 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-system-cni-dir\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.250755 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250610 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.250755 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250637 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj7nc\" (UniqueName: \"kubernetes.io/projected/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-kube-api-access-wj7nc\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.250755 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250666 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-etc-openvswitch\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.250755 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250680 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.250755 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250693 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.250755 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250721 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-ovnkube-config\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.250755 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250728 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-etc-openvswitch\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.250755 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ac71bf8-ef94-4cee-b3aa-07599cf27742-host\") pod \"node-ca-nkl7l\" (UID: \"9ac71bf8-ef94-4cee-b3aa-07599cf27742\") " pod="openshift-image-registry/node-ca-nkl7l" Jun 02 13:35:26.251266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250760 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.251266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250768 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cc10233-1c0c-4b74-8965-e49b0d97d906-os-release\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.251266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250795 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cc10233-1c0c-4b74-8965-e49b0d97d906-cni-binary-copy\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.251266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-var-lib-kubelet\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.251266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250844 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-var-lib-cni-multus\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.251266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250870 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsxkj\" (UniqueName: \"kubernetes.io/projected/cc5bda26-742f-4ea7-a266-9c97e87606b9-kube-api-access-hsxkj\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.251266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250909 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-run-netns\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.251266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250941 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-run-ovn-kubernetes\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.251266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250968 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2vwt\" (UniqueName: \"kubernetes.io/projected/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-kube-api-access-k2vwt\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.251266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.250996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-modprobe-d\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.251266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251008 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-run-netns\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.251266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251019 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-host\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.251266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251053 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-os-release\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.251266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251056 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-run-ovn-kubernetes\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.251266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251078 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-multus-conf-dir\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.251266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251099 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-sysctl-d\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.251956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251117 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8d4k\" (UniqueName: \"kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k\") pod \"network-check-target-rck6h\" (UID: \"9c643b49-721f-4cf7-8bb3-d7348acc04f3\") " pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:26.251956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251144 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-slash\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.251956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251171 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-run-systemd\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.251956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251187 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-slash\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.251956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251196 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-var-lib-openvswitch\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.251956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251234 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-run-openvswitch\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.251956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251242 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-run-systemd\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.251956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251235 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-var-lib-openvswitch\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.251956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251264 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c0e798ef-026f-4d2d-bbbf-8e52bda3bf94-agent-certs\") pod \"konnectivity-agent-qpfnp\" (UID: \"c0e798ef-026f-4d2d-bbbf-8e52bda3bf94\") " pod="kube-system/konnectivity-agent-qpfnp" Jun 02 13:35:26.251956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251267 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-run-openvswitch\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.251956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251291 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cc10233-1c0c-4b74-8965-e49b0d97d906-tuning-conf-dir\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.251956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251317 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhcqv\" (UniqueName: \"kubernetes.io/projected/037c8b1f-f090-4b5a-972c-f681ef9bcff6-kube-api-access-hhcqv\") pod \"node-resolver-nlnt5\" (UID: \"037c8b1f-f090-4b5a-972c-f681ef9bcff6\") " pod="openshift-dns/node-resolver-nlnt5" Jun 02 13:35:26.251956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251344 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-socket-dir\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.251956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251389 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-sys-fs\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.251956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251417 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cc10233-1c0c-4b74-8965-e49b0d97d906-cnibin\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.251956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-lib-modules\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.251956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251464 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-sys-fs\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.252653 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251470 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-var-lib-kubelet\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.252653 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-hostroot\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.252653 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251521 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-run-ovn\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.252653 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251548 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-cni-netd\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.252653 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251574 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-env-overrides\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.252653 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251604 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c0e798ef-026f-4d2d-bbbf-8e52bda3bf94-konnectivity-ca\") pod \"konnectivity-agent-qpfnp\" (UID: \"c0e798ef-026f-4d2d-bbbf-8e52bda3bf94\") " pod="kube-system/konnectivity-agent-qpfnp" Jun 02 13:35:26.252653 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251611 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-cni-netd\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.252653 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251631 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6cc10233-1c0c-4b74-8965-e49b0d97d906-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.252653 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251578 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-run-ovn\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.252653 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251654 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-socket-dir\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.252653 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251639 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 13:35:26.252653 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-systemd\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.252653 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251738 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.252653 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251834 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-registration-dir\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.252653 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251851 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.252653 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251896 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-device-dir\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.252653 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251925 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-env-overrides\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.253218 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251935 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-registration-dir\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.253218 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251937 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc5bda26-742f-4ea7-a266-9c97e87606b9-device-dir\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.253218 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251940 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-log-socket\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.253218 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251981 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-cni-bin\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.253218 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.251986 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-log-socket\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.253218 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252016 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-var-lib-cni-bin\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.253218 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252035 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-etc-kubernetes\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.253218 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252014 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-cni-bin\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.253218 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ac71bf8-ef94-4cee-b3aa-07599cf27742-serviceca\") pod \"node-ca-nkl7l\" (UID: \"9ac71bf8-ef94-4cee-b3aa-07599cf27742\") " pod="openshift-image-registry/node-ca-nkl7l" Jun 02 13:35:26.253218 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252087 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-run-multus-certs\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.253218 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252116 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-ovnkube-script-lib\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.253218 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252148 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-run-netns\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.253218 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252171 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-node-log\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.253218 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252181 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-ovnkube-config\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.253218 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cc10233-1c0c-4b74-8965-e49b0d97d906-system-cni-dir\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.253218 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252213 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c0e798ef-026f-4d2d-bbbf-8e52bda3bf94-konnectivity-ca\") pod \"konnectivity-agent-qpfnp\" (UID: \"c0e798ef-026f-4d2d-bbbf-8e52bda3bf94\") " pod="kube-system/konnectivity-agent-qpfnp" Jun 02 13:35:26.253218 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252232 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-sysctl-conf\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.253761 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-tmp\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.253761 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252270 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-node-log\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.253761 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252289 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-ovn-node-metrics-cert\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.253761 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252317 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl6rx\" (UniqueName: \"kubernetes.io/projected/6cc10233-1c0c-4b74-8965-e49b0d97d906-kube-api-access-zl6rx\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.253761 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252344 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-cnibin\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.253761 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/598c8188-4f93-4742-8ae8-7c96abe18894-cni-binary-copy\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.253761 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252405 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-multus-socket-dir-parent\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.253761 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252424 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/598c8188-4f93-4742-8ae8-7c96abe18894-multus-daemon-config\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.253761 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqfwv\" (UniqueName: \"kubernetes.io/projected/ed3b2b23-30df-4e74-8662-a29c58704801-kube-api-access-bqfwv\") pod \"network-metrics-daemon-lvq7r\" (UID: \"ed3b2b23-30df-4e74-8662-a29c58704801\") " pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:26.253761 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252475 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee5c0940-9302-4e41-b978-7e2d26e5f929-host-slash\") pod \"iptables-alerter-sxmj2\" (UID: \"ee5c0940-9302-4e41-b978-7e2d26e5f929\") " pod="openshift-network-operator/iptables-alerter-sxmj2" Jun 02 13:35:26.253761 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252503 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sdvx2\" (UniqueName: \"kubernetes.io/projected/ee5c0940-9302-4e41-b978-7e2d26e5f929-kube-api-access-sdvx2\") pod \"iptables-alerter-sxmj2\" (UID: \"ee5c0940-9302-4e41-b978-7e2d26e5f929\") " pod="openshift-network-operator/iptables-alerter-sxmj2" Jun 02 13:35:26.253761 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252528 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee5c0940-9302-4e41-b978-7e2d26e5f929-iptables-alerter-script\") pod \"iptables-alerter-sxmj2\" (UID: \"ee5c0940-9302-4e41-b978-7e2d26e5f929\") " pod="openshift-network-operator/iptables-alerter-sxmj2" Jun 02 13:35:26.253761 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252535 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-ovnkube-script-lib\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.253761 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252557 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee5c0940-9302-4e41-b978-7e2d26e5f929-host-slash\") pod \"iptables-alerter-sxmj2\" (UID: \"ee5c0940-9302-4e41-b978-7e2d26e5f929\") " pod="openshift-network-operator/iptables-alerter-sxmj2" Jun 02 13:35:26.253761 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252553 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-systemd-units\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.253761 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252585 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-sys\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.253761 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252598 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-systemd-units\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.254284 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252604 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdn4g\" (UniqueName: \"kubernetes.io/projected/598c8188-4f93-4742-8ae8-7c96abe18894-kube-api-access-tdn4g\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.254284 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252631 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-kubelet\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.254284 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252656 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th5tr\" (UniqueName: \"kubernetes.io/projected/9ac71bf8-ef94-4cee-b3aa-07599cf27742-kube-api-access-th5tr\") pod \"node-ca-nkl7l\" (UID: \"9ac71bf8-ef94-4cee-b3aa-07599cf27742\") " pod="openshift-image-registry/node-ca-nkl7l" Jun 02 13:35:26.254284 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252672 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-host-kubelet\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.254284 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252678 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-kubernetes\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.254284 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252713 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-run-k8s-cni-cncf-io\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.254284 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252735 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6cc10233-1c0c-4b74-8965-e49b0d97d906-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.254284 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.252936 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee5c0940-9302-4e41-b978-7e2d26e5f929-iptables-alerter-script\") pod \"iptables-alerter-sxmj2\" (UID: \"ee5c0940-9302-4e41-b978-7e2d26e5f929\") " pod="openshift-network-operator/iptables-alerter-sxmj2" Jun 02 13:35:26.255162 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.255143 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-ovn-node-metrics-cert\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.255280 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.255262 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c0e798ef-026f-4d2d-bbbf-8e52bda3bf94-agent-certs\") pod \"konnectivity-agent-qpfnp\" (UID: \"c0e798ef-026f-4d2d-bbbf-8e52bda3bf94\") " pod="kube-system/konnectivity-agent-qpfnp" Jun 02 13:35:26.259392 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:26.259343 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 13:35:26.259392 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:26.259380 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 13:35:26.259392 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:26.259390 2578 projected.go:194] Error preparing data for projected volume kube-api-access-h8d4k for pod openshift-network-diagnostics/network-check-target-rck6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 13:35:26.259589 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:26.259458 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k podName:9c643b49-721f-4cf7-8bb3-d7348acc04f3 nodeName:}" failed. No retries permitted until 2026-06-02 13:35:26.759421807 +0000 UTC m=+3.066786384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h8d4k" (UniqueName: "kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k") pod "network-check-target-rck6h" (UID: "9c643b49-721f-4cf7-8bb3-d7348acc04f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 13:35:26.261819 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.261798 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsxkj\" (UniqueName: \"kubernetes.io/projected/cc5bda26-742f-4ea7-a266-9c97e87606b9-kube-api-access-hsxkj\") pod \"aws-ebs-csi-driver-node-6xgwk\" (UID: \"cc5bda26-742f-4ea7-a266-9c97e87606b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.262248 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.262226 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdvx2\" (UniqueName: \"kubernetes.io/projected/ee5c0940-9302-4e41-b978-7e2d26e5f929-kube-api-access-sdvx2\") pod \"iptables-alerter-sxmj2\" (UID: \"ee5c0940-9302-4e41-b978-7e2d26e5f929\") " pod="openshift-network-operator/iptables-alerter-sxmj2" Jun 02 13:35:26.262307 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.262295 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2vwt\" (UniqueName: \"kubernetes.io/projected/3554d7b2-3288-4d6c-bc33-ddf4f5ddda33-kube-api-access-k2vwt\") pod \"ovnkube-node-ck8pc\" (UID: \"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33\") " pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.353019 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.352977 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-modprobe-d\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.353019 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353020 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-host\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.353250 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353044 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-os-release\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.353250 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353064 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-multus-conf-dir\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.353250 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353083 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-sysctl-d\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.353250 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353127 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cc10233-1c0c-4b74-8965-e49b0d97d906-tuning-conf-dir\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.353250 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353126 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-modprobe-d\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.353250 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353156 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhcqv\" (UniqueName: \"kubernetes.io/projected/037c8b1f-f090-4b5a-972c-f681ef9bcff6-kube-api-access-hhcqv\") pod \"node-resolver-nlnt5\" (UID: \"037c8b1f-f090-4b5a-972c-f681ef9bcff6\") " pod="openshift-dns/node-resolver-nlnt5" Jun 02 13:35:26.353250 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353163 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-multus-conf-dir\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.353250 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353125 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-host\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.353250 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353191 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-os-release\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.353250 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353196 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cc10233-1c0c-4b74-8965-e49b0d97d906-cnibin\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.353250 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353224 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cc10233-1c0c-4b74-8965-e49b0d97d906-cnibin\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.353250 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353227 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-lib-modules\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.353250 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353237 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-sysctl-d\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.353250 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353260 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-var-lib-kubelet\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353290 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-var-lib-kubelet\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353293 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-hostroot\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353306 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cc10233-1c0c-4b74-8965-e49b0d97d906-tuning-conf-dir\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353294 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-lib-modules\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353325 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-hostroot\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353357 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6cc10233-1c0c-4b74-8965-e49b0d97d906-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353414 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-systemd\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353447 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-var-lib-cni-bin\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353471 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-etc-kubernetes\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353475 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-systemd\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353498 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ac71bf8-ef94-4cee-b3aa-07599cf27742-serviceca\") pod \"node-ca-nkl7l\" (UID: \"9ac71bf8-ef94-4cee-b3aa-07599cf27742\") " pod="openshift-image-registry/node-ca-nkl7l" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353524 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-run-multus-certs\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353527 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-etc-kubernetes\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353551 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-run-netns\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353568 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-run-multus-certs\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353524 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-var-lib-cni-bin\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353575 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cc10233-1c0c-4b74-8965-e49b0d97d906-system-cni-dir\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.353968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353604 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-sysctl-conf\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353611 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cc10233-1c0c-4b74-8965-e49b0d97d906-system-cni-dir\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353617 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-run-netns\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353626 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-tmp\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353654 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zl6rx\" (UniqueName: \"kubernetes.io/projected/6cc10233-1c0c-4b74-8965-e49b0d97d906-kube-api-access-zl6rx\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353677 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-cnibin\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353698 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/598c8188-4f93-4742-8ae8-7c96abe18894-cni-binary-copy\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353720 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-multus-socket-dir-parent\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-sysctl-conf\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353768 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/598c8188-4f93-4742-8ae8-7c96abe18894-multus-daemon-config\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353788 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-cnibin\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353797 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqfwv\" (UniqueName: \"kubernetes.io/projected/ed3b2b23-30df-4e74-8662-a29c58704801-kube-api-access-bqfwv\") pod \"network-metrics-daemon-lvq7r\" (UID: \"ed3b2b23-30df-4e74-8662-a29c58704801\") " pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353827 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-sys\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353840 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-multus-socket-dir-parent\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353859 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tdn4g\" (UniqueName: \"kubernetes.io/projected/598c8188-4f93-4742-8ae8-7c96abe18894-kube-api-access-tdn4g\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353885 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-th5tr\" (UniqueName: \"kubernetes.io/projected/9ac71bf8-ef94-4cee-b3aa-07599cf27742-kube-api-access-th5tr\") pod \"node-ca-nkl7l\" (UID: \"9ac71bf8-ef94-4cee-b3aa-07599cf27742\") " pod="openshift-image-registry/node-ca-nkl7l" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353908 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-kubernetes\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353927 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ac71bf8-ef94-4cee-b3aa-07599cf27742-serviceca\") pod \"node-ca-nkl7l\" (UID: \"9ac71bf8-ef94-4cee-b3aa-07599cf27742\") " pod="openshift-image-registry/node-ca-nkl7l" Jun 02 13:35:26.354884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353930 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-run-k8s-cni-cncf-io\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.355534 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353947 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6cc10233-1c0c-4b74-8965-e49b0d97d906-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.355534 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353979 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6cc10233-1c0c-4b74-8965-e49b0d97d906-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.355534 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.353992 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-sys\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.355534 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354010 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/037c8b1f-f090-4b5a-972c-f681ef9bcff6-tmp-dir\") pod \"node-resolver-nlnt5\" (UID: \"037c8b1f-f090-4b5a-972c-f681ef9bcff6\") " pod="openshift-dns/node-resolver-nlnt5" Jun 02 13:35:26.355534 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354035 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-sysconfig\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.355534 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354051 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-kubernetes\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.355534 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354067 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-tuned\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.355534 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354093 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-multus-cni-dir\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.355534 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354118 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/037c8b1f-f090-4b5a-972c-f681ef9bcff6-hosts-file\") pod \"node-resolver-nlnt5\" (UID: \"037c8b1f-f090-4b5a-972c-f681ef9bcff6\") " pod="openshift-dns/node-resolver-nlnt5" Jun 02 13:35:26.355534 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354142 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs\") pod \"network-metrics-daemon-lvq7r\" (UID: \"ed3b2b23-30df-4e74-8662-a29c58704801\") " pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:26.355534 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354162 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-sysconfig\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.355534 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354216 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-run\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.355534 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354339 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/598c8188-4f93-4742-8ae8-7c96abe18894-cni-binary-copy\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.355534 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354314 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/037c8b1f-f090-4b5a-972c-f681ef9bcff6-hosts-file\") pod \"node-resolver-nlnt5\" (UID: \"037c8b1f-f090-4b5a-972c-f681ef9bcff6\") " pod="openshift-dns/node-resolver-nlnt5" Jun 02 13:35:26.355534 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:26.354479 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 13:35:26.355534 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354537 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/037c8b1f-f090-4b5a-972c-f681ef9bcff6-tmp-dir\") pod \"node-resolver-nlnt5\" (UID: \"037c8b1f-f090-4b5a-972c-f681ef9bcff6\") " pod="openshift-dns/node-resolver-nlnt5" Jun 02 13:35:26.355534 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354167 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-run\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.355993 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:26.354551 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs podName:ed3b2b23-30df-4e74-8662-a29c58704801 nodeName:}" failed. No retries permitted until 2026-06-02 13:35:26.85453275 +0000 UTC m=+3.161897341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs") pod "network-metrics-daemon-lvq7r" (UID: "ed3b2b23-30df-4e74-8662-a29c58704801") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 13:35:26.355993 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354585 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-system-cni-dir\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.355993 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354614 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wj7nc\" (UniqueName: \"kubernetes.io/projected/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-kube-api-access-wj7nc\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.355993 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354643 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-system-cni-dir\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.355993 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354647 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ac71bf8-ef94-4cee-b3aa-07599cf27742-host\") pod \"node-ca-nkl7l\" (UID: \"9ac71bf8-ef94-4cee-b3aa-07599cf27742\") " pod="openshift-image-registry/node-ca-nkl7l" Jun 02 13:35:26.355993 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354671 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6cc10233-1c0c-4b74-8965-e49b0d97d906-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.355993 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354686 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cc10233-1c0c-4b74-8965-e49b0d97d906-os-release\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.355993 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354735 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cc10233-1c0c-4b74-8965-e49b0d97d906-os-release\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.355993 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354542 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-multus-cni-dir\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.355993 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354753 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cc10233-1c0c-4b74-8965-e49b0d97d906-cni-binary-copy\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.355993 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354688 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ac71bf8-ef94-4cee-b3aa-07599cf27742-host\") pod \"node-ca-nkl7l\" (UID: \"9ac71bf8-ef94-4cee-b3aa-07599cf27742\") " pod="openshift-image-registry/node-ca-nkl7l" Jun 02 13:35:26.355993 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354815 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-var-lib-kubelet\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.355993 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354841 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-var-lib-cni-multus\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.355993 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354903 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-run-k8s-cni-cncf-io\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.355993 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354911 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/598c8188-4f93-4742-8ae8-7c96abe18894-host-var-lib-cni-multus\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.355993 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.354925 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-var-lib-kubelet\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.355993 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.355197 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cc10233-1c0c-4b74-8965-e49b0d97d906-cni-binary-copy\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.356884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.355401 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/598c8188-4f93-4742-8ae8-7c96abe18894-multus-daemon-config\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.356884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.356159 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-tmp\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.356884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.356279 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-etc-tuned\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.363823 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.363795 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th5tr\" (UniqueName: \"kubernetes.io/projected/9ac71bf8-ef94-4cee-b3aa-07599cf27742-kube-api-access-th5tr\") pod \"node-ca-nkl7l\" (UID: \"9ac71bf8-ef94-4cee-b3aa-07599cf27742\") " pod="openshift-image-registry/node-ca-nkl7l" Jun 02 13:35:26.363947 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.363798 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl6rx\" (UniqueName: \"kubernetes.io/projected/6cc10233-1c0c-4b74-8965-e49b0d97d906-kube-api-access-zl6rx\") pod \"multus-additional-cni-plugins-99k8j\" (UID: \"6cc10233-1c0c-4b74-8965-e49b0d97d906\") " pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.364174 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.364138 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhcqv\" (UniqueName: \"kubernetes.io/projected/037c8b1f-f090-4b5a-972c-f681ef9bcff6-kube-api-access-hhcqv\") pod \"node-resolver-nlnt5\" (UID: \"037c8b1f-f090-4b5a-972c-f681ef9bcff6\") " pod="openshift-dns/node-resolver-nlnt5" Jun 02 13:35:26.364266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.364224 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj7nc\" (UniqueName: \"kubernetes.io/projected/4413c4bb-65b3-4015-af69-84d1d7d6ec9c-kube-api-access-wj7nc\") pod \"tuned-7rw8k\" (UID: \"4413c4bb-65b3-4015-af69-84d1d7d6ec9c\") " pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.364577 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.364561 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdn4g\" (UniqueName: \"kubernetes.io/projected/598c8188-4f93-4742-8ae8-7c96abe18894-kube-api-access-tdn4g\") pod \"multus-fn2z4\" (UID: \"598c8188-4f93-4742-8ae8-7c96abe18894\") " pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.364630 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.364615 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqfwv\" (UniqueName: \"kubernetes.io/projected/ed3b2b23-30df-4e74-8662-a29c58704801-kube-api-access-bqfwv\") pod \"network-metrics-daemon-lvq7r\" (UID: \"ed3b2b23-30df-4e74-8662-a29c58704801\") " pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:26.441714 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.441640 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" Jun 02 13:35:26.452473 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.452356 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sxmj2" Jun 02 13:35:26.462096 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.462071 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:26.465735 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.465706 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qpfnp" Jun 02 13:35:26.467885 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.467867 2578 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 13:35:26.471769 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.471751 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" Jun 02 13:35:26.478753 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.478735 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nkl7l" Jun 02 13:35:26.485309 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.485289 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-99k8j" Jun 02 13:35:26.491117 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.491095 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fn2z4" Jun 02 13:35:26.497641 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.497622 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nlnt5" Jun 02 13:35:26.856657 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.856632 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs\") pod \"network-metrics-daemon-lvq7r\" (UID: \"ed3b2b23-30df-4e74-8662-a29c58704801\") " pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:26.856767 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:26.856674 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8d4k\" (UniqueName: \"kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k\") pod \"network-check-target-rck6h\" (UID: \"9c643b49-721f-4cf7-8bb3-d7348acc04f3\") " pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:26.856894 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:26.856787 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 13:35:26.856894 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:26.856793 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 13:35:26.856894 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:26.856809 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 13:35:26.856894 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:26.856818 2578 projected.go:194] Error preparing data for projected volume kube-api-access-h8d4k for pod openshift-network-diagnostics/network-check-target-rck6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 13:35:26.856894 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:26.856846 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs podName:ed3b2b23-30df-4e74-8662-a29c58704801 nodeName:}" failed. No retries permitted until 2026-06-02 13:35:27.856831321 +0000 UTC m=+4.164195884 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs") pod "network-metrics-daemon-lvq7r" (UID: "ed3b2b23-30df-4e74-8662-a29c58704801") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 13:35:26.856894 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:26.856863 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k podName:9c643b49-721f-4cf7-8bb3-d7348acc04f3 nodeName:}" failed. No retries permitted until 2026-06-02 13:35:27.856852776 +0000 UTC m=+4.164217338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8d4k" (UniqueName: "kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k") pod "network-check-target-rck6h" (UID: "9c643b49-721f-4cf7-8bb3-d7348acc04f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 13:35:26.878443 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:26.878406 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod037c8b1f_f090_4b5a_972c_f681ef9bcff6.slice/crio-37a2acfb9a0173415b07e0cf80035f7efc6b3187aa5db7ef363472358f5df934 WatchSource:0}: Error finding container 37a2acfb9a0173415b07e0cf80035f7efc6b3187aa5db7ef363472358f5df934: Status 404 returned error can't find the container with id 37a2acfb9a0173415b07e0cf80035f7efc6b3187aa5db7ef363472358f5df934 Jun 02 13:35:26.879671 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:26.879649 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5c0940_9302_4e41_b978_7e2d26e5f929.slice/crio-f5970c44a9a0fd77138b4f4923b9dc81f41366bff3efa56bb43f3a01de1fde57 WatchSource:0}: Error finding container f5970c44a9a0fd77138b4f4923b9dc81f41366bff3efa56bb43f3a01de1fde57: Status 404 returned error can't find the container with id f5970c44a9a0fd77138b4f4923b9dc81f41366bff3efa56bb43f3a01de1fde57 Jun 02 13:35:26.880313 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:26.880293 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e798ef_026f_4d2d_bbbf_8e52bda3bf94.slice/crio-df01b70f85076a2358e646b0babc5b7ac102d4ef0f2bdb3c344b1473c1a5a794 WatchSource:0}: Error finding container df01b70f85076a2358e646b0babc5b7ac102d4ef0f2bdb3c344b1473c1a5a794: Status 404 returned error can't find the container with id df01b70f85076a2358e646b0babc5b7ac102d4ef0f2bdb3c344b1473c1a5a794 Jun 02 13:35:26.883734 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:26.883714 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod598c8188_4f93_4742_8ae8_7c96abe18894.slice/crio-12a19e08e27eec4707ef109a84facce3f679f6cb7c4b24efa5d04e293a266970 WatchSource:0}: Error finding container 12a19e08e27eec4707ef109a84facce3f679f6cb7c4b24efa5d04e293a266970: Status 404 returned error can't find the container with id 12a19e08e27eec4707ef109a84facce3f679f6cb7c4b24efa5d04e293a266970 Jun 02 13:35:26.887622 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:26.887516 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac71bf8_ef94_4cee_b3aa_07599cf27742.slice/crio-ee6aeddd8826bc8100c669e8460a47c6c5f5b568cd80b8ec5f27794e97f01bea WatchSource:0}: Error finding container ee6aeddd8826bc8100c669e8460a47c6c5f5b568cd80b8ec5f27794e97f01bea: Status 404 returned error can't find the container with id ee6aeddd8826bc8100c669e8460a47c6c5f5b568cd80b8ec5f27794e97f01bea Jun 02 13:35:26.890579 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:26.890277 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc5bda26_742f_4ea7_a266_9c97e87606b9.slice/crio-3c342bacf223ffbdba8e37d1451788f8b5b29eebe7b207197eeea57427ac6c3b WatchSource:0}: Error finding container 3c342bacf223ffbdba8e37d1451788f8b5b29eebe7b207197eeea57427ac6c3b: Status 404 returned error can't find the container with id 3c342bacf223ffbdba8e37d1451788f8b5b29eebe7b207197eeea57427ac6c3b Jun 02 13:35:26.891346 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:35:26.891328 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4413c4bb_65b3_4015_af69_84d1d7d6ec9c.slice/crio-9f8c836c146823754dfe5ec653e559c9762dda90243adfb774dfb315975b64b1 WatchSource:0}: Error finding container 9f8c836c146823754dfe5ec653e559c9762dda90243adfb774dfb315975b64b1: Status 404 returned error can't find the container with id 9f8c836c146823754dfe5ec653e559c9762dda90243adfb774dfb315975b64b1 Jun 02 13:35:27.230321 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:27.230061 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 13:30:25 +0000 UTC" deadline="2028-03-01 12:21:16.102377528 +0000 UTC" Jun 02 13:35:27.230321 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:27.230297 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15310h45m48.872085185s" Jun 02 13:35:27.258038 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:27.257194 2578 generic.go:358] "Generic (PLEG): container finished" podID="a8f19974dc12d938533399d61084bdb2" containerID="df4e4913a7c427810968c534906451452df8d5ddbe29a511202a48d0d3103e87" exitCode=0 Jun 02 13:35:27.258038 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:27.257274 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal" event={"ID":"a8f19974dc12d938533399d61084bdb2","Type":"ContainerDied","Data":"df4e4913a7c427810968c534906451452df8d5ddbe29a511202a48d0d3103e87"} Jun 02 13:35:27.262296 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:27.261864 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-124.ec2.internal" event={"ID":"51cf72cd0e936b57f6d1dce1f14e8f86","Type":"ContainerStarted","Data":"2d65b2569eef6678dc70629377f0c64e1a10fb42fec3610c883b1ae4c5347610"} Jun 02 13:35:27.272080 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:27.272048 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" event={"ID":"4413c4bb-65b3-4015-af69-84d1d7d6ec9c","Type":"ContainerStarted","Data":"9f8c836c146823754dfe5ec653e559c9762dda90243adfb774dfb315975b64b1"} Jun 02 13:35:27.280031 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:27.280005 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" event={"ID":"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33","Type":"ContainerStarted","Data":"3cc0e11ec5f6f202e99fa52c2f042ccd7a74759f2143b049526626486578c43d"} Jun 02 13:35:27.281780 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:27.281721 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99k8j" event={"ID":"6cc10233-1c0c-4b74-8965-e49b0d97d906","Type":"ContainerStarted","Data":"aa5ce929e34861fb4fcc3bf5ca5fc73eea973f3ba571ba7581baa886225da007"} Jun 02 13:35:27.286928 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:27.286902 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nkl7l" event={"ID":"9ac71bf8-ef94-4cee-b3aa-07599cf27742","Type":"ContainerStarted","Data":"ee6aeddd8826bc8100c669e8460a47c6c5f5b568cd80b8ec5f27794e97f01bea"} Jun 02 13:35:27.291557 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:27.291498 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fn2z4" event={"ID":"598c8188-4f93-4742-8ae8-7c96abe18894","Type":"ContainerStarted","Data":"12a19e08e27eec4707ef109a84facce3f679f6cb7c4b24efa5d04e293a266970"} Jun 02 13:35:27.293992 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:27.293924 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qpfnp" event={"ID":"c0e798ef-026f-4d2d-bbbf-8e52bda3bf94","Type":"ContainerStarted","Data":"df01b70f85076a2358e646b0babc5b7ac102d4ef0f2bdb3c344b1473c1a5a794"} Jun 02 13:35:27.300779 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:27.300743 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" event={"ID":"cc5bda26-742f-4ea7-a266-9c97e87606b9","Type":"ContainerStarted","Data":"3c342bacf223ffbdba8e37d1451788f8b5b29eebe7b207197eeea57427ac6c3b"} Jun 02 13:35:27.309410 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:27.304147 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sxmj2" event={"ID":"ee5c0940-9302-4e41-b978-7e2d26e5f929","Type":"ContainerStarted","Data":"f5970c44a9a0fd77138b4f4923b9dc81f41366bff3efa56bb43f3a01de1fde57"} Jun 02 13:35:27.309410 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:27.309057 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nlnt5" event={"ID":"037c8b1f-f090-4b5a-972c-f681ef9bcff6","Type":"ContainerStarted","Data":"37a2acfb9a0173415b07e0cf80035f7efc6b3187aa5db7ef363472358f5df934"} Jun 02 13:35:27.864598 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:27.864558 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs\") pod \"network-metrics-daemon-lvq7r\" (UID: \"ed3b2b23-30df-4e74-8662-a29c58704801\") " pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:27.864779 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:27.864625 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8d4k\" (UniqueName: \"kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k\") pod \"network-check-target-rck6h\" (UID: \"9c643b49-721f-4cf7-8bb3-d7348acc04f3\") " pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:27.864855 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:27.864777 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 13:35:27.864855 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:27.864796 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 13:35:27.864855 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:27.864809 2578 projected.go:194] Error preparing data for projected volume kube-api-access-h8d4k for pod openshift-network-diagnostics/network-check-target-rck6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 13:35:27.864999 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:27.864866 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k podName:9c643b49-721f-4cf7-8bb3-d7348acc04f3 nodeName:}" failed. No retries permitted until 2026-06-02 13:35:29.864847917 +0000 UTC m=+6.172212497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8d4k" (UniqueName: "kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k") pod "network-check-target-rck6h" (UID: "9c643b49-721f-4cf7-8bb3-d7348acc04f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 13:35:27.865283 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:27.865259 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 13:35:27.865340 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:27.865320 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs podName:ed3b2b23-30df-4e74-8662-a29c58704801 nodeName:}" failed. No retries permitted until 2026-06-02 13:35:29.865304982 +0000 UTC m=+6.172669545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs") pod "network-metrics-daemon-lvq7r" (UID: "ed3b2b23-30df-4e74-8662-a29c58704801") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 13:35:28.245266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:28.244483 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:28.245266 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:28.244630 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:28.245266 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:28.245081 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:28.245266 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:28.245173 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rck6h" podUID="9c643b49-721f-4cf7-8bb3-d7348acc04f3" Jun 02 13:35:28.330216 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:28.330182 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal" event={"ID":"a8f19974dc12d938533399d61084bdb2","Type":"ContainerStarted","Data":"2817c591f7a48c5e29d5eb00456f6131e10e895682163baa3aabb665c7743d87"} Jun 02 13:35:28.342133 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:28.342063 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-124.ec2.internal" podStartSLOduration=3.3420442870000002 podStartE2EDuration="3.342044287s" podCreationTimestamp="2026-06-02 13:35:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 13:35:27.283718363 +0000 UTC m=+3.591082949" watchObservedRunningTime="2026-06-02 13:35:28.342044287 +0000 UTC m=+4.649408874" Jun 02 13:35:29.880357 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:29.880313 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs\") pod \"network-metrics-daemon-lvq7r\" (UID: \"ed3b2b23-30df-4e74-8662-a29c58704801\") " pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:29.880845 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:29.880403 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8d4k\" (UniqueName: \"kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k\") pod \"network-check-target-rck6h\" (UID: \"9c643b49-721f-4cf7-8bb3-d7348acc04f3\") " pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:29.880845 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:29.880561 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 13:35:29.880845 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:29.880610 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 13:35:29.880845 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:29.880624 2578 projected.go:194] Error preparing data for projected volume kube-api-access-h8d4k for pod openshift-network-diagnostics/network-check-target-rck6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 13:35:29.880845 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:29.880683 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k podName:9c643b49-721f-4cf7-8bb3-d7348acc04f3 nodeName:}" failed. No retries permitted until 2026-06-02 13:35:33.880664173 +0000 UTC m=+10.188028742 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8d4k" (UniqueName: "kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k") pod "network-check-target-rck6h" (UID: "9c643b49-721f-4cf7-8bb3-d7348acc04f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 13:35:29.881111 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:29.881095 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 13:35:29.881169 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:29.881148 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs podName:ed3b2b23-30df-4e74-8662-a29c58704801 nodeName:}" failed. No retries permitted until 2026-06-02 13:35:33.881132647 +0000 UTC m=+10.188497214 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs") pod "network-metrics-daemon-lvq7r" (UID: "ed3b2b23-30df-4e74-8662-a29c58704801") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 13:35:30.244250 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:30.244176 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:30.244483 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:30.244302 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rck6h" podUID="9c643b49-721f-4cf7-8bb3-d7348acc04f3" Jun 02 13:35:30.244707 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:30.244680 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:30.244826 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:30.244806 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:32.244680 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:32.244646 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:32.245127 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:32.244769 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rck6h" podUID="9c643b49-721f-4cf7-8bb3-d7348acc04f3" Jun 02 13:35:32.245285 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:32.245261 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:32.245426 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:32.245402 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:33.913836 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:33.913801 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs\") pod \"network-metrics-daemon-lvq7r\" (UID: \"ed3b2b23-30df-4e74-8662-a29c58704801\") " pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:33.913836 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:33.913848 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8d4k\" (UniqueName: \"kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k\") pod \"network-check-target-rck6h\" (UID: \"9c643b49-721f-4cf7-8bb3-d7348acc04f3\") " pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:33.914256 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:33.913974 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 13:35:33.914256 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:33.913986 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 13:35:33.914256 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:33.913995 2578 projected.go:194] Error preparing data for projected volume kube-api-access-h8d4k for pod openshift-network-diagnostics/network-check-target-rck6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 13:35:33.914256 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:33.914040 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k podName:9c643b49-721f-4cf7-8bb3-d7348acc04f3 nodeName:}" failed. No retries permitted until 2026-06-02 13:35:41.914026269 +0000 UTC m=+18.221390832 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8d4k" (UniqueName: "kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k") pod "network-check-target-rck6h" (UID: "9c643b49-721f-4cf7-8bb3-d7348acc04f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 13:35:33.914417 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:33.914340 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 13:35:33.914417 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:33.914389 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs podName:ed3b2b23-30df-4e74-8662-a29c58704801 nodeName:}" failed. No retries permitted until 2026-06-02 13:35:41.914360532 +0000 UTC m=+18.221725095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs") pod "network-metrics-daemon-lvq7r" (UID: "ed3b2b23-30df-4e74-8662-a29c58704801") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 13:35:34.247597 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:34.247519 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:34.247757 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:34.247519 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:34.247757 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:34.247658 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:34.247757 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:34.247698 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rck6h" podUID="9c643b49-721f-4cf7-8bb3-d7348acc04f3" Jun 02 13:35:36.246401 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:36.246350 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:36.246884 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:36.246468 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rck6h" podUID="9c643b49-721f-4cf7-8bb3-d7348acc04f3" Jun 02 13:35:36.246884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:36.246799 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:36.247005 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:36.246885 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:38.245013 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:38.244975 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:38.245460 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:38.245103 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rck6h" podUID="9c643b49-721f-4cf7-8bb3-d7348acc04f3" Jun 02 13:35:38.245460 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:38.245179 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:38.245460 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:38.245316 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:40.247995 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:40.247968 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:40.248553 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:40.248085 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rck6h" podUID="9c643b49-721f-4cf7-8bb3-d7348acc04f3" Jun 02 13:35:40.248553 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:40.247968 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:40.248553 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:40.248448 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:41.970891 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:41.970848 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs\") pod \"network-metrics-daemon-lvq7r\" (UID: \"ed3b2b23-30df-4e74-8662-a29c58704801\") " pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:41.971330 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:41.970920 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8d4k\" (UniqueName: \"kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k\") pod \"network-check-target-rck6h\" (UID: \"9c643b49-721f-4cf7-8bb3-d7348acc04f3\") " pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:41.971330 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:41.970978 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 13:35:41.971330 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:41.971055 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs podName:ed3b2b23-30df-4e74-8662-a29c58704801 nodeName:}" failed. No retries permitted until 2026-06-02 13:35:57.971033756 +0000 UTC m=+34.278398322 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs") pod "network-metrics-daemon-lvq7r" (UID: "ed3b2b23-30df-4e74-8662-a29c58704801") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 13:35:41.971330 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:41.971073 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 13:35:41.971330 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:41.971094 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 13:35:41.971330 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:41.971108 2578 projected.go:194] Error preparing data for projected volume kube-api-access-h8d4k for pod openshift-network-diagnostics/network-check-target-rck6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 13:35:41.971330 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:41.971167 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k podName:9c643b49-721f-4cf7-8bb3-d7348acc04f3 nodeName:}" failed. No retries permitted until 2026-06-02 13:35:57.971150059 +0000 UTC m=+34.278514623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8d4k" (UniqueName: "kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k") pod "network-check-target-rck6h" (UID: "9c643b49-721f-4cf7-8bb3-d7348acc04f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 13:35:42.244845 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:42.244761 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:42.245001 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:42.244762 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:42.245001 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:42.244897 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:42.245116 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:42.244992 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rck6h" podUID="9c643b49-721f-4cf7-8bb3-d7348acc04f3" Jun 02 13:35:44.245338 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:44.245300 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:44.245759 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:44.245434 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rck6h" podUID="9c643b49-721f-4cf7-8bb3-d7348acc04f3" Jun 02 13:35:44.245759 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:44.245490 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:44.245759 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:44.245606 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:45.360195 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:45.360148 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qpfnp" event={"ID":"c0e798ef-026f-4d2d-bbbf-8e52bda3bf94","Type":"ContainerStarted","Data":"5ad6f48c46470f799720d9bc9a9da4df592739db52f9db055e652df9bde5e732"} Jun 02 13:35:45.361473 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:45.361452 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" event={"ID":"cc5bda26-742f-4ea7-a266-9c97e87606b9","Type":"ContainerStarted","Data":"350be8a1933334853fe4f813bab72a22c68a272405d2380b59db395ea1a74233"} Jun 02 13:35:45.362659 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:45.362635 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nkl7l" event={"ID":"9ac71bf8-ef94-4cee-b3aa-07599cf27742","Type":"ContainerStarted","Data":"9827011c5a20e0bf0d112a2642efe7415bab3b600fbd157c058e1a288d4ea114"} Jun 02 13:35:45.373286 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:45.373252 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-124.ec2.internal" podStartSLOduration=20.373241137 podStartE2EDuration="20.373241137s" podCreationTimestamp="2026-06-02 13:35:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 13:35:28.342542253 +0000 UTC m=+4.649906840" watchObservedRunningTime="2026-06-02 13:35:45.373241137 +0000 UTC m=+21.680605721" Jun 02 13:35:45.387579 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:45.387543 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nkl7l" podStartSLOduration=3.192073617 podStartE2EDuration="21.387531183s" podCreationTimestamp="2026-06-02 13:35:24 +0000 UTC" firstStartedPulling="2026-06-02 13:35:26.88923333 +0000 UTC m=+3.196597893" lastFinishedPulling="2026-06-02 13:35:45.084690879 +0000 UTC m=+21.392055459" observedRunningTime="2026-06-02 13:35:45.387491459 +0000 UTC m=+21.694856043" watchObservedRunningTime="2026-06-02 13:35:45.387531183 +0000 UTC m=+21.694895767" Jun 02 13:35:45.387968 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:45.387947 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qpfnp" podStartSLOduration=3.186790998 podStartE2EDuration="21.387942823s" podCreationTimestamp="2026-06-02 13:35:24 +0000 UTC" firstStartedPulling="2026-06-02 13:35:26.883536988 +0000 UTC m=+3.190901551" lastFinishedPulling="2026-06-02 13:35:45.084688812 +0000 UTC m=+21.392053376" observedRunningTime="2026-06-02 13:35:45.373125602 +0000 UTC m=+21.680490187" watchObservedRunningTime="2026-06-02 13:35:45.387942823 +0000 UTC m=+21.695307408" Jun 02 13:35:46.244594 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:46.244404 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:46.244779 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:46.244429 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:46.244779 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:46.244691 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:46.244779 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:46.244763 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rck6h" podUID="9c643b49-721f-4cf7-8bb3-d7348acc04f3" Jun 02 13:35:46.366326 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:46.366290 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" event={"ID":"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33","Type":"ContainerStarted","Data":"a774c89ddf72bc7acb80cf01ece8760928c5e66d916f97fe9d0aa862186aed5c"} Jun 02 13:35:46.367858 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:46.367829 2578 generic.go:358] "Generic (PLEG): container finished" podID="6cc10233-1c0c-4b74-8965-e49b0d97d906" containerID="4cc8e663a2b1a8dc192ddefd920301c0e69ee746c89daaec2b5bf78e4c7fd143" exitCode=0 Jun 02 13:35:46.367975 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:46.367921 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99k8j" event={"ID":"6cc10233-1c0c-4b74-8965-e49b0d97d906","Type":"ContainerDied","Data":"4cc8e663a2b1a8dc192ddefd920301c0e69ee746c89daaec2b5bf78e4c7fd143"} Jun 02 13:35:46.369381 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:46.369261 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fn2z4" event={"ID":"598c8188-4f93-4742-8ae8-7c96abe18894","Type":"ContainerStarted","Data":"f919e01795c50a26b834bc447cd93a061c957a3aa558c0f78428f048a21ff3bb"} Jun 02 13:35:46.370676 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:46.370655 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nlnt5" event={"ID":"037c8b1f-f090-4b5a-972c-f681ef9bcff6","Type":"ContainerStarted","Data":"a1db4ea2f5774807bbca94046bc3649607fa5070bda17989fdc6c093197c5114"} Jun 02 13:35:46.372036 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:46.372016 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" event={"ID":"4413c4bb-65b3-4015-af69-84d1d7d6ec9c","Type":"ContainerStarted","Data":"90e8f8981dc96b459a150ae3123239e4d43fb0f31770677f6ddee0dd29611ba8"} Jun 02 13:35:46.402301 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:46.402253 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7rw8k" podStartSLOduration=4.148257136 podStartE2EDuration="22.402236746s" podCreationTimestamp="2026-06-02 13:35:24 +0000 UTC" firstStartedPulling="2026-06-02 13:35:26.89297501 +0000 UTC m=+3.200339586" lastFinishedPulling="2026-06-02 13:35:45.146954619 +0000 UTC m=+21.454319196" observedRunningTime="2026-06-02 13:35:46.402069931 +0000 UTC m=+22.709434515" watchObservedRunningTime="2026-06-02 13:35:46.402236746 +0000 UTC m=+22.709601330" Jun 02 13:35:46.420270 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:46.420227 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-fn2z4" podStartSLOduration=4.148828364 podStartE2EDuration="22.420211805s" podCreationTimestamp="2026-06-02 13:35:24 +0000 UTC" firstStartedPulling="2026-06-02 13:35:26.887674446 +0000 UTC m=+3.195039008" lastFinishedPulling="2026-06-02 13:35:45.15905787 +0000 UTC m=+21.466422449" observedRunningTime="2026-06-02 13:35:46.419843773 +0000 UTC m=+22.727208360" watchObservedRunningTime="2026-06-02 13:35:46.420211805 +0000 UTC m=+22.727576390" Jun 02 13:35:46.442101 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:46.441992 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-nlnt5" podStartSLOduration=4.17525312 podStartE2EDuration="22.441972903s" podCreationTimestamp="2026-06-02 13:35:24 +0000 UTC" firstStartedPulling="2026-06-02 13:35:26.880268455 +0000 UTC m=+3.187633032" lastFinishedPulling="2026-06-02 13:35:45.146988235 +0000 UTC m=+21.454352815" observedRunningTime="2026-06-02 13:35:46.435455065 +0000 UTC m=+22.742819648" watchObservedRunningTime="2026-06-02 13:35:46.441972903 +0000 UTC m=+22.749337490" Jun 02 13:35:46.796096 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:46.796077 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 13:35:46.950186 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:46.950162 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qpfnp" Jun 02 13:35:46.950946 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:46.950927 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qpfnp" Jun 02 13:35:47.214642 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:47.214416 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T13:35:46.796093757Z","UUID":"a8511c36-01a2-4371-bdb9-7ff81f830bb8","Handler":null,"Name":"","Endpoint":""} Jun 02 13:35:47.216400 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:47.216239 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 13:35:47.216400 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:47.216270 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 13:35:47.377610 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:47.377492 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" event={"ID":"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33","Type":"ContainerStarted","Data":"b605ce0f1d6bf3a7b4b917b10f230f18cbdc165aa2dfd8f7a2c01eb762d9e656"} Jun 02 13:35:47.377610 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:47.377546 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" event={"ID":"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33","Type":"ContainerStarted","Data":"91601a79e1d084d4ff63102dda2f01b8da385832b1f2d371bd019c1b40bd4dcf"} Jun 02 13:35:47.377610 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:47.377565 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" event={"ID":"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33","Type":"ContainerStarted","Data":"1755c26ff18ed0111a449194e65ebf8c3ec4b100b91cdab84db8b166afb00e04"} Jun 02 13:35:47.377610 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:47.377578 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" event={"ID":"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33","Type":"ContainerStarted","Data":"c3b22d258c9e1dc379ef2622768f9d7f35ef38cf0b1c46fe16e0105ce1b25a84"} Jun 02 13:35:47.377610 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:47.377591 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" event={"ID":"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33","Type":"ContainerStarted","Data":"990dcd09145486f7ee2cf9eab7965921360313bbc3ee9a50ca3cd994dac6ceef"} Jun 02 13:35:47.380207 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:47.380161 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" event={"ID":"cc5bda26-742f-4ea7-a266-9c97e87606b9","Type":"ContainerStarted","Data":"f000f4f4b700764e4d1d58997f42602a08f1681696eeaa41b95972d41b1b7902"} Jun 02 13:35:47.381707 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:47.381676 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sxmj2" event={"ID":"ee5c0940-9302-4e41-b978-7e2d26e5f929","Type":"ContainerStarted","Data":"5617c7e0d9c36843b17384a69d0d6248dbad7a2ab59f437365b5d58c0ff80900"} Jun 02 13:35:47.382872 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:47.382851 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qpfnp" Jun 02 13:35:47.383333 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:47.383313 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qpfnp" Jun 02 13:35:47.396321 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:47.396277 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sxmj2" podStartSLOduration=5.126164426 podStartE2EDuration="23.396261445s" podCreationTimestamp="2026-06-02 13:35:24 +0000 UTC" firstStartedPulling="2026-06-02 13:35:26.882309007 +0000 UTC m=+3.189673573" lastFinishedPulling="2026-06-02 13:35:45.152406013 +0000 UTC m=+21.459770592" observedRunningTime="2026-06-02 13:35:47.395742721 +0000 UTC m=+23.703107306" watchObservedRunningTime="2026-06-02 13:35:47.396261445 +0000 UTC m=+23.703626031" Jun 02 13:35:48.244333 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:48.244303 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:48.244492 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:48.244347 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:48.244492 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:48.244481 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:48.244626 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:48.244604 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rck6h" podUID="9c643b49-721f-4cf7-8bb3-d7348acc04f3" Jun 02 13:35:48.385244 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:48.385187 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" event={"ID":"cc5bda26-742f-4ea7-a266-9c97e87606b9","Type":"ContainerStarted","Data":"2288e61605a5485cb122908cfe56ad53db3b6f2ad7d64510c88e6b0d675566a0"} Jun 02 13:35:49.403296 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:49.403195 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6xgwk" podStartSLOduration=4.070857273 podStartE2EDuration="25.403178525s" podCreationTimestamp="2026-06-02 13:35:24 +0000 UTC" firstStartedPulling="2026-06-02 13:35:26.892282027 +0000 UTC m=+3.199646597" lastFinishedPulling="2026-06-02 13:35:48.224603271 +0000 UTC m=+24.531967849" observedRunningTime="2026-06-02 13:35:49.403054567 +0000 UTC m=+25.710419152" watchObservedRunningTime="2026-06-02 13:35:49.403178525 +0000 UTC m=+25.710543110" Jun 02 13:35:50.244135 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:50.244105 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:50.244315 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:50.244217 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rck6h" podUID="9c643b49-721f-4cf7-8bb3-d7348acc04f3" Jun 02 13:35:50.244404 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:50.244308 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:50.244457 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:50.244440 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:50.392634 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:50.392598 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" event={"ID":"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33","Type":"ContainerStarted","Data":"77be092d2b85832058f545de0d585785b779bd3ed32942d83350dde3d7c8bf6b"} Jun 02 13:35:51.395924 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:51.395891 2578 generic.go:358] "Generic (PLEG): container finished" podID="6cc10233-1c0c-4b74-8965-e49b0d97d906" containerID="32a40c69d99973cf6b4de25837651915e70a320b78d1964c224ebabfb92a9bcb" exitCode=0 Jun 02 13:35:51.396527 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:51.395939 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99k8j" event={"ID":"6cc10233-1c0c-4b74-8965-e49b0d97d906","Type":"ContainerDied","Data":"32a40c69d99973cf6b4de25837651915e70a320b78d1964c224ebabfb92a9bcb"} Jun 02 13:35:52.247623 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:52.247597 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:52.247723 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:52.247601 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:52.247786 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:52.247727 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:52.247829 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:52.247800 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rck6h" podUID="9c643b49-721f-4cf7-8bb3-d7348acc04f3" Jun 02 13:35:52.400738 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:52.399770 2578 generic.go:358] "Generic (PLEG): container finished" podID="6cc10233-1c0c-4b74-8965-e49b0d97d906" containerID="42a4508ea024563b0b786f28952a58fb616e60c2d928ec431d34e20749158efb" exitCode=0 Jun 02 13:35:52.400738 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:52.399975 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99k8j" event={"ID":"6cc10233-1c0c-4b74-8965-e49b0d97d906","Type":"ContainerDied","Data":"42a4508ea024563b0b786f28952a58fb616e60c2d928ec431d34e20749158efb"} Jun 02 13:35:53.404871 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:53.404830 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" event={"ID":"3554d7b2-3288-4d6c-bc33-ddf4f5ddda33","Type":"ContainerStarted","Data":"0218a08a0c171d4887562011534f29603e56841916bdd697afc071a72cf87da6"} Jun 02 13:35:53.405347 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:53.405124 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:53.407052 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:53.407023 2578 generic.go:358] "Generic (PLEG): container finished" podID="6cc10233-1c0c-4b74-8965-e49b0d97d906" containerID="7d59ea6e4224c1cad5fd3a84db6c7db17095b985b3cab7be80d815a4c3469e97" exitCode=0 Jun 02 13:35:53.407167 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:53.407073 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99k8j" event={"ID":"6cc10233-1c0c-4b74-8965-e49b0d97d906","Type":"ContainerDied","Data":"7d59ea6e4224c1cad5fd3a84db6c7db17095b985b3cab7be80d815a4c3469e97"} Jun 02 13:35:53.421062 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:53.421043 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:53.429159 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:53.429123 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" podStartSLOduration=10.072019234 podStartE2EDuration="29.429110645s" podCreationTimestamp="2026-06-02 13:35:24 +0000 UTC" firstStartedPulling="2026-06-02 13:35:26.891323796 +0000 UTC m=+3.198688360" lastFinishedPulling="2026-06-02 13:35:46.248415206 +0000 UTC m=+22.555779771" observedRunningTime="2026-06-02 13:35:53.42866222 +0000 UTC m=+29.736026799" watchObservedRunningTime="2026-06-02 13:35:53.429110645 +0000 UTC m=+29.736475230" Jun 02 13:35:54.245204 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:54.245178 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:54.245345 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:54.245267 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rck6h" podUID="9c643b49-721f-4cf7-8bb3-d7348acc04f3" Jun 02 13:35:54.245414 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:54.245348 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:54.245470 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:54.245451 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:54.409433 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:54.409404 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:54.409773 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:54.409444 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:54.426172 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:54.426146 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:35:54.882139 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:54.881731 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rck6h"] Jun 02 13:35:54.882139 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:54.882065 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:54.882398 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:54.882189 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rck6h" podUID="9c643b49-721f-4cf7-8bb3-d7348acc04f3" Jun 02 13:35:54.884347 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:54.884320 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lvq7r"] Jun 02 13:35:54.884476 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:54.884437 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:54.884557 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:54.884535 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:56.244800 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:56.244766 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:56.245351 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:56.244902 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:57.244505 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:57.244464 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:57.244672 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:57.244590 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rck6h" podUID="9c643b49-721f-4cf7-8bb3-d7348acc04f3" Jun 02 13:35:57.987276 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:57.987241 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8d4k\" (UniqueName: \"kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k\") pod \"network-check-target-rck6h\" (UID: \"9c643b49-721f-4cf7-8bb3-d7348acc04f3\") " pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:57.987889 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:57.987326 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs\") pod \"network-metrics-daemon-lvq7r\" (UID: \"ed3b2b23-30df-4e74-8662-a29c58704801\") " pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:57.987889 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:57.987424 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 13:35:57.987889 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:57.987442 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 13:35:57.987889 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:57.987450 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 13:35:57.987889 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:57.987464 2578 projected.go:194] Error preparing data for projected volume kube-api-access-h8d4k for pod openshift-network-diagnostics/network-check-target-rck6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 13:35:57.987889 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:57.987503 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs podName:ed3b2b23-30df-4e74-8662-a29c58704801 nodeName:}" failed. No retries permitted until 2026-06-02 13:36:29.987483976 +0000 UTC m=+66.294848539 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs") pod "network-metrics-daemon-lvq7r" (UID: "ed3b2b23-30df-4e74-8662-a29c58704801") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 13:35:57.987889 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:57.987519 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k podName:9c643b49-721f-4cf7-8bb3-d7348acc04f3 nodeName:}" failed. No retries permitted until 2026-06-02 13:36:29.987511171 +0000 UTC m=+66.294875740 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h8d4k" (UniqueName: "kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k") pod "network-check-target-rck6h" (UID: "9c643b49-721f-4cf7-8bb3-d7348acc04f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 13:35:58.245269 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:58.245185 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:35:58.245429 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:58.245336 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:35:58.976874 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:58.976845 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-124.ec2.internal" event="NodeReady" Jun 02 13:35:58.977041 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:58.976995 2578 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 13:35:59.019035 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.019001 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mwt7z"] Jun 02 13:35:59.053497 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.053470 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j4wmd"] Jun 02 13:35:59.053682 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.053661 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mwt7z" Jun 02 13:35:59.056222 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.056203 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 13:35:59.056320 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.056200 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5pg95\"" Jun 02 13:35:59.056320 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.056202 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 13:35:59.071523 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.071503 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mwt7z"] Jun 02 13:35:59.071615 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.071528 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j4wmd"] Jun 02 13:35:59.071665 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.071638 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j4wmd" Jun 02 13:35:59.074048 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.074025 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 13:35:59.074126 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.074054 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 13:35:59.074190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.074117 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 13:35:59.074227 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.074186 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qvdp6\"" Jun 02 13:35:59.197069 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.196987 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t8hv\" (UniqueName: \"kubernetes.io/projected/d38db827-b14d-4561-8411-d4f9e6a613ab-kube-api-access-6t8hv\") pod \"ingress-canary-j4wmd\" (UID: \"d38db827-b14d-4561-8411-d4f9e6a613ab\") " pod="openshift-ingress-canary/ingress-canary-j4wmd" Jun 02 13:35:59.197069 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.197034 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert\") pod \"ingress-canary-j4wmd\" (UID: \"d38db827-b14d-4561-8411-d4f9e6a613ab\") " pod="openshift-ingress-canary/ingress-canary-j4wmd" Jun 02 13:35:59.197272 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.197085 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdh5q\" (UniqueName: \"kubernetes.io/projected/53a5bd7b-7795-4be2-8547-eb90b389c051-kube-api-access-vdh5q\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:35:59.197272 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.197132 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53a5bd7b-7795-4be2-8547-eb90b389c051-tmp-dir\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:35:59.197272 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.197159 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:35:59.197272 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.197201 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53a5bd7b-7795-4be2-8547-eb90b389c051-config-volume\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:35:59.244501 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.244467 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:35:59.247300 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.247273 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 13:35:59.247300 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.247300 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xkc2b\"" Jun 02 13:35:59.247461 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.247271 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 13:35:59.298386 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.298345 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6t8hv\" (UniqueName: \"kubernetes.io/projected/d38db827-b14d-4561-8411-d4f9e6a613ab-kube-api-access-6t8hv\") pod \"ingress-canary-j4wmd\" (UID: \"d38db827-b14d-4561-8411-d4f9e6a613ab\") " pod="openshift-ingress-canary/ingress-canary-j4wmd" Jun 02 13:35:59.298558 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.298404 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert\") pod \"ingress-canary-j4wmd\" (UID: \"d38db827-b14d-4561-8411-d4f9e6a613ab\") " pod="openshift-ingress-canary/ingress-canary-j4wmd" Jun 02 13:35:59.298558 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.298428 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdh5q\" (UniqueName: \"kubernetes.io/projected/53a5bd7b-7795-4be2-8547-eb90b389c051-kube-api-access-vdh5q\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:35:59.298558 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:59.298515 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 13:35:59.298718 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:59.298585 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert podName:d38db827-b14d-4561-8411-d4f9e6a613ab nodeName:}" failed. No retries permitted until 2026-06-02 13:35:59.798563509 +0000 UTC m=+36.105928095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert") pod "ingress-canary-j4wmd" (UID: "d38db827-b14d-4561-8411-d4f9e6a613ab") : secret "canary-serving-cert" not found Jun 02 13:35:59.298718 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.298612 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53a5bd7b-7795-4be2-8547-eb90b389c051-tmp-dir\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:35:59.298718 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.298654 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:35:59.298888 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.298725 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53a5bd7b-7795-4be2-8547-eb90b389c051-config-volume\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:35:59.298888 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:59.298804 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 13:35:59.298888 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:59.298846 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls podName:53a5bd7b-7795-4be2-8547-eb90b389c051 nodeName:}" failed. No retries permitted until 2026-06-02 13:35:59.798833847 +0000 UTC m=+36.106198410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls") pod "dns-default-mwt7z" (UID: "53a5bd7b-7795-4be2-8547-eb90b389c051") : secret "dns-default-metrics-tls" not found Jun 02 13:35:59.298888 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.298879 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53a5bd7b-7795-4be2-8547-eb90b389c051-tmp-dir\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:35:59.299223 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.299203 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53a5bd7b-7795-4be2-8547-eb90b389c051-config-volume\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:35:59.309669 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.309649 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdh5q\" (UniqueName: \"kubernetes.io/projected/53a5bd7b-7795-4be2-8547-eb90b389c051-kube-api-access-vdh5q\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:35:59.309755 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.309670 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t8hv\" (UniqueName: \"kubernetes.io/projected/d38db827-b14d-4561-8411-d4f9e6a613ab-kube-api-access-6t8hv\") pod \"ingress-canary-j4wmd\" (UID: \"d38db827-b14d-4561-8411-d4f9e6a613ab\") " pod="openshift-ingress-canary/ingress-canary-j4wmd" Jun 02 13:35:59.803258 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.803221 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:35:59.803407 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:35:59.803301 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert\") pod \"ingress-canary-j4wmd\" (UID: \"d38db827-b14d-4561-8411-d4f9e6a613ab\") " pod="openshift-ingress-canary/ingress-canary-j4wmd" Jun 02 13:35:59.803407 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:59.803376 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 13:35:59.803501 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:59.803414 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 13:35:59.803501 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:59.803443 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls podName:53a5bd7b-7795-4be2-8547-eb90b389c051 nodeName:}" failed. No retries permitted until 2026-06-02 13:36:00.803427719 +0000 UTC m=+37.110792286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls") pod "dns-default-mwt7z" (UID: "53a5bd7b-7795-4be2-8547-eb90b389c051") : secret "dns-default-metrics-tls" not found Jun 02 13:35:59.803501 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:35:59.803460 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert podName:d38db827-b14d-4561-8411-d4f9e6a613ab nodeName:}" failed. No retries permitted until 2026-06-02 13:36:00.803449683 +0000 UTC m=+37.110814246 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert") pod "ingress-canary-j4wmd" (UID: "d38db827-b14d-4561-8411-d4f9e6a613ab") : secret "canary-serving-cert" not found Jun 02 13:36:00.245166 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:00.245128 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:36:00.248099 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:00.248080 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 13:36:00.248211 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:00.248122 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ddqxr\"" Jun 02 13:36:00.424394 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:00.424346 2578 generic.go:358] "Generic (PLEG): container finished" podID="6cc10233-1c0c-4b74-8965-e49b0d97d906" containerID="ffdc5181cb4db8baedfadb6ae663d4ef6f43fc6f9765515f0efb86a0f35fd1bd" exitCode=0 Jun 02 13:36:00.424564 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:00.424415 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99k8j" event={"ID":"6cc10233-1c0c-4b74-8965-e49b0d97d906","Type":"ContainerDied","Data":"ffdc5181cb4db8baedfadb6ae663d4ef6f43fc6f9765515f0efb86a0f35fd1bd"} Jun 02 13:36:00.809905 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:00.809873 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert\") pod \"ingress-canary-j4wmd\" (UID: \"d38db827-b14d-4561-8411-d4f9e6a613ab\") " pod="openshift-ingress-canary/ingress-canary-j4wmd" Jun 02 13:36:00.809905 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:00.809917 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:36:00.810135 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:00.810016 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 13:36:00.810135 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:00.810036 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 13:36:00.810135 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:00.810072 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls podName:53a5bd7b-7795-4be2-8547-eb90b389c051 nodeName:}" failed. No retries permitted until 2026-06-02 13:36:02.810055789 +0000 UTC m=+39.117420360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls") pod "dns-default-mwt7z" (UID: "53a5bd7b-7795-4be2-8547-eb90b389c051") : secret "dns-default-metrics-tls" not found Jun 02 13:36:00.810135 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:00.810099 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert podName:d38db827-b14d-4561-8411-d4f9e6a613ab nodeName:}" failed. No retries permitted until 2026-06-02 13:36:02.810080437 +0000 UTC m=+39.117445014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert") pod "ingress-canary-j4wmd" (UID: "d38db827-b14d-4561-8411-d4f9e6a613ab") : secret "canary-serving-cert" not found Jun 02 13:36:01.428942 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:01.428909 2578 generic.go:358] "Generic (PLEG): container finished" podID="6cc10233-1c0c-4b74-8965-e49b0d97d906" containerID="5ebaeecd7d42b047fdd3be166e8b57647dd8540e055ea232fed6056d437cc583" exitCode=0 Jun 02 13:36:01.429319 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:01.428958 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99k8j" event={"ID":"6cc10233-1c0c-4b74-8965-e49b0d97d906","Type":"ContainerDied","Data":"5ebaeecd7d42b047fdd3be166e8b57647dd8540e055ea232fed6056d437cc583"} Jun 02 13:36:02.438128 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:02.437945 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99k8j" event={"ID":"6cc10233-1c0c-4b74-8965-e49b0d97d906","Type":"ContainerStarted","Data":"578f25f38d210887b86ce155823fe54a03d06f83e685bf84cdaff702a31ac9d9"} Jun 02 13:36:02.459189 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:02.459129 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-99k8j" podStartSLOduration=5.850312117 podStartE2EDuration="38.459107868s" podCreationTimestamp="2026-06-02 13:35:24 +0000 UTC" firstStartedPulling="2026-06-02 13:35:26.891246939 +0000 UTC m=+3.198611514" lastFinishedPulling="2026-06-02 13:35:59.500042697 +0000 UTC m=+35.807407265" observedRunningTime="2026-06-02 13:36:02.458004062 +0000 UTC m=+38.765368647" watchObservedRunningTime="2026-06-02 13:36:02.459107868 +0000 UTC m=+38.766472449" Jun 02 13:36:02.824356 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:02.824321 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:36:02.824582 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:02.824409 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert\") pod \"ingress-canary-j4wmd\" (UID: \"d38db827-b14d-4561-8411-d4f9e6a613ab\") " pod="openshift-ingress-canary/ingress-canary-j4wmd" Jun 02 13:36:02.824582 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:02.824472 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 13:36:02.824582 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:02.824487 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 13:36:02.824582 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:02.824537 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls podName:53a5bd7b-7795-4be2-8547-eb90b389c051 nodeName:}" failed. No retries permitted until 2026-06-02 13:36:06.824521685 +0000 UTC m=+43.131886248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls") pod "dns-default-mwt7z" (UID: "53a5bd7b-7795-4be2-8547-eb90b389c051") : secret "dns-default-metrics-tls" not found Jun 02 13:36:02.824582 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:02.824553 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert podName:d38db827-b14d-4561-8411-d4f9e6a613ab nodeName:}" failed. No retries permitted until 2026-06-02 13:36:06.824546487 +0000 UTC m=+43.131911049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert") pod "ingress-canary-j4wmd" (UID: "d38db827-b14d-4561-8411-d4f9e6a613ab") : secret "canary-serving-cert" not found Jun 02 13:36:06.852964 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:06.852925 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert\") pod \"ingress-canary-j4wmd\" (UID: \"d38db827-b14d-4561-8411-d4f9e6a613ab\") " pod="openshift-ingress-canary/ingress-canary-j4wmd" Jun 02 13:36:06.852964 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:06.852971 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:36:06.853562 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:06.853064 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 13:36:06.853562 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:06.853068 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 13:36:06.853562 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:06.853115 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls podName:53a5bd7b-7795-4be2-8547-eb90b389c051 nodeName:}" failed. No retries permitted until 2026-06-02 13:36:14.853102794 +0000 UTC m=+51.160467357 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls") pod "dns-default-mwt7z" (UID: "53a5bd7b-7795-4be2-8547-eb90b389c051") : secret "dns-default-metrics-tls" not found Jun 02 13:36:06.853562 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:06.853128 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert podName:d38db827-b14d-4561-8411-d4f9e6a613ab nodeName:}" failed. No retries permitted until 2026-06-02 13:36:14.853121638 +0000 UTC m=+51.160486201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert") pod "ingress-canary-j4wmd" (UID: "d38db827-b14d-4561-8411-d4f9e6a613ab") : secret "canary-serving-cert" not found Jun 02 13:36:14.905231 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:14.905187 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert\") pod \"ingress-canary-j4wmd\" (UID: \"d38db827-b14d-4561-8411-d4f9e6a613ab\") " pod="openshift-ingress-canary/ingress-canary-j4wmd" Jun 02 13:36:14.905231 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:14.905238 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:36:14.905862 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:14.905388 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 13:36:14.905862 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:14.905467 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert podName:d38db827-b14d-4561-8411-d4f9e6a613ab nodeName:}" failed. No retries permitted until 2026-06-02 13:36:30.905445026 +0000 UTC m=+67.212809604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert") pod "ingress-canary-j4wmd" (UID: "d38db827-b14d-4561-8411-d4f9e6a613ab") : secret "canary-serving-cert" not found Jun 02 13:36:14.905862 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:14.905392 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 13:36:14.905862 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:14.905547 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls podName:53a5bd7b-7795-4be2-8547-eb90b389c051 nodeName:}" failed. No retries permitted until 2026-06-02 13:36:30.905534947 +0000 UTC m=+67.212899510 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls") pod "dns-default-mwt7z" (UID: "53a5bd7b-7795-4be2-8547-eb90b389c051") : secret "dns-default-metrics-tls" not found Jun 02 13:36:26.424634 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:26.424602 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ck8pc" Jun 02 13:36:30.010051 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:30.010008 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs\") pod \"network-metrics-daemon-lvq7r\" (UID: \"ed3b2b23-30df-4e74-8662-a29c58704801\") " pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:36:30.010051 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:30.010060 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8d4k\" (UniqueName: \"kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k\") pod \"network-check-target-rck6h\" (UID: \"9c643b49-721f-4cf7-8bb3-d7348acc04f3\") " pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:36:30.012422 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:30.012405 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 13:36:30.012503 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:30.012410 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 13:36:30.020266 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:30.020245 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 13:36:30.020387 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:30.020323 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs podName:ed3b2b23-30df-4e74-8662-a29c58704801 nodeName:}" failed. No retries permitted until 2026-06-02 13:37:34.020300591 +0000 UTC m=+130.327665161 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs") pod "network-metrics-daemon-lvq7r" (UID: "ed3b2b23-30df-4e74-8662-a29c58704801") : secret "metrics-daemon-secret" not found Jun 02 13:36:30.022287 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:30.022269 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 13:36:30.033631 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:30.033608 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8d4k\" (UniqueName: \"kubernetes.io/projected/9c643b49-721f-4cf7-8bb3-d7348acc04f3-kube-api-access-h8d4k\") pod \"network-check-target-rck6h\" (UID: \"9c643b49-721f-4cf7-8bb3-d7348acc04f3\") " pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:36:30.155560 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:30.155522 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xkc2b\"" Jun 02 13:36:30.163479 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:30.163456 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:36:30.311877 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:30.311847 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rck6h"] Jun 02 13:36:30.315831 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:36:30.315808 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c643b49_721f_4cf7_8bb3_d7348acc04f3.slice/crio-225f0bc0b5575a91a973589204dad662c4e53bdd7883646f677189604c988ebe WatchSource:0}: Error finding container 225f0bc0b5575a91a973589204dad662c4e53bdd7883646f677189604c988ebe: Status 404 returned error can't find the container with id 225f0bc0b5575a91a973589204dad662c4e53bdd7883646f677189604c988ebe Jun 02 13:36:30.500773 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:30.500738 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rck6h" event={"ID":"9c643b49-721f-4cf7-8bb3-d7348acc04f3","Type":"ContainerStarted","Data":"225f0bc0b5575a91a973589204dad662c4e53bdd7883646f677189604c988ebe"} Jun 02 13:36:30.917627 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:30.917588 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert\") pod \"ingress-canary-j4wmd\" (UID: \"d38db827-b14d-4561-8411-d4f9e6a613ab\") " pod="openshift-ingress-canary/ingress-canary-j4wmd" Jun 02 13:36:30.917808 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:30.917655 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:36:30.917808 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:30.917745 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 13:36:30.917808 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:30.917773 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 13:36:30.917909 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:30.917821 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert podName:d38db827-b14d-4561-8411-d4f9e6a613ab nodeName:}" failed. No retries permitted until 2026-06-02 13:37:02.917804837 +0000 UTC m=+99.225169400 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert") pod "ingress-canary-j4wmd" (UID: "d38db827-b14d-4561-8411-d4f9e6a613ab") : secret "canary-serving-cert" not found Jun 02 13:36:30.917909 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:36:30.917837 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls podName:53a5bd7b-7795-4be2-8547-eb90b389c051 nodeName:}" failed. No retries permitted until 2026-06-02 13:37:02.917830956 +0000 UTC m=+99.225195519 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls") pod "dns-default-mwt7z" (UID: "53a5bd7b-7795-4be2-8547-eb90b389c051") : secret "dns-default-metrics-tls" not found Jun 02 13:36:34.509452 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:34.509411 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rck6h" event={"ID":"9c643b49-721f-4cf7-8bb3-d7348acc04f3","Type":"ContainerStarted","Data":"682532bd5b92cc159d6305ae6dea9760872b0cd2a40e9dcdeeeee0dc48a98543"} Jun 02 13:36:34.509944 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:34.509539 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:36:34.524827 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:36:34.524787 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rck6h" podStartSLOduration=67.323703444 podStartE2EDuration="1m10.524775737s" podCreationTimestamp="2026-06-02 13:35:24 +0000 UTC" firstStartedPulling="2026-06-02 13:36:30.319528098 +0000 UTC m=+66.626892661" lastFinishedPulling="2026-06-02 13:36:33.520600385 +0000 UTC m=+69.827964954" observedRunningTime="2026-06-02 13:36:34.52368337 +0000 UTC m=+70.831047952" watchObservedRunningTime="2026-06-02 13:36:34.524775737 +0000 UTC m=+70.832140323" Jun 02 13:37:02.932253 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:02.932108 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert\") pod \"ingress-canary-j4wmd\" (UID: \"d38db827-b14d-4561-8411-d4f9e6a613ab\") " pod="openshift-ingress-canary/ingress-canary-j4wmd" Jun 02 13:37:02.932253 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:02.932169 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:37:02.932696 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:02.932258 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 13:37:02.932696 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:02.932335 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls podName:53a5bd7b-7795-4be2-8547-eb90b389c051 nodeName:}" failed. No retries permitted until 2026-06-02 13:38:06.932318734 +0000 UTC m=+163.239683297 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls") pod "dns-default-mwt7z" (UID: "53a5bd7b-7795-4be2-8547-eb90b389c051") : secret "dns-default-metrics-tls" not found Jun 02 13:37:02.932696 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:02.932258 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 13:37:02.932696 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:02.932426 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert podName:d38db827-b14d-4561-8411-d4f9e6a613ab nodeName:}" failed. No retries permitted until 2026-06-02 13:38:06.932412243 +0000 UTC m=+163.239776809 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert") pod "ingress-canary-j4wmd" (UID: "d38db827-b14d-4561-8411-d4f9e6a613ab") : secret "canary-serving-cert" not found Jun 02 13:37:05.513289 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:05.513251 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rck6h" Jun 02 13:37:27.012027 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.011995 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8"] Jun 02 13:37:27.013664 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.013640 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" Jun 02 13:37:27.017922 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.017901 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 13:37:27.018089 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.018067 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 02 13:37:27.018155 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.018098 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-q5fhp\"" Jun 02 13:37:27.018234 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.018218 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 13:37:27.018287 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.018252 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 02 13:37:27.022716 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.022683 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8"] Jun 02 13:37:27.084108 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.084074 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gnkt8\" (UID: \"b81ad2a5-97a5-452d-beb1-12eb06143da5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" Jun 02 13:37:27.084288 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.084114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b81ad2a5-97a5-452d-beb1-12eb06143da5-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-gnkt8\" (UID: \"b81ad2a5-97a5-452d-beb1-12eb06143da5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" Jun 02 13:37:27.084288 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.084211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tcnw\" (UniqueName: \"kubernetes.io/projected/b81ad2a5-97a5-452d-beb1-12eb06143da5-kube-api-access-8tcnw\") pod \"cluster-monitoring-operator-69b6cbdb88-gnkt8\" (UID: \"b81ad2a5-97a5-452d-beb1-12eb06143da5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" Jun 02 13:37:27.114143 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.114108 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9l68n"] Jun 02 13:37:27.115856 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.115841 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9l68n" Jun 02 13:37:27.118163 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.118133 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 13:37:27.118283 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.118167 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-g6nqz\"" Jun 02 13:37:27.118283 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.118220 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 13:37:27.121506 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.121486 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4"] Jun 02 13:37:27.123246 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.123161 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-86658498b7-lrbfc"] Jun 02 13:37:27.123602 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.123582 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4" Jun 02 13:37:27.127735 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.127132 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9l68n"] Jun 02 13:37:27.127735 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.127260 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:27.128050 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.128027 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 02 13:37:27.128163 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.128092 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 02 13:37:27.128163 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.128139 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zl22m\"" Jun 02 13:37:27.128815 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.128797 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 02 13:37:27.129626 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.129608 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 02 13:37:27.129824 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.129809 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 02 13:37:27.129898 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.129821 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gkddf\"" Jun 02 13:37:27.129956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.129893 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 02 13:37:27.129956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.129821 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 13:37:27.130238 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.130220 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 13:37:27.130547 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.130526 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 02 13:37:27.139609 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.139586 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4"] Jun 02 13:37:27.140351 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.140331 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86658498b7-lrbfc"] Jun 02 13:37:27.185093 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.185057 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b81ad2a5-97a5-452d-beb1-12eb06143da5-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-gnkt8\" (UID: \"b81ad2a5-97a5-452d-beb1-12eb06143da5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" Jun 02 13:37:27.185093 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.185096 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgch6\" (UniqueName: \"kubernetes.io/projected/58239f28-f968-483a-ac96-f5151dc81a6d-kube-api-access-wgch6\") pod \"cluster-samples-operator-755bbf9bfb-rmzb4\" (UID: \"58239f28-f968-483a-ac96-f5151dc81a6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4" Jun 02 13:37:27.185307 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.185121 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-stats-auth\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:27.185307 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.185168 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-default-certificate\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:27.185307 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.185188 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6mqk\" (UniqueName: \"kubernetes.io/projected/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-kube-api-access-s6mqk\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:27.185307 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.185236 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:27.185307 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.185272 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6qsc\" (UniqueName: \"kubernetes.io/projected/6a41cad0-8b20-4e6f-9697-93ac76a9225a-kube-api-access-n6qsc\") pod \"volume-data-source-validator-7598fd5bd-9l68n\" (UID: \"6a41cad0-8b20-4e6f-9697-93ac76a9225a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9l68n" Jun 02 13:37:27.185481 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.185358 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tcnw\" (UniqueName: \"kubernetes.io/projected/b81ad2a5-97a5-452d-beb1-12eb06143da5-kube-api-access-8tcnw\") pod \"cluster-monitoring-operator-69b6cbdb88-gnkt8\" (UID: \"b81ad2a5-97a5-452d-beb1-12eb06143da5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" Jun 02 13:37:27.185481 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.185414 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rmzb4\" (UID: \"58239f28-f968-483a-ac96-f5151dc81a6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4" Jun 02 13:37:27.185541 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.185509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:27.185541 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.185528 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gnkt8\" (UID: \"b81ad2a5-97a5-452d-beb1-12eb06143da5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" Jun 02 13:37:27.185628 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:27.185616 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 13:37:27.185691 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:27.185683 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls podName:b81ad2a5-97a5-452d-beb1-12eb06143da5 nodeName:}" failed. No retries permitted until 2026-06-02 13:37:27.685670449 +0000 UTC m=+123.993035012 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-gnkt8" (UID: "b81ad2a5-97a5-452d-beb1-12eb06143da5") : secret "cluster-monitoring-operator-tls" not found Jun 02 13:37:27.185776 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.185759 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b81ad2a5-97a5-452d-beb1-12eb06143da5-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-gnkt8\" (UID: \"b81ad2a5-97a5-452d-beb1-12eb06143da5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" Jun 02 13:37:27.193558 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.193531 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tcnw\" (UniqueName: \"kubernetes.io/projected/b81ad2a5-97a5-452d-beb1-12eb06143da5-kube-api-access-8tcnw\") pod \"cluster-monitoring-operator-69b6cbdb88-gnkt8\" (UID: \"b81ad2a5-97a5-452d-beb1-12eb06143da5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" Jun 02 13:37:27.286380 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.286263 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:27.286380 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.286317 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6qsc\" (UniqueName: \"kubernetes.io/projected/6a41cad0-8b20-4e6f-9697-93ac76a9225a-kube-api-access-n6qsc\") pod \"volume-data-source-validator-7598fd5bd-9l68n\" (UID: \"6a41cad0-8b20-4e6f-9697-93ac76a9225a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9l68n" Jun 02 13:37:27.286380 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.286347 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rmzb4\" (UID: \"58239f28-f968-483a-ac96-f5151dc81a6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4" Jun 02 13:37:27.286380 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.286382 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:27.286793 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:27.286434 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 13:37:27.286793 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:27.286504 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 13:37:27.286793 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:27.286507 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle podName:fedc3d80-29d5-4bc9-829d-abcbecbbcf5f nodeName:}" failed. No retries permitted until 2026-06-02 13:37:27.786494579 +0000 UTC m=+124.093859142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle") pod "router-default-86658498b7-lrbfc" (UID: "fedc3d80-29d5-4bc9-829d-abcbecbbcf5f") : configmap references non-existent config key: service-ca.crt Jun 02 13:37:27.286793 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:27.286610 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs podName:fedc3d80-29d5-4bc9-829d-abcbecbbcf5f nodeName:}" failed. No retries permitted until 2026-06-02 13:37:27.786592029 +0000 UTC m=+124.093956611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs") pod "router-default-86658498b7-lrbfc" (UID: "fedc3d80-29d5-4bc9-829d-abcbecbbcf5f") : secret "router-metrics-certs-default" not found Jun 02 13:37:27.286793 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.286632 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wgch6\" (UniqueName: \"kubernetes.io/projected/58239f28-f968-483a-ac96-f5151dc81a6d-kube-api-access-wgch6\") pod \"cluster-samples-operator-755bbf9bfb-rmzb4\" (UID: \"58239f28-f968-483a-ac96-f5151dc81a6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4" Jun 02 13:37:27.286793 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.286682 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-stats-auth\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:27.286793 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.286713 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-default-certificate\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:27.286793 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:27.286739 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls podName:58239f28-f968-483a-ac96-f5151dc81a6d nodeName:}" failed. No retries permitted until 2026-06-02 13:37:27.786717032 +0000 UTC m=+124.094081595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rmzb4" (UID: "58239f28-f968-483a-ac96-f5151dc81a6d") : secret "samples-operator-tls" not found Jun 02 13:37:27.286793 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.286789 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6mqk\" (UniqueName: \"kubernetes.io/projected/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-kube-api-access-s6mqk\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:27.289552 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.289523 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-default-certificate\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:27.289638 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.289523 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-stats-auth\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:27.295207 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.295185 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6mqk\" (UniqueName: \"kubernetes.io/projected/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-kube-api-access-s6mqk\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:27.298345 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.298316 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6qsc\" (UniqueName: \"kubernetes.io/projected/6a41cad0-8b20-4e6f-9697-93ac76a9225a-kube-api-access-n6qsc\") pod \"volume-data-source-validator-7598fd5bd-9l68n\" (UID: \"6a41cad0-8b20-4e6f-9697-93ac76a9225a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9l68n" Jun 02 13:37:27.298454 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.298406 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgch6\" (UniqueName: \"kubernetes.io/projected/58239f28-f968-483a-ac96-f5151dc81a6d-kube-api-access-wgch6\") pod \"cluster-samples-operator-755bbf9bfb-rmzb4\" (UID: \"58239f28-f968-483a-ac96-f5151dc81a6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4" Jun 02 13:37:27.428197 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.428159 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9l68n" Jun 02 13:37:27.544868 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.544779 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9l68n"] Jun 02 13:37:27.548200 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:37:27.548169 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a41cad0_8b20_4e6f_9697_93ac76a9225a.slice/crio-c47839520b64d8311138310091b0cf4765d510b67b55f73f2ee467442e481ab7 WatchSource:0}: Error finding container c47839520b64d8311138310091b0cf4765d510b67b55f73f2ee467442e481ab7: Status 404 returned error can't find the container with id c47839520b64d8311138310091b0cf4765d510b67b55f73f2ee467442e481ab7 Jun 02 13:37:27.612002 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.611966 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9l68n" event={"ID":"6a41cad0-8b20-4e6f-9697-93ac76a9225a","Type":"ContainerStarted","Data":"c47839520b64d8311138310091b0cf4765d510b67b55f73f2ee467442e481ab7"} Jun 02 13:37:27.689417 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.689352 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gnkt8\" (UID: \"b81ad2a5-97a5-452d-beb1-12eb06143da5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" Jun 02 13:37:27.689613 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:27.689520 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 13:37:27.689613 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:27.689604 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls podName:b81ad2a5-97a5-452d-beb1-12eb06143da5 nodeName:}" failed. No retries permitted until 2026-06-02 13:37:28.689585249 +0000 UTC m=+124.996949826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-gnkt8" (UID: "b81ad2a5-97a5-452d-beb1-12eb06143da5") : secret "cluster-monitoring-operator-tls" not found Jun 02 13:37:27.790114 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.790079 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:27.790289 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.790140 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rmzb4\" (UID: \"58239f28-f968-483a-ac96-f5151dc81a6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4" Jun 02 13:37:27.790289 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.790160 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:27.790289 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:27.790225 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 13:37:27.790289 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:27.790276 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle podName:fedc3d80-29d5-4bc9-829d-abcbecbbcf5f nodeName:}" failed. No retries permitted until 2026-06-02 13:37:28.790262337 +0000 UTC m=+125.097626901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle") pod "router-default-86658498b7-lrbfc" (UID: "fedc3d80-29d5-4bc9-829d-abcbecbbcf5f") : configmap references non-existent config key: service-ca.crt Jun 02 13:37:27.790505 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:27.790290 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs podName:fedc3d80-29d5-4bc9-829d-abcbecbbcf5f nodeName:}" failed. No retries permitted until 2026-06-02 13:37:28.790284523 +0000 UTC m=+125.097649085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs") pod "router-default-86658498b7-lrbfc" (UID: "fedc3d80-29d5-4bc9-829d-abcbecbbcf5f") : secret "router-metrics-certs-default" not found Jun 02 13:37:27.790505 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:27.790297 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 13:37:27.790505 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:27.790351 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls podName:58239f28-f968-483a-ac96-f5151dc81a6d nodeName:}" failed. No retries permitted until 2026-06-02 13:37:28.790330824 +0000 UTC m=+125.097695392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rmzb4" (UID: "58239f28-f968-483a-ac96-f5151dc81a6d") : secret "samples-operator-tls" not found Jun 02 13:37:27.995494 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.995460 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4"] Jun 02 13:37:27.997839 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:27.997823 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4" Jun 02 13:37:28.000265 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.000238 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 02 13:37:28.000414 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.000266 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 02 13:37:28.000414 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.000278 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 02 13:37:28.000414 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.000390 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-hcd56\"" Jun 02 13:37:28.000561 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.000523 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 02 13:37:28.005709 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.005687 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4"] Jun 02 13:37:28.092246 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.092213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2a9a73d0-15c2-4604-a9cf-ae254f856b44-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-p5vp4\" (UID: \"2a9a73d0-15c2-4604-a9cf-ae254f856b44\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4" Jun 02 13:37:28.092666 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.092353 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r44v2\" (UniqueName: \"kubernetes.io/projected/2a9a73d0-15c2-4604-a9cf-ae254f856b44-kube-api-access-r44v2\") pod \"kube-storage-version-migrator-operator-96ddc787c-p5vp4\" (UID: \"2a9a73d0-15c2-4604-a9cf-ae254f856b44\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4" Jun 02 13:37:28.092666 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.092410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a9a73d0-15c2-4604-a9cf-ae254f856b44-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-p5vp4\" (UID: \"2a9a73d0-15c2-4604-a9cf-ae254f856b44\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4" Jun 02 13:37:28.193355 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.193312 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2a9a73d0-15c2-4604-a9cf-ae254f856b44-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-p5vp4\" (UID: \"2a9a73d0-15c2-4604-a9cf-ae254f856b44\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4" Jun 02 13:37:28.193521 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.193469 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r44v2\" (UniqueName: \"kubernetes.io/projected/2a9a73d0-15c2-4604-a9cf-ae254f856b44-kube-api-access-r44v2\") pod \"kube-storage-version-migrator-operator-96ddc787c-p5vp4\" (UID: \"2a9a73d0-15c2-4604-a9cf-ae254f856b44\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4" Jun 02 13:37:28.193521 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.193506 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a9a73d0-15c2-4604-a9cf-ae254f856b44-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-p5vp4\" (UID: \"2a9a73d0-15c2-4604-a9cf-ae254f856b44\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4" Jun 02 13:37:28.193901 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.193881 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2a9a73d0-15c2-4604-a9cf-ae254f856b44-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-p5vp4\" (UID: \"2a9a73d0-15c2-4604-a9cf-ae254f856b44\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4" Jun 02 13:37:28.196177 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.196150 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a9a73d0-15c2-4604-a9cf-ae254f856b44-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-p5vp4\" (UID: \"2a9a73d0-15c2-4604-a9cf-ae254f856b44\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4" Jun 02 13:37:28.202952 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.202901 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r44v2\" (UniqueName: \"kubernetes.io/projected/2a9a73d0-15c2-4604-a9cf-ae254f856b44-kube-api-access-r44v2\") pod \"kube-storage-version-migrator-operator-96ddc787c-p5vp4\" (UID: \"2a9a73d0-15c2-4604-a9cf-ae254f856b44\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4" Jun 02 13:37:28.306952 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.306925 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4" Jun 02 13:37:28.435865 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.435827 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4"] Jun 02 13:37:28.439085 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:37:28.439058 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a9a73d0_15c2_4604_a9cf_ae254f856b44.slice/crio-4263cf4f3632b0a459683ed6472bc084a3974a694250c8ed16862402e0414396 WatchSource:0}: Error finding container 4263cf4f3632b0a459683ed6472bc084a3974a694250c8ed16862402e0414396: Status 404 returned error can't find the container with id 4263cf4f3632b0a459683ed6472bc084a3974a694250c8ed16862402e0414396 Jun 02 13:37:28.615191 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.615109 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4" event={"ID":"2a9a73d0-15c2-4604-a9cf-ae254f856b44","Type":"ContainerStarted","Data":"4263cf4f3632b0a459683ed6472bc084a3974a694250c8ed16862402e0414396"} Jun 02 13:37:28.696649 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.696617 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gnkt8\" (UID: \"b81ad2a5-97a5-452d-beb1-12eb06143da5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" Jun 02 13:37:28.696795 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:28.696729 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 13:37:28.696795 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:28.696784 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls podName:b81ad2a5-97a5-452d-beb1-12eb06143da5 nodeName:}" failed. No retries permitted until 2026-06-02 13:37:30.69676927 +0000 UTC m=+127.004133833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-gnkt8" (UID: "b81ad2a5-97a5-452d-beb1-12eb06143da5") : secret "cluster-monitoring-operator-tls" not found Jun 02 13:37:28.797172 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.797136 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:28.797339 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.797196 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rmzb4\" (UID: \"58239f28-f968-483a-ac96-f5151dc81a6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4" Jun 02 13:37:28.797339 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:28.797282 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 13:37:28.797339 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:28.797282 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 13:37:28.797339 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:28.797311 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:28.797487 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:28.797344 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls podName:58239f28-f968-483a-ac96-f5151dc81a6d nodeName:}" failed. No retries permitted until 2026-06-02 13:37:30.797325872 +0000 UTC m=+127.104690457 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rmzb4" (UID: "58239f28-f968-483a-ac96-f5151dc81a6d") : secret "samples-operator-tls" not found Jun 02 13:37:28.797487 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:28.797399 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs podName:fedc3d80-29d5-4bc9-829d-abcbecbbcf5f nodeName:}" failed. No retries permitted until 2026-06-02 13:37:30.797379052 +0000 UTC m=+127.104743616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs") pod "router-default-86658498b7-lrbfc" (UID: "fedc3d80-29d5-4bc9-829d-abcbecbbcf5f") : secret "router-metrics-certs-default" not found Jun 02 13:37:28.797487 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:28.797427 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle podName:fedc3d80-29d5-4bc9-829d-abcbecbbcf5f nodeName:}" failed. No retries permitted until 2026-06-02 13:37:30.797420333 +0000 UTC m=+127.104784896 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle") pod "router-default-86658498b7-lrbfc" (UID: "fedc3d80-29d5-4bc9-829d-abcbecbbcf5f") : configmap references non-existent config key: service-ca.crt Jun 02 13:37:29.619651 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:29.619423 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9l68n" event={"ID":"6a41cad0-8b20-4e6f-9697-93ac76a9225a","Type":"ContainerStarted","Data":"60d392b46c8219994e42891664a43ab34a26d07e422440f9913ca53fb9bd5f84"} Jun 02 13:37:29.633935 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:29.633881 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9l68n" podStartSLOduration=0.967177116 podStartE2EDuration="2.633864811s" podCreationTimestamp="2026-06-02 13:37:27 +0000 UTC" firstStartedPulling="2026-06-02 13:37:27.549942928 +0000 UTC m=+123.857307492" lastFinishedPulling="2026-06-02 13:37:29.21663062 +0000 UTC m=+125.523995187" observedRunningTime="2026-06-02 13:37:29.633700178 +0000 UTC m=+125.941064765" watchObservedRunningTime="2026-06-02 13:37:29.633864811 +0000 UTC m=+125.941229397" Jun 02 13:37:30.714040 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:30.713996 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gnkt8\" (UID: \"b81ad2a5-97a5-452d-beb1-12eb06143da5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" Jun 02 13:37:30.714523 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:30.714185 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 13:37:30.714523 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:30.714266 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls podName:b81ad2a5-97a5-452d-beb1-12eb06143da5 nodeName:}" failed. No retries permitted until 2026-06-02 13:37:34.714245483 +0000 UTC m=+131.021610051 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-gnkt8" (UID: "b81ad2a5-97a5-452d-beb1-12eb06143da5") : secret "cluster-monitoring-operator-tls" not found Jun 02 13:37:30.815019 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:30.814972 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rmzb4\" (UID: \"58239f28-f968-483a-ac96-f5151dc81a6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4" Jun 02 13:37:30.815019 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:30.815022 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:30.815275 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:30.815144 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 13:37:30.815275 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:30.815152 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle podName:fedc3d80-29d5-4bc9-829d-abcbecbbcf5f nodeName:}" failed. No retries permitted until 2026-06-02 13:37:34.815133203 +0000 UTC m=+131.122497768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle") pod "router-default-86658498b7-lrbfc" (UID: "fedc3d80-29d5-4bc9-829d-abcbecbbcf5f") : configmap references non-existent config key: service-ca.crt Jun 02 13:37:30.815418 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:30.815323 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:30.815418 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:30.815338 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls podName:58239f28-f968-483a-ac96-f5151dc81a6d nodeName:}" failed. No retries permitted until 2026-06-02 13:37:34.815317296 +0000 UTC m=+131.122681861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rmzb4" (UID: "58239f28-f968-483a-ac96-f5151dc81a6d") : secret "samples-operator-tls" not found Jun 02 13:37:30.815537 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:30.815420 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 13:37:30.815537 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:30.815460 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs podName:fedc3d80-29d5-4bc9-829d-abcbecbbcf5f nodeName:}" failed. No retries permitted until 2026-06-02 13:37:34.815449405 +0000 UTC m=+131.122813968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs") pod "router-default-86658498b7-lrbfc" (UID: "fedc3d80-29d5-4bc9-829d-abcbecbbcf5f") : secret "router-metrics-certs-default" not found Jun 02 13:37:30.995277 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:30.995192 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2"] Jun 02 13:37:30.997419 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:30.997388 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2" Jun 02 13:37:30.999789 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:30.999762 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 13:37:30.999940 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:30.999869 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 13:37:30.999940 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:30.999869 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6hjlw\"" Jun 02 13:37:31.001012 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:31.000812 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 13:37:31.001012 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:31.000842 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 13:37:31.006661 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:31.006640 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2"] Jun 02 13:37:31.118311 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:31.118283 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e-serving-cert\") pod \"service-ca-operator-69877444c-ssxl2\" (UID: \"9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2" Jun 02 13:37:31.118433 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:31.118315 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e-config\") pod \"service-ca-operator-69877444c-ssxl2\" (UID: \"9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2" Jun 02 13:37:31.118433 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:31.118343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5dfz\" (UniqueName: \"kubernetes.io/projected/9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e-kube-api-access-n5dfz\") pod \"service-ca-operator-69877444c-ssxl2\" (UID: \"9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2" Jun 02 13:37:31.219275 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:31.219241 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e-serving-cert\") pod \"service-ca-operator-69877444c-ssxl2\" (UID: \"9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2" Jun 02 13:37:31.219275 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:31.219281 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e-config\") pod \"service-ca-operator-69877444c-ssxl2\" (UID: \"9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2" Jun 02 13:37:31.219555 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:31.219301 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5dfz\" (UniqueName: \"kubernetes.io/projected/9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e-kube-api-access-n5dfz\") pod \"service-ca-operator-69877444c-ssxl2\" (UID: \"9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2" Jun 02 13:37:31.219792 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:31.219772 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e-config\") pod \"service-ca-operator-69877444c-ssxl2\" (UID: \"9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2" Jun 02 13:37:31.221636 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:31.221614 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e-serving-cert\") pod \"service-ca-operator-69877444c-ssxl2\" (UID: \"9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2" Jun 02 13:37:31.227139 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:31.227114 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5dfz\" (UniqueName: \"kubernetes.io/projected/9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e-kube-api-access-n5dfz\") pod \"service-ca-operator-69877444c-ssxl2\" (UID: \"9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2" Jun 02 13:37:31.308712 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:31.308666 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2" Jun 02 13:37:31.427075 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:31.427041 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2"] Jun 02 13:37:31.430379 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:37:31.430330 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f21eedb_8ea5_4b4e_b00a_4e20d6dd635e.slice/crio-24f7a884c8ce27e9cfacf029f510fed4b16b70a733fb8a44e6e859e49a77eb9f WatchSource:0}: Error finding container 24f7a884c8ce27e9cfacf029f510fed4b16b70a733fb8a44e6e859e49a77eb9f: Status 404 returned error can't find the container with id 24f7a884c8ce27e9cfacf029f510fed4b16b70a733fb8a44e6e859e49a77eb9f Jun 02 13:37:31.624589 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:31.624490 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4" event={"ID":"2a9a73d0-15c2-4604-a9cf-ae254f856b44","Type":"ContainerStarted","Data":"4aa66cd3e3fdb8aeb1db41dc29384510242d8266616d6e1f0c23ff7c4b61b866"} Jun 02 13:37:31.625447 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:31.625420 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2" event={"ID":"9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e","Type":"ContainerStarted","Data":"24f7a884c8ce27e9cfacf029f510fed4b16b70a733fb8a44e6e859e49a77eb9f"} Jun 02 13:37:31.639546 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:31.639506 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4" podStartSLOduration=1.9879203749999999 podStartE2EDuration="4.639494008s" podCreationTimestamp="2026-06-02 13:37:27 +0000 UTC" firstStartedPulling="2026-06-02 13:37:28.441020764 +0000 UTC m=+124.748385327" lastFinishedPulling="2026-06-02 13:37:31.092594397 +0000 UTC m=+127.399958960" observedRunningTime="2026-06-02 13:37:31.639239253 +0000 UTC m=+127.946603839" watchObservedRunningTime="2026-06-02 13:37:31.639494008 +0000 UTC m=+127.946858618" Jun 02 13:37:33.631123 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:33.631083 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2" event={"ID":"9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e","Type":"ContainerStarted","Data":"08900b22dc0502ea43573f697efbb06c537a2cf120efc1f07b41591e35f9af5a"} Jun 02 13:37:33.647777 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:33.647732 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2" podStartSLOduration=1.58326285 podStartE2EDuration="3.6477193s" podCreationTimestamp="2026-06-02 13:37:30 +0000 UTC" firstStartedPulling="2026-06-02 13:37:31.43208379 +0000 UTC m=+127.739448353" lastFinishedPulling="2026-06-02 13:37:33.496540224 +0000 UTC m=+129.803904803" observedRunningTime="2026-06-02 13:37:33.646701438 +0000 UTC m=+129.954066022" watchObservedRunningTime="2026-06-02 13:37:33.6477193 +0000 UTC m=+129.955083903" Jun 02 13:37:34.043557 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:34.043519 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs\") pod \"network-metrics-daemon-lvq7r\" (UID: \"ed3b2b23-30df-4e74-8662-a29c58704801\") " pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:37:34.043699 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:34.043669 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 13:37:34.043754 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:34.043737 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs podName:ed3b2b23-30df-4e74-8662-a29c58704801 nodeName:}" failed. No retries permitted until 2026-06-02 13:39:36.04372079 +0000 UTC m=+252.351085352 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs") pod "network-metrics-daemon-lvq7r" (UID: "ed3b2b23-30df-4e74-8662-a29c58704801") : secret "metrics-daemon-secret" not found Jun 02 13:37:34.177731 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:34.177706 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nlnt5_037c8b1f-f090-4b5a-972c-f681ef9bcff6/dns-node-resolver/0.log" Jun 02 13:37:34.748139 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:34.748094 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gnkt8\" (UID: \"b81ad2a5-97a5-452d-beb1-12eb06143da5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" Jun 02 13:37:34.748642 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:34.748247 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 13:37:34.748642 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:34.748345 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls podName:b81ad2a5-97a5-452d-beb1-12eb06143da5 nodeName:}" failed. No retries permitted until 2026-06-02 13:37:42.748322745 +0000 UTC m=+139.055687308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-gnkt8" (UID: "b81ad2a5-97a5-452d-beb1-12eb06143da5") : secret "cluster-monitoring-operator-tls" not found Jun 02 13:37:34.849065 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:34.849008 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rmzb4\" (UID: \"58239f28-f968-483a-ac96-f5151dc81a6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4" Jun 02 13:37:34.849065 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:34.849067 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:34.849299 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:34.849144 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:34.849299 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:34.849168 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 13:37:34.849299 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:34.849241 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle podName:fedc3d80-29d5-4bc9-829d-abcbecbbcf5f nodeName:}" failed. No retries permitted until 2026-06-02 13:37:42.849219686 +0000 UTC m=+139.156584250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle") pod "router-default-86658498b7-lrbfc" (UID: "fedc3d80-29d5-4bc9-829d-abcbecbbcf5f") : configmap references non-existent config key: service-ca.crt Jun 02 13:37:34.849299 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:34.849257 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls podName:58239f28-f968-483a-ac96-f5151dc81a6d nodeName:}" failed. No retries permitted until 2026-06-02 13:37:42.849251284 +0000 UTC m=+139.156615847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rmzb4" (UID: "58239f28-f968-483a-ac96-f5151dc81a6d") : secret "samples-operator-tls" not found Jun 02 13:37:34.849299 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:34.849283 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 13:37:34.849528 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:34.849344 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs podName:fedc3d80-29d5-4bc9-829d-abcbecbbcf5f nodeName:}" failed. No retries permitted until 2026-06-02 13:37:42.849327089 +0000 UTC m=+139.156691652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs") pod "router-default-86658498b7-lrbfc" (UID: "fedc3d80-29d5-4bc9-829d-abcbecbbcf5f") : secret "router-metrics-certs-default" not found Jun 02 13:37:35.377655 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:35.377628 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nkl7l_9ac71bf8-ef94-4cee-b3aa-07599cf27742/node-ca/0.log" Jun 02 13:37:37.032063 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.032026 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-pstbv"] Jun 02 13:37:37.033675 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.033660 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-pstbv" Jun 02 13:37:37.037050 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.037030 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 02 13:37:37.037159 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.037085 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 02 13:37:37.038071 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.038051 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 02 13:37:37.038169 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.038078 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 02 13:37:37.038169 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.038056 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fffcr\"" Jun 02 13:37:37.043730 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.043684 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-pstbv"] Jun 02 13:37:37.168927 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.168879 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d1843e90-5a14-4d5a-836c-3f99a4400a61-signing-key\") pod \"service-ca-685df94d57-pstbv\" (UID: \"d1843e90-5a14-4d5a-836c-3f99a4400a61\") " pod="openshift-service-ca/service-ca-685df94d57-pstbv" Jun 02 13:37:37.168927 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.168927 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d1843e90-5a14-4d5a-836c-3f99a4400a61-signing-cabundle\") pod \"service-ca-685df94d57-pstbv\" (UID: \"d1843e90-5a14-4d5a-836c-3f99a4400a61\") " pod="openshift-service-ca/service-ca-685df94d57-pstbv" Jun 02 13:37:37.169175 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.168951 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwhhh\" (UniqueName: \"kubernetes.io/projected/d1843e90-5a14-4d5a-836c-3f99a4400a61-kube-api-access-zwhhh\") pod \"service-ca-685df94d57-pstbv\" (UID: \"d1843e90-5a14-4d5a-836c-3f99a4400a61\") " pod="openshift-service-ca/service-ca-685df94d57-pstbv" Jun 02 13:37:37.270299 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.270243 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d1843e90-5a14-4d5a-836c-3f99a4400a61-signing-key\") pod \"service-ca-685df94d57-pstbv\" (UID: \"d1843e90-5a14-4d5a-836c-3f99a4400a61\") " pod="openshift-service-ca/service-ca-685df94d57-pstbv" Jun 02 13:37:37.270299 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.270301 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d1843e90-5a14-4d5a-836c-3f99a4400a61-signing-cabundle\") pod \"service-ca-685df94d57-pstbv\" (UID: \"d1843e90-5a14-4d5a-836c-3f99a4400a61\") " pod="openshift-service-ca/service-ca-685df94d57-pstbv" Jun 02 13:37:37.270567 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.270336 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwhhh\" (UniqueName: \"kubernetes.io/projected/d1843e90-5a14-4d5a-836c-3f99a4400a61-kube-api-access-zwhhh\") pod \"service-ca-685df94d57-pstbv\" (UID: \"d1843e90-5a14-4d5a-836c-3f99a4400a61\") " pod="openshift-service-ca/service-ca-685df94d57-pstbv" Jun 02 13:37:37.271025 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.270992 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d1843e90-5a14-4d5a-836c-3f99a4400a61-signing-cabundle\") pod \"service-ca-685df94d57-pstbv\" (UID: \"d1843e90-5a14-4d5a-836c-3f99a4400a61\") " pod="openshift-service-ca/service-ca-685df94d57-pstbv" Jun 02 13:37:37.272770 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.272751 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d1843e90-5a14-4d5a-836c-3f99a4400a61-signing-key\") pod \"service-ca-685df94d57-pstbv\" (UID: \"d1843e90-5a14-4d5a-836c-3f99a4400a61\") " pod="openshift-service-ca/service-ca-685df94d57-pstbv" Jun 02 13:37:37.278149 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.278127 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwhhh\" (UniqueName: \"kubernetes.io/projected/d1843e90-5a14-4d5a-836c-3f99a4400a61-kube-api-access-zwhhh\") pod \"service-ca-685df94d57-pstbv\" (UID: \"d1843e90-5a14-4d5a-836c-3f99a4400a61\") " pod="openshift-service-ca/service-ca-685df94d57-pstbv" Jun 02 13:37:37.342588 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.342538 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-pstbv" Jun 02 13:37:37.460581 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.460550 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-pstbv"] Jun 02 13:37:37.463751 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:37:37.463725 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1843e90_5a14_4d5a_836c_3f99a4400a61.slice/crio-54bb2b60f0c36cb4780484903979ef5a0a445d33c1bba474851196fe0dc414ec WatchSource:0}: Error finding container 54bb2b60f0c36cb4780484903979ef5a0a445d33c1bba474851196fe0dc414ec: Status 404 returned error can't find the container with id 54bb2b60f0c36cb4780484903979ef5a0a445d33c1bba474851196fe0dc414ec Jun 02 13:37:37.639525 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.639423 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-pstbv" event={"ID":"d1843e90-5a14-4d5a-836c-3f99a4400a61","Type":"ContainerStarted","Data":"3cd1c6d2d60c883808ada777ebe07443ee5ae524e88d6833ae2a44c6f5dd66c3"} Jun 02 13:37:37.639525 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.639467 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-pstbv" event={"ID":"d1843e90-5a14-4d5a-836c-3f99a4400a61","Type":"ContainerStarted","Data":"54bb2b60f0c36cb4780484903979ef5a0a445d33c1bba474851196fe0dc414ec"} Jun 02 13:37:37.656286 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:37.656234 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-pstbv" podStartSLOduration=0.656221159 podStartE2EDuration="656.221159ms" podCreationTimestamp="2026-06-02 13:37:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 13:37:37.65540764 +0000 UTC m=+133.962772225" watchObservedRunningTime="2026-06-02 13:37:37.656221159 +0000 UTC m=+133.963585743" Jun 02 13:37:42.815458 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:42.815420 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gnkt8\" (UID: \"b81ad2a5-97a5-452d-beb1-12eb06143da5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" Jun 02 13:37:42.815954 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:42.815602 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 13:37:42.815954 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:42.815692 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls podName:b81ad2a5-97a5-452d-beb1-12eb06143da5 nodeName:}" failed. No retries permitted until 2026-06-02 13:37:58.815668649 +0000 UTC m=+155.123033212 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-gnkt8" (UID: "b81ad2a5-97a5-452d-beb1-12eb06143da5") : secret "cluster-monitoring-operator-tls" not found Jun 02 13:37:42.916585 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:42.916547 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rmzb4\" (UID: \"58239f28-f968-483a-ac96-f5151dc81a6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4" Jun 02 13:37:42.916585 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:42.916586 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:42.916785 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:42.916704 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle podName:fedc3d80-29d5-4bc9-829d-abcbecbbcf5f nodeName:}" failed. No retries permitted until 2026-06-02 13:37:58.916690039 +0000 UTC m=+155.224054601 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle") pod "router-default-86658498b7-lrbfc" (UID: "fedc3d80-29d5-4bc9-829d-abcbecbbcf5f") : configmap references non-existent config key: service-ca.crt Jun 02 13:37:42.916785 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:42.916738 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:42.917876 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:42.917548 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 13:37:42.917876 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:37:42.917776 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs podName:fedc3d80-29d5-4bc9-829d-abcbecbbcf5f nodeName:}" failed. No retries permitted until 2026-06-02 13:37:58.917738787 +0000 UTC m=+155.225103364 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs") pod "router-default-86658498b7-lrbfc" (UID: "fedc3d80-29d5-4bc9-829d-abcbecbbcf5f") : secret "router-metrics-certs-default" not found Jun 02 13:37:42.921437 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:42.921412 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58239f28-f968-483a-ac96-f5151dc81a6d-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rmzb4\" (UID: \"58239f28-f968-483a-ac96-f5151dc81a6d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4" Jun 02 13:37:43.037119 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:43.037083 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4" Jun 02 13:37:43.160523 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:43.160499 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4"] Jun 02 13:37:43.651795 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:43.651757 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4" event={"ID":"58239f28-f968-483a-ac96-f5151dc81a6d","Type":"ContainerStarted","Data":"a501057a240a78a61a4bb2bdf2b70c1d00b145a1ef1279a44a51ff7bf3bd2309"} Jun 02 13:37:45.658619 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:45.658587 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4" event={"ID":"58239f28-f968-483a-ac96-f5151dc81a6d","Type":"ContainerStarted","Data":"1e5d71e15880eea409739e0a8cec0ad9ec77c25b8a62060830484827877daf11"} Jun 02 13:37:45.658619 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:45.658621 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4" event={"ID":"58239f28-f968-483a-ac96-f5151dc81a6d","Type":"ContainerStarted","Data":"431b15099ddfb1af7373cb0654585aa60ee32508405ec04786a440ec19159c03"} Jun 02 13:37:45.675426 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:45.675353 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rmzb4" podStartSLOduration=16.652819317 podStartE2EDuration="18.675339823s" podCreationTimestamp="2026-06-02 13:37:27 +0000 UTC" firstStartedPulling="2026-06-02 13:37:43.197444159 +0000 UTC m=+139.504808723" lastFinishedPulling="2026-06-02 13:37:45.219964651 +0000 UTC m=+141.527329229" observedRunningTime="2026-06-02 13:37:45.674152638 +0000 UTC m=+141.981517223" watchObservedRunningTime="2026-06-02 13:37:45.675339823 +0000 UTC m=+141.982704408" Jun 02 13:37:58.847338 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:58.847289 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gnkt8\" (UID: \"b81ad2a5-97a5-452d-beb1-12eb06143da5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" Jun 02 13:37:58.849899 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:58.849876 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b81ad2a5-97a5-452d-beb1-12eb06143da5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-gnkt8\" (UID: \"b81ad2a5-97a5-452d-beb1-12eb06143da5\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" Jun 02 13:37:58.898555 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:58.898521 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j5g46"] Jun 02 13:37:58.901166 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:58.901147 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j5g46" Jun 02 13:37:58.903704 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:58.903674 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 13:37:58.903809 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:58.903794 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 13:37:58.904785 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:58.904764 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 13:37:58.904785 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:58.904781 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wmgcc\"" Jun 02 13:37:58.904931 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:58.904836 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 13:37:58.912650 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:58.912628 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j5g46"] Jun 02 13:37:58.948703 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:58.948659 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:58.948870 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:58.948729 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:58.949402 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:58.949333 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-service-ca-bundle\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:58.951289 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:58.951262 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fedc3d80-29d5-4bc9-829d-abcbecbbcf5f-metrics-certs\") pod \"router-default-86658498b7-lrbfc\" (UID: \"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f\") " pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:59.049138 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.049104 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c42bf850-7ec6-45a4-afb4-0a1a4408391b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j5g46\" (UID: \"c42bf850-7ec6-45a4-afb4-0a1a4408391b\") " pod="openshift-insights/insights-runtime-extractor-j5g46" Jun 02 13:37:59.049305 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.049164 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr92s\" (UniqueName: \"kubernetes.io/projected/c42bf850-7ec6-45a4-afb4-0a1a4408391b-kube-api-access-zr92s\") pod \"insights-runtime-extractor-j5g46\" (UID: \"c42bf850-7ec6-45a4-afb4-0a1a4408391b\") " pod="openshift-insights/insights-runtime-extractor-j5g46" Jun 02 13:37:59.049305 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.049263 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c42bf850-7ec6-45a4-afb4-0a1a4408391b-crio-socket\") pod \"insights-runtime-extractor-j5g46\" (UID: \"c42bf850-7ec6-45a4-afb4-0a1a4408391b\") " pod="openshift-insights/insights-runtime-extractor-j5g46" Jun 02 13:37:59.049305 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.049299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c42bf850-7ec6-45a4-afb4-0a1a4408391b-data-volume\") pod \"insights-runtime-extractor-j5g46\" (UID: \"c42bf850-7ec6-45a4-afb4-0a1a4408391b\") " pod="openshift-insights/insights-runtime-extractor-j5g46" Jun 02 13:37:59.049427 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.049324 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c42bf850-7ec6-45a4-afb4-0a1a4408391b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j5g46\" (UID: \"c42bf850-7ec6-45a4-afb4-0a1a4408391b\") " pod="openshift-insights/insights-runtime-extractor-j5g46" Jun 02 13:37:59.122099 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.122011 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" Jun 02 13:37:59.149901 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.149868 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zr92s\" (UniqueName: \"kubernetes.io/projected/c42bf850-7ec6-45a4-afb4-0a1a4408391b-kube-api-access-zr92s\") pod \"insights-runtime-extractor-j5g46\" (UID: \"c42bf850-7ec6-45a4-afb4-0a1a4408391b\") " pod="openshift-insights/insights-runtime-extractor-j5g46" Jun 02 13:37:59.150076 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.149939 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c42bf850-7ec6-45a4-afb4-0a1a4408391b-crio-socket\") pod \"insights-runtime-extractor-j5g46\" (UID: \"c42bf850-7ec6-45a4-afb4-0a1a4408391b\") " pod="openshift-insights/insights-runtime-extractor-j5g46" Jun 02 13:37:59.150076 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.149975 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c42bf850-7ec6-45a4-afb4-0a1a4408391b-data-volume\") pod \"insights-runtime-extractor-j5g46\" (UID: \"c42bf850-7ec6-45a4-afb4-0a1a4408391b\") " pod="openshift-insights/insights-runtime-extractor-j5g46" Jun 02 13:37:59.150076 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.150002 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c42bf850-7ec6-45a4-afb4-0a1a4408391b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j5g46\" (UID: \"c42bf850-7ec6-45a4-afb4-0a1a4408391b\") " pod="openshift-insights/insights-runtime-extractor-j5g46" Jun 02 13:37:59.150076 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.150045 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c42bf850-7ec6-45a4-afb4-0a1a4408391b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j5g46\" (UID: \"c42bf850-7ec6-45a4-afb4-0a1a4408391b\") " pod="openshift-insights/insights-runtime-extractor-j5g46" Jun 02 13:37:59.150229 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.150068 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c42bf850-7ec6-45a4-afb4-0a1a4408391b-crio-socket\") pod \"insights-runtime-extractor-j5g46\" (UID: \"c42bf850-7ec6-45a4-afb4-0a1a4408391b\") " pod="openshift-insights/insights-runtime-extractor-j5g46" Jun 02 13:37:59.150472 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.150449 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c42bf850-7ec6-45a4-afb4-0a1a4408391b-data-volume\") pod \"insights-runtime-extractor-j5g46\" (UID: \"c42bf850-7ec6-45a4-afb4-0a1a4408391b\") " pod="openshift-insights/insights-runtime-extractor-j5g46" Jun 02 13:37:59.150677 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.150660 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c42bf850-7ec6-45a4-afb4-0a1a4408391b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j5g46\" (UID: \"c42bf850-7ec6-45a4-afb4-0a1a4408391b\") " pod="openshift-insights/insights-runtime-extractor-j5g46" Jun 02 13:37:59.152483 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.152464 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c42bf850-7ec6-45a4-afb4-0a1a4408391b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j5g46\" (UID: \"c42bf850-7ec6-45a4-afb4-0a1a4408391b\") " pod="openshift-insights/insights-runtime-extractor-j5g46" Jun 02 13:37:59.158446 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.158422 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr92s\" (UniqueName: \"kubernetes.io/projected/c42bf850-7ec6-45a4-afb4-0a1a4408391b-kube-api-access-zr92s\") pod \"insights-runtime-extractor-j5g46\" (UID: \"c42bf850-7ec6-45a4-afb4-0a1a4408391b\") " pod="openshift-insights/insights-runtime-extractor-j5g46" Jun 02 13:37:59.211254 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.211214 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j5g46" Jun 02 13:37:59.242803 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.242768 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:37:59.255854 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.255804 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8"] Jun 02 13:37:59.258834 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:37:59.258787 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81ad2a5_97a5_452d_beb1_12eb06143da5.slice/crio-445f41fa7b37b7123b1d033b5b8af8d8b55380bddf8ca3e862ab19d77d33b20e WatchSource:0}: Error finding container 445f41fa7b37b7123b1d033b5b8af8d8b55380bddf8ca3e862ab19d77d33b20e: Status 404 returned error can't find the container with id 445f41fa7b37b7123b1d033b5b8af8d8b55380bddf8ca3e862ab19d77d33b20e Jun 02 13:37:59.356746 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.356712 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j5g46"] Jun 02 13:37:59.360118 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:37:59.360079 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc42bf850_7ec6_45a4_afb4_0a1a4408391b.slice/crio-082687dba4141e315b72c8f0961f445c13511ff739d0c314112b520d8ee93826 WatchSource:0}: Error finding container 082687dba4141e315b72c8f0961f445c13511ff739d0c314112b520d8ee93826: Status 404 returned error can't find the container with id 082687dba4141e315b72c8f0961f445c13511ff739d0c314112b520d8ee93826 Jun 02 13:37:59.378952 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.378926 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-86658498b7-lrbfc"] Jun 02 13:37:59.389547 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:37:59.389506 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfedc3d80_29d5_4bc9_829d_abcbecbbcf5f.slice/crio-224b9f2e8bfa7022b7fbb6d9c679f31d4b4f977a7ef96eed9cd5418ff89a11d6 WatchSource:0}: Error finding container 224b9f2e8bfa7022b7fbb6d9c679f31d4b4f977a7ef96eed9cd5418ff89a11d6: Status 404 returned error can't find the container with id 224b9f2e8bfa7022b7fbb6d9c679f31d4b4f977a7ef96eed9cd5418ff89a11d6 Jun 02 13:37:59.695201 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.695118 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86658498b7-lrbfc" event={"ID":"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f","Type":"ContainerStarted","Data":"f8243dcd8d34e0afc07dfcec0ed9684e3cece4530940b98474ec030e117397ae"} Jun 02 13:37:59.695201 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.695153 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-86658498b7-lrbfc" event={"ID":"fedc3d80-29d5-4bc9-829d-abcbecbbcf5f","Type":"ContainerStarted","Data":"224b9f2e8bfa7022b7fbb6d9c679f31d4b4f977a7ef96eed9cd5418ff89a11d6"} Jun 02 13:37:59.696397 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.696352 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j5g46" event={"ID":"c42bf850-7ec6-45a4-afb4-0a1a4408391b","Type":"ContainerStarted","Data":"c29a8940cb5a682c799ebfedd2bd0378b4f6d69c662638ec9c93a16b69346614"} Jun 02 13:37:59.696501 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.696405 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j5g46" event={"ID":"c42bf850-7ec6-45a4-afb4-0a1a4408391b","Type":"ContainerStarted","Data":"082687dba4141e315b72c8f0961f445c13511ff739d0c314112b520d8ee93826"} Jun 02 13:37:59.697220 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.697199 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" event={"ID":"b81ad2a5-97a5-452d-beb1-12eb06143da5","Type":"ContainerStarted","Data":"445f41fa7b37b7123b1d033b5b8af8d8b55380bddf8ca3e862ab19d77d33b20e"} Jun 02 13:37:59.712187 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:37:59.712140 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-86658498b7-lrbfc" podStartSLOduration=32.712126075 podStartE2EDuration="32.712126075s" podCreationTimestamp="2026-06-02 13:37:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 13:37:59.710382839 +0000 UTC m=+156.017747415" watchObservedRunningTime="2026-06-02 13:37:59.712126075 +0000 UTC m=+156.019490661" Jun 02 13:38:00.243098 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:00.243060 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:38:00.248056 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:00.248030 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:38:00.701519 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:00.701472 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j5g46" event={"ID":"c42bf850-7ec6-45a4-afb4-0a1a4408391b","Type":"ContainerStarted","Data":"ff12846367b049b4d0d674a3d9de3d6a7f51c74217c9267ffc80b66b060507b4"} Jun 02 13:38:00.702023 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:00.702002 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:38:00.703492 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:00.703466 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-86658498b7-lrbfc" Jun 02 13:38:02.062942 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:38:02.062897 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mwt7z" podUID="53a5bd7b-7795-4be2-8547-eb90b389c051" Jun 02 13:38:02.083361 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:38:02.083316 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-j4wmd" podUID="d38db827-b14d-4561-8411-d4f9e6a613ab" Jun 02 13:38:02.472101 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:02.472062 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-gtdrr"] Jun 02 13:38:02.474012 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:02.473990 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-gtdrr" Jun 02 13:38:02.476388 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:02.476342 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 13:38:02.476507 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:02.476447 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xqqmb\"" Jun 02 13:38:02.482026 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:02.482006 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-gtdrr"] Jun 02 13:38:02.580274 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:02.580227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7c7048b8-5719-4068-a3eb-87cad5153992-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-gtdrr\" (UID: \"7c7048b8-5719-4068-a3eb-87cad5153992\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-gtdrr" Jun 02 13:38:02.680816 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:02.680771 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7c7048b8-5719-4068-a3eb-87cad5153992-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-gtdrr\" (UID: \"7c7048b8-5719-4068-a3eb-87cad5153992\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-gtdrr" Jun 02 13:38:02.683383 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:02.683340 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7c7048b8-5719-4068-a3eb-87cad5153992-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-gtdrr\" (UID: \"7c7048b8-5719-4068-a3eb-87cad5153992\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-gtdrr" Jun 02 13:38:02.707894 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:02.707851 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" event={"ID":"b81ad2a5-97a5-452d-beb1-12eb06143da5","Type":"ContainerStarted","Data":"1c4cef8f90b66eefcc44bfdf5ab547f9bdc4400ad4faf18a692041b1448bfdc2"} Jun 02 13:38:02.709651 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:02.709625 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j5g46" event={"ID":"c42bf850-7ec6-45a4-afb4-0a1a4408391b","Type":"ContainerStarted","Data":"ed3bdb186e6a95334bb100b89a7a46f9098aab38eabd66f78e7dd30eacbd9636"} Jun 02 13:38:02.709760 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:02.709728 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mwt7z" Jun 02 13:38:02.723321 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:02.723227 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-gnkt8" podStartSLOduration=34.005420686 podStartE2EDuration="36.72321421s" podCreationTimestamp="2026-06-02 13:37:26 +0000 UTC" firstStartedPulling="2026-06-02 13:37:59.260882604 +0000 UTC m=+155.568247185" lastFinishedPulling="2026-06-02 13:38:01.978676143 +0000 UTC m=+158.286040709" observedRunningTime="2026-06-02 13:38:02.722605147 +0000 UTC m=+159.029969731" watchObservedRunningTime="2026-06-02 13:38:02.72321421 +0000 UTC m=+159.030578839" Jun 02 13:38:02.740757 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:02.740704 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j5g46" podStartSLOduration=2.176901113 podStartE2EDuration="4.740690255s" podCreationTimestamp="2026-06-02 13:37:58 +0000 UTC" firstStartedPulling="2026-06-02 13:37:59.413991193 +0000 UTC m=+155.721355755" lastFinishedPulling="2026-06-02 13:38:01.977780327 +0000 UTC m=+158.285144897" observedRunningTime="2026-06-02 13:38:02.739812781 +0000 UTC m=+159.047177378" watchObservedRunningTime="2026-06-02 13:38:02.740690255 +0000 UTC m=+159.048054870" Jun 02 13:38:02.782813 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:02.782776 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-gtdrr" Jun 02 13:38:02.923287 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:02.923254 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-gtdrr"] Jun 02 13:38:02.926267 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:38:02.926234 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c7048b8_5719_4068_a3eb_87cad5153992.slice/crio-4ce075ece2beb1e6a845a1797c6aec39b28d3b6fe94857ed151319b388d3271d WatchSource:0}: Error finding container 4ce075ece2beb1e6a845a1797c6aec39b28d3b6fe94857ed151319b388d3271d: Status 404 returned error can't find the container with id 4ce075ece2beb1e6a845a1797c6aec39b28d3b6fe94857ed151319b388d3271d Jun 02 13:38:03.253434 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:38:03.253384 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lvq7r" podUID="ed3b2b23-30df-4e74-8662-a29c58704801" Jun 02 13:38:03.714039 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:03.713999 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-gtdrr" event={"ID":"7c7048b8-5719-4068-a3eb-87cad5153992","Type":"ContainerStarted","Data":"4ce075ece2beb1e6a845a1797c6aec39b28d3b6fe94857ed151319b388d3271d"} Jun 02 13:38:04.718282 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:04.718198 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-gtdrr" event={"ID":"7c7048b8-5719-4068-a3eb-87cad5153992","Type":"ContainerStarted","Data":"81100aaf4382a48517ba35f4d6c56e9d27434098f16b2899107950050adba747"} Jun 02 13:38:04.718744 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:04.718392 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-gtdrr" Jun 02 13:38:04.722956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:04.722934 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-gtdrr" Jun 02 13:38:04.732837 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:04.732792 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-gtdrr" podStartSLOduration=1.194575398 podStartE2EDuration="2.732778608s" podCreationTimestamp="2026-06-02 13:38:02 +0000 UTC" firstStartedPulling="2026-06-02 13:38:02.928015175 +0000 UTC m=+159.235379739" lastFinishedPulling="2026-06-02 13:38:04.466218384 +0000 UTC m=+160.773582949" observedRunningTime="2026-06-02 13:38:04.732063245 +0000 UTC m=+161.039427830" watchObservedRunningTime="2026-06-02 13:38:04.732778608 +0000 UTC m=+161.040143192" Jun 02 13:38:05.542996 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.542961 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27"] Jun 02 13:38:05.545040 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.545024 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" Jun 02 13:38:05.548387 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.548339 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 13:38:05.548387 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.548355 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xdz87\"" Jun 02 13:38:05.548584 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.548355 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 13:38:05.548584 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.548449 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 13:38:05.552941 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.552916 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27"] Jun 02 13:38:05.618681 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.618637 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/942a4254-2d0b-4bc1-8794-62a8c55f6012-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-dkw27\" (UID: \"942a4254-2d0b-4bc1-8794-62a8c55f6012\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" Jun 02 13:38:05.618860 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.618767 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cnjx\" (UniqueName: \"kubernetes.io/projected/942a4254-2d0b-4bc1-8794-62a8c55f6012-kube-api-access-5cnjx\") pod \"prometheus-operator-658bcd8bdf-dkw27\" (UID: \"942a4254-2d0b-4bc1-8794-62a8c55f6012\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" Jun 02 13:38:05.618860 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.618815 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/942a4254-2d0b-4bc1-8794-62a8c55f6012-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-dkw27\" (UID: \"942a4254-2d0b-4bc1-8794-62a8c55f6012\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" Jun 02 13:38:05.618860 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.618843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/942a4254-2d0b-4bc1-8794-62a8c55f6012-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-dkw27\" (UID: \"942a4254-2d0b-4bc1-8794-62a8c55f6012\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" Jun 02 13:38:05.719271 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.719228 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5cnjx\" (UniqueName: \"kubernetes.io/projected/942a4254-2d0b-4bc1-8794-62a8c55f6012-kube-api-access-5cnjx\") pod \"prometheus-operator-658bcd8bdf-dkw27\" (UID: \"942a4254-2d0b-4bc1-8794-62a8c55f6012\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" Jun 02 13:38:05.719271 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.719276 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/942a4254-2d0b-4bc1-8794-62a8c55f6012-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-dkw27\" (UID: \"942a4254-2d0b-4bc1-8794-62a8c55f6012\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" Jun 02 13:38:05.719868 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.719299 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/942a4254-2d0b-4bc1-8794-62a8c55f6012-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-dkw27\" (UID: \"942a4254-2d0b-4bc1-8794-62a8c55f6012\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" Jun 02 13:38:05.719868 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.719343 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/942a4254-2d0b-4bc1-8794-62a8c55f6012-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-dkw27\" (UID: \"942a4254-2d0b-4bc1-8794-62a8c55f6012\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" Jun 02 13:38:05.720169 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.720149 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/942a4254-2d0b-4bc1-8794-62a8c55f6012-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-dkw27\" (UID: \"942a4254-2d0b-4bc1-8794-62a8c55f6012\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" Jun 02 13:38:05.721935 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.721912 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/942a4254-2d0b-4bc1-8794-62a8c55f6012-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-dkw27\" (UID: \"942a4254-2d0b-4bc1-8794-62a8c55f6012\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" Jun 02 13:38:05.722235 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.722215 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/942a4254-2d0b-4bc1-8794-62a8c55f6012-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-dkw27\" (UID: \"942a4254-2d0b-4bc1-8794-62a8c55f6012\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" Jun 02 13:38:05.726963 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.726939 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cnjx\" (UniqueName: \"kubernetes.io/projected/942a4254-2d0b-4bc1-8794-62a8c55f6012-kube-api-access-5cnjx\") pod \"prometheus-operator-658bcd8bdf-dkw27\" (UID: \"942a4254-2d0b-4bc1-8794-62a8c55f6012\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" Jun 02 13:38:05.855373 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.855331 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" Jun 02 13:38:05.981427 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:05.981398 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27"] Jun 02 13:38:05.984175 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:38:05.984147 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod942a4254_2d0b_4bc1_8794_62a8c55f6012.slice/crio-6f1a6bc3f4f3645ee6ea1721433ca1a73e68d2b8ca4b8f327f8c68de092fa1bc WatchSource:0}: Error finding container 6f1a6bc3f4f3645ee6ea1721433ca1a73e68d2b8ca4b8f327f8c68de092fa1bc: Status 404 returned error can't find the container with id 6f1a6bc3f4f3645ee6ea1721433ca1a73e68d2b8ca4b8f327f8c68de092fa1bc Jun 02 13:38:06.725904 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:06.725865 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" event={"ID":"942a4254-2d0b-4bc1-8794-62a8c55f6012","Type":"ContainerStarted","Data":"6f1a6bc3f4f3645ee6ea1721433ca1a73e68d2b8ca4b8f327f8c68de092fa1bc"} Jun 02 13:38:07.031378 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:07.031262 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:38:07.031539 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:07.031376 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert\") pod \"ingress-canary-j4wmd\" (UID: \"d38db827-b14d-4561-8411-d4f9e6a613ab\") " pod="openshift-ingress-canary/ingress-canary-j4wmd" Jun 02 13:38:07.034230 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:07.034177 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53a5bd7b-7795-4be2-8547-eb90b389c051-metrics-tls\") pod \"dns-default-mwt7z\" (UID: \"53a5bd7b-7795-4be2-8547-eb90b389c051\") " pod="openshift-dns/dns-default-mwt7z" Jun 02 13:38:07.034395 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:07.034286 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d38db827-b14d-4561-8411-d4f9e6a613ab-cert\") pod \"ingress-canary-j4wmd\" (UID: \"d38db827-b14d-4561-8411-d4f9e6a613ab\") " pod="openshift-ingress-canary/ingress-canary-j4wmd" Jun 02 13:38:07.214455 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:07.214432 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5pg95\"" Jun 02 13:38:07.222560 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:07.222539 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mwt7z" Jun 02 13:38:07.359225 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:07.359189 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mwt7z"] Jun 02 13:38:07.363094 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:38:07.363067 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a5bd7b_7795_4be2_8547_eb90b389c051.slice/crio-a018052477dabe9e739235ced9e616c32f987be70def5d6c521e299c01a47060 WatchSource:0}: Error finding container a018052477dabe9e739235ced9e616c32f987be70def5d6c521e299c01a47060: Status 404 returned error can't find the container with id a018052477dabe9e739235ced9e616c32f987be70def5d6c521e299c01a47060 Jun 02 13:38:07.729745 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:07.729713 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mwt7z" event={"ID":"53a5bd7b-7795-4be2-8547-eb90b389c051","Type":"ContainerStarted","Data":"a018052477dabe9e739235ced9e616c32f987be70def5d6c521e299c01a47060"} Jun 02 13:38:07.731153 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:07.731127 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" event={"ID":"942a4254-2d0b-4bc1-8794-62a8c55f6012","Type":"ContainerStarted","Data":"dc2bcfe026f9d8de61d0e18b97351ecb2c155b9c880f718ef492f2db3583dfa4"} Jun 02 13:38:07.731287 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:07.731158 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" event={"ID":"942a4254-2d0b-4bc1-8794-62a8c55f6012","Type":"ContainerStarted","Data":"5cb36aced342fa441f2e06528d0d40f9225d0bdee5545a3d5c9ec80fe1c61cd7"} Jun 02 13:38:07.746741 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:07.746698 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dkw27" podStartSLOduration=1.523650458 podStartE2EDuration="2.746686276s" podCreationTimestamp="2026-06-02 13:38:05 +0000 UTC" firstStartedPulling="2026-06-02 13:38:05.986245407 +0000 UTC m=+162.293609983" lastFinishedPulling="2026-06-02 13:38:07.209281237 +0000 UTC m=+163.516645801" observedRunningTime="2026-06-02 13:38:07.745449112 +0000 UTC m=+164.052813698" watchObservedRunningTime="2026-06-02 13:38:07.746686276 +0000 UTC m=+164.054050860" Jun 02 13:38:08.629475 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.629388 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-f55865766-t72fp"] Jun 02 13:38:08.632983 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.632963 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.635673 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.635530 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 13:38:08.635673 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.635548 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 13:38:08.635673 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.635538 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 13:38:08.635673 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.635588 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 13:38:08.635952 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.635681 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 13:38:08.636575 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.636556 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 13:38:08.636675 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.636583 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-c9f2h\"" Jun 02 13:38:08.636675 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.636632 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 13:38:08.646606 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.645742 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f55865766-t72fp"] Jun 02 13:38:08.647066 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.647042 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 13:38:08.647187 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.647159 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7762ef38-f288-4dfa-99ba-2302e6038f70-console-serving-cert\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.647311 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.647203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7762ef38-f288-4dfa-99ba-2302e6038f70-console-oauth-config\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.647311 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.647270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-service-ca\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.647443 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.647343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-console-config\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.647781 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.647756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-oauth-serving-cert\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.647874 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.647797 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd5qt\" (UniqueName: \"kubernetes.io/projected/7762ef38-f288-4dfa-99ba-2302e6038f70-kube-api-access-jd5qt\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.647874 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.647829 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-trusted-ca-bundle\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.749058 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.748358 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7762ef38-f288-4dfa-99ba-2302e6038f70-console-oauth-config\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.749058 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.748417 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-service-ca\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.749058 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.748448 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-console-config\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.749058 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.748477 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-oauth-serving-cert\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.749058 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.748498 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jd5qt\" (UniqueName: \"kubernetes.io/projected/7762ef38-f288-4dfa-99ba-2302e6038f70-kube-api-access-jd5qt\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.749058 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.748536 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-trusted-ca-bundle\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.749058 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.748627 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7762ef38-f288-4dfa-99ba-2302e6038f70-console-serving-cert\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.749773 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.749287 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-oauth-serving-cert\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.749773 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.749637 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-service-ca\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.750148 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.750124 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-console-config\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.750239 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.750152 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-trusted-ca-bundle\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.752605 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.752581 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7762ef38-f288-4dfa-99ba-2302e6038f70-console-serving-cert\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.752722 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.752606 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7762ef38-f288-4dfa-99ba-2302e6038f70-console-oauth-config\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.757065 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.757042 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd5qt\" (UniqueName: \"kubernetes.io/projected/7762ef38-f288-4dfa-99ba-2302e6038f70-kube-api-access-jd5qt\") pod \"console-f55865766-t72fp\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:08.946960 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:08.946921 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:09.080630 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.080595 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f55865766-t72fp"] Jun 02 13:38:09.084939 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:38:09.084913 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7762ef38_f288_4dfa_99ba_2302e6038f70.slice/crio-59e40f93804376fd6d2a9709ca8a95de85863bfb6e04c985c9eb737759023b26 WatchSource:0}: Error finding container 59e40f93804376fd6d2a9709ca8a95de85863bfb6e04c985c9eb737759023b26: Status 404 returned error can't find the container with id 59e40f93804376fd6d2a9709ca8a95de85863bfb6e04c985c9eb737759023b26 Jun 02 13:38:09.738287 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.738247 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f55865766-t72fp" event={"ID":"7762ef38-f288-4dfa-99ba-2302e6038f70","Type":"ContainerStarted","Data":"59e40f93804376fd6d2a9709ca8a95de85863bfb6e04c985c9eb737759023b26"} Jun 02 13:38:09.740122 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.740087 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mwt7z" event={"ID":"53a5bd7b-7795-4be2-8547-eb90b389c051","Type":"ContainerStarted","Data":"453fcd3ca8377dcf926a988fde679dada88e2eb947dc41bd93624cb4da348848"} Jun 02 13:38:09.740237 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.740125 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mwt7z" event={"ID":"53a5bd7b-7795-4be2-8547-eb90b389c051","Type":"ContainerStarted","Data":"9f12811d87a23193e6aca7d25fd95d2bb73a529ccccfab494473c28be931efeb"} Jun 02 13:38:09.740297 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.740280 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mwt7z" Jun 02 13:38:09.758176 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.758131 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-mwt7z" podStartSLOduration=129.305066121 podStartE2EDuration="2m10.758117473s" podCreationTimestamp="2026-06-02 13:35:59 +0000 UTC" firstStartedPulling="2026-06-02 13:38:07.365111212 +0000 UTC m=+163.672475777" lastFinishedPulling="2026-06-02 13:38:08.818162567 +0000 UTC m=+165.125527129" observedRunningTime="2026-06-02 13:38:09.756825244 +0000 UTC m=+166.064189829" watchObservedRunningTime="2026-06-02 13:38:09.758117473 +0000 UTC m=+166.065482085" Jun 02 13:38:09.874820 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.873280 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-bcwhd"] Jun 02 13:38:09.877888 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.876912 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" Jun 02 13:38:09.880103 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.879502 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rf56h\"" Jun 02 13:38:09.880103 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.879770 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 13:38:09.880103 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.879959 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 13:38:09.899113 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.899057 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-bcwhd"] Jun 02 13:38:09.900022 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.900000 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w44vl"] Jun 02 13:38:09.904202 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.903341 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:09.906598 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.905661 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 13:38:09.906598 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.906007 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vp266\"" Jun 02 13:38:09.906598 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.906212 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 13:38:09.906598 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.906444 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 13:38:09.959302 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.959054 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd53e096-2775-40eb-8018-51a34e96cfbf-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-bcwhd\" (UID: \"cd53e096-2775-40eb-8018-51a34e96cfbf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" Jun 02 13:38:09.959302 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.959107 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-textfile\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:09.959302 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.959134 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-tls\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:09.959302 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.959160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-wtmp\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:09.959302 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.959189 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:09.959302 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.959223 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:09.959302 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.959250 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c87ws\" (UniqueName: \"kubernetes.io/projected/cd53e096-2775-40eb-8018-51a34e96cfbf-kube-api-access-c87ws\") pod \"openshift-state-metrics-85658796db-bcwhd\" (UID: \"cd53e096-2775-40eb-8018-51a34e96cfbf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" Jun 02 13:38:09.960498 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.959333 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnswb\" (UniqueName: \"kubernetes.io/projected/4888357e-23e9-4394-a820-4a67a1bd13b1-kube-api-access-rnswb\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:09.960498 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.959427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd53e096-2775-40eb-8018-51a34e96cfbf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-bcwhd\" (UID: \"cd53e096-2775-40eb-8018-51a34e96cfbf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" Jun 02 13:38:09.960498 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.959472 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4888357e-23e9-4394-a820-4a67a1bd13b1-root\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:09.960498 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.959529 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4888357e-23e9-4394-a820-4a67a1bd13b1-metrics-client-ca\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:09.960498 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.959555 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd53e096-2775-40eb-8018-51a34e96cfbf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-bcwhd\" (UID: \"cd53e096-2775-40eb-8018-51a34e96cfbf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" Jun 02 13:38:09.960498 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:09.959590 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4888357e-23e9-4394-a820-4a67a1bd13b1-sys\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.060884 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.060843 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4888357e-23e9-4394-a820-4a67a1bd13b1-sys\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.061073 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.060916 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd53e096-2775-40eb-8018-51a34e96cfbf-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-bcwhd\" (UID: \"cd53e096-2775-40eb-8018-51a34e96cfbf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" Jun 02 13:38:10.061073 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.060950 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-textfile\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.061073 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.060976 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-tls\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.061073 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.060998 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-wtmp\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.061073 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.061030 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.061073 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.061061 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.061414 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.061089 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c87ws\" (UniqueName: \"kubernetes.io/projected/cd53e096-2775-40eb-8018-51a34e96cfbf-kube-api-access-c87ws\") pod \"openshift-state-metrics-85658796db-bcwhd\" (UID: \"cd53e096-2775-40eb-8018-51a34e96cfbf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" Jun 02 13:38:10.061414 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.061119 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnswb\" (UniqueName: \"kubernetes.io/projected/4888357e-23e9-4394-a820-4a67a1bd13b1-kube-api-access-rnswb\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.061414 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.061152 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd53e096-2775-40eb-8018-51a34e96cfbf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-bcwhd\" (UID: \"cd53e096-2775-40eb-8018-51a34e96cfbf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" Jun 02 13:38:10.061414 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.061197 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4888357e-23e9-4394-a820-4a67a1bd13b1-root\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.061414 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.061237 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4888357e-23e9-4394-a820-4a67a1bd13b1-metrics-client-ca\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.061414 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.061263 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd53e096-2775-40eb-8018-51a34e96cfbf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-bcwhd\" (UID: \"cd53e096-2775-40eb-8018-51a34e96cfbf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" Jun 02 13:38:10.064831 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.062336 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.064831 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.062443 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4888357e-23e9-4394-a820-4a67a1bd13b1-sys\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.064831 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.063271 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd53e096-2775-40eb-8018-51a34e96cfbf-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-bcwhd\" (UID: \"cd53e096-2775-40eb-8018-51a34e96cfbf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" Jun 02 13:38:10.064831 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.063540 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-textfile\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.064831 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:38:10.063634 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 13:38:10.064831 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:38:10.063694 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-tls podName:4888357e-23e9-4394-a820-4a67a1bd13b1 nodeName:}" failed. No retries permitted until 2026-06-02 13:38:10.563674977 +0000 UTC m=+166.871039540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-tls") pod "node-exporter-w44vl" (UID: "4888357e-23e9-4394-a820-4a67a1bd13b1") : secret "node-exporter-tls" not found Jun 02 13:38:10.064831 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.064018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-wtmp\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.064831 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.064523 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4888357e-23e9-4394-a820-4a67a1bd13b1-root\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.065873 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.065248 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4888357e-23e9-4394-a820-4a67a1bd13b1-metrics-client-ca\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.067304 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.067274 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd53e096-2775-40eb-8018-51a34e96cfbf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-bcwhd\" (UID: \"cd53e096-2775-40eb-8018-51a34e96cfbf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" Jun 02 13:38:10.070227 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.069936 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.071402 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.071321 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd53e096-2775-40eb-8018-51a34e96cfbf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-bcwhd\" (UID: \"cd53e096-2775-40eb-8018-51a34e96cfbf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" Jun 02 13:38:10.075263 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.075220 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnswb\" (UniqueName: \"kubernetes.io/projected/4888357e-23e9-4394-a820-4a67a1bd13b1-kube-api-access-rnswb\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.078112 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.078070 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c87ws\" (UniqueName: \"kubernetes.io/projected/cd53e096-2775-40eb-8018-51a34e96cfbf-kube-api-access-c87ws\") pod \"openshift-state-metrics-85658796db-bcwhd\" (UID: \"cd53e096-2775-40eb-8018-51a34e96cfbf\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" Jun 02 13:38:10.200086 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.200048 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" Jun 02 13:38:10.365182 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.365157 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-bcwhd"] Jun 02 13:38:10.367740 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:38:10.367544 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd53e096_2775_40eb_8018_51a34e96cfbf.slice/crio-9462288eff700340bf5f9431764199bd29f34b1fb3633f0bc2cb864144dec00b WatchSource:0}: Error finding container 9462288eff700340bf5f9431764199bd29f34b1fb3633f0bc2cb864144dec00b: Status 404 returned error can't find the container with id 9462288eff700340bf5f9431764199bd29f34b1fb3633f0bc2cb864144dec00b Jun 02 13:38:10.569481 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.569449 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-tls\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.572147 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.572121 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4888357e-23e9-4394-a820-4a67a1bd13b1-node-exporter-tls\") pod \"node-exporter-w44vl\" (UID: \"4888357e-23e9-4394-a820-4a67a1bd13b1\") " pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.744736 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.744659 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" event={"ID":"cd53e096-2775-40eb-8018-51a34e96cfbf","Type":"ContainerStarted","Data":"f542e41a4eb168e3037675c429ce225dd4c250818113184002979ac43b4e8bb7"} Jun 02 13:38:10.744736 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.744700 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" event={"ID":"cd53e096-2775-40eb-8018-51a34e96cfbf","Type":"ContainerStarted","Data":"7502d0f063782813360eefaa2edfe231a2d7330f9d19bb2f1f76fe2d68832281"} Jun 02 13:38:10.744736 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.744713 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" event={"ID":"cd53e096-2775-40eb-8018-51a34e96cfbf","Type":"ContainerStarted","Data":"9462288eff700340bf5f9431764199bd29f34b1fb3633f0bc2cb864144dec00b"} Jun 02 13:38:10.816488 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.816451 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w44vl" Jun 02 13:38:10.984031 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.983990 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 13:38:10.988127 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.988102 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:10.990587 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.990561 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 13:38:10.990795 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.990774 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 13:38:10.990903 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.990840 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 13:38:10.991136 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.990783 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 13:38:10.991136 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.991059 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 13:38:10.991395 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.991354 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2c7pq\"" Jun 02 13:38:10.991476 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.991381 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 13:38:10.991534 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.991477 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 13:38:10.991881 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.991863 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 13:38:10.991988 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:10.991967 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 13:38:11.010977 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.010940 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 13:38:11.074818 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.074781 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d2a9743-6a7b-4913-a201-776b8f45eccf-config-out\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.075014 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.074837 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.075014 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.074873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2a9743-6a7b-4913-a201-776b8f45eccf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.075014 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.074980 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d2a9743-6a7b-4913-a201-776b8f45eccf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.075184 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.075021 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.075184 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.075055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-web-config\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.075184 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.075081 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhpmz\" (UniqueName: \"kubernetes.io/projected/7d2a9743-6a7b-4913-a201-776b8f45eccf-kube-api-access-nhpmz\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.075184 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.075160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.075184 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.075184 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d2a9743-6a7b-4913-a201-776b8f45eccf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.075470 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.075229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.075470 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.075282 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.075470 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.075319 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d2a9743-6a7b-4913-a201-776b8f45eccf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.075470 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.075337 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.176058 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.176024 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d2a9743-6a7b-4913-a201-776b8f45eccf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.176242 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.176070 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.176242 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.176100 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d2a9743-6a7b-4913-a201-776b8f45eccf-config-out\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.176242 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.176130 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.176242 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.176158 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2a9743-6a7b-4913-a201-776b8f45eccf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.176242 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.176197 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d2a9743-6a7b-4913-a201-776b8f45eccf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.176242 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.176222 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.176570 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.176249 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-web-config\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.176570 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.176273 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhpmz\" (UniqueName: \"kubernetes.io/projected/7d2a9743-6a7b-4913-a201-776b8f45eccf-kube-api-access-nhpmz\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.176570 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.176335 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.176570 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.176360 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d2a9743-6a7b-4913-a201-776b8f45eccf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.176570 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.176425 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.176570 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.176464 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.176570 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.176518 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d2a9743-6a7b-4913-a201-776b8f45eccf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.178039 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.177997 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2a9743-6a7b-4913-a201-776b8f45eccf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.178460 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.178433 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d2a9743-6a7b-4913-a201-776b8f45eccf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.181527 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.181223 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.181527 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.181519 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d2a9743-6a7b-4913-a201-776b8f45eccf-config-out\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.181965 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.181521 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.182331 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.182247 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.182922 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.182896 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d2a9743-6a7b-4913-a201-776b8f45eccf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.183073 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.183033 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.183175 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.183082 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.183175 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.183093 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.185437 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.185398 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-web-config\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.185535 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.185499 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhpmz\" (UniqueName: \"kubernetes.io/projected/7d2a9743-6a7b-4913-a201-776b8f45eccf-kube-api-access-nhpmz\") pod \"alertmanager-main-0\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.300394 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.300341 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:38:11.858345 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:38:11.858306 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4888357e_23e9_4394_a820_4a67a1bd13b1.slice/crio-becf61f7cfbed14fdaa42a62dbeb0deed604efcf2c3b7d923330e727ff2a8ddd WatchSource:0}: Error finding container becf61f7cfbed14fdaa42a62dbeb0deed604efcf2c3b7d923330e727ff2a8ddd: Status 404 returned error can't find the container with id becf61f7cfbed14fdaa42a62dbeb0deed604efcf2c3b7d923330e727ff2a8ddd Jun 02 13:38:11.992170 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:11.992145 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 13:38:11.994607 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:38:11.994575 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2a9743_6a7b_4913_a201_776b8f45eccf.slice/crio-a48d47f3086254b554f450a023932bd8d589f7932ba754486c2a7df79b0a68b9 WatchSource:0}: Error finding container a48d47f3086254b554f450a023932bd8d589f7932ba754486c2a7df79b0a68b9: Status 404 returned error can't find the container with id a48d47f3086254b554f450a023932bd8d589f7932ba754486c2a7df79b0a68b9 Jun 02 13:38:12.755983 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:12.755939 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f55865766-t72fp" event={"ID":"7762ef38-f288-4dfa-99ba-2302e6038f70","Type":"ContainerStarted","Data":"45c9215a131c3259cf7f44422cc952ae84e00bf5c7f5fb349bc9ed6b7043b889"} Jun 02 13:38:12.757304 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:12.757277 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d2a9743-6a7b-4913-a201-776b8f45eccf","Type":"ContainerStarted","Data":"a48d47f3086254b554f450a023932bd8d589f7932ba754486c2a7df79b0a68b9"} Jun 02 13:38:12.758459 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:12.758429 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w44vl" event={"ID":"4888357e-23e9-4394-a820-4a67a1bd13b1","Type":"ContainerStarted","Data":"becf61f7cfbed14fdaa42a62dbeb0deed604efcf2c3b7d923330e727ff2a8ddd"} Jun 02 13:38:12.775505 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:12.775455 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-f55865766-t72fp" podStartSLOduration=1.958847609 podStartE2EDuration="4.775440325s" podCreationTimestamp="2026-06-02 13:38:08 +0000 UTC" firstStartedPulling="2026-06-02 13:38:09.086742495 +0000 UTC m=+165.394107071" lastFinishedPulling="2026-06-02 13:38:11.903335221 +0000 UTC m=+168.210699787" observedRunningTime="2026-06-02 13:38:12.772909454 +0000 UTC m=+169.080274039" watchObservedRunningTime="2026-06-02 13:38:12.775440325 +0000 UTC m=+169.082804909" Jun 02 13:38:13.762872 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:13.762841 2578 generic.go:358] "Generic (PLEG): container finished" podID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerID="33b9a18bd94b5eeedfaca4e5c248b4b686162753b3f9bed8307d97931393fe05" exitCode=0 Jun 02 13:38:13.763289 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:13.762913 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d2a9743-6a7b-4913-a201-776b8f45eccf","Type":"ContainerDied","Data":"33b9a18bd94b5eeedfaca4e5c248b4b686162753b3f9bed8307d97931393fe05"} Jun 02 13:38:13.764487 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:13.764457 2578 generic.go:358] "Generic (PLEG): container finished" podID="4888357e-23e9-4394-a820-4a67a1bd13b1" containerID="10e557b8f0ae77c8b154d5c12812164206bef1a4d7e2817edbb38aefde84c6b8" exitCode=0 Jun 02 13:38:13.764608 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:13.764547 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w44vl" event={"ID":"4888357e-23e9-4394-a820-4a67a1bd13b1","Type":"ContainerDied","Data":"10e557b8f0ae77c8b154d5c12812164206bef1a4d7e2817edbb38aefde84c6b8"} Jun 02 13:38:13.766628 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:13.766606 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" event={"ID":"cd53e096-2775-40eb-8018-51a34e96cfbf","Type":"ContainerStarted","Data":"767f7c1ad6db818ad7052a190ec62a8b95b04944ac7f6c4e67904c8ebfd3e957"} Jun 02 13:38:13.802543 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:13.802490 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-bcwhd" podStartSLOduration=2.107611972 podStartE2EDuration="4.802477512s" podCreationTimestamp="2026-06-02 13:38:09 +0000 UTC" firstStartedPulling="2026-06-02 13:38:10.514817909 +0000 UTC m=+166.822182472" lastFinishedPulling="2026-06-02 13:38:13.209683449 +0000 UTC m=+169.517048012" observedRunningTime="2026-06-02 13:38:13.801270896 +0000 UTC m=+170.108635482" watchObservedRunningTime="2026-06-02 13:38:13.802477512 +0000 UTC m=+170.109842097" Jun 02 13:38:14.193037 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.192992 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5dd65878cd-vjl7z"] Jun 02 13:38:14.196179 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.196156 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.198745 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.198718 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 13:38:14.200005 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.199973 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-g6zj2\"" Jun 02 13:38:14.200005 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.199981 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cr1mepkpc6a3c\"" Jun 02 13:38:14.200137 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.199974 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 13:38:14.200137 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.200128 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 13:38:14.200252 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.199973 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 13:38:14.204642 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.204620 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dd65878cd-vjl7z"] Jun 02 13:38:14.245830 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.245811 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j4wmd" Jun 02 13:38:14.248546 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.248528 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qvdp6\"" Jun 02 13:38:14.256550 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.256534 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j4wmd" Jun 02 13:38:14.306766 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.305783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62363fee-6348-481f-97cf-505cc0febdcb-client-ca-bundle\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.306766 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.305836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/62363fee-6348-481f-97cf-505cc0febdcb-metrics-server-audit-profiles\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.306766 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.305891 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/62363fee-6348-481f-97cf-505cc0febdcb-secret-metrics-server-client-certs\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.306766 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.305920 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/62363fee-6348-481f-97cf-505cc0febdcb-audit-log\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.306766 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.305961 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62363fee-6348-481f-97cf-505cc0febdcb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.306766 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.305991 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/62363fee-6348-481f-97cf-505cc0febdcb-secret-metrics-server-tls\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.306766 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.306068 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbsfd\" (UniqueName: \"kubernetes.io/projected/62363fee-6348-481f-97cf-505cc0febdcb-kube-api-access-vbsfd\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.377774 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.377750 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j4wmd"] Jun 02 13:38:14.380067 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:38:14.380036 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd38db827_b14d_4561_8411_d4f9e6a613ab.slice/crio-d22007646e6a6941e6ac96c7f62ebe22b9962e2124164eaa68ff34e6fdcdad84 WatchSource:0}: Error finding container d22007646e6a6941e6ac96c7f62ebe22b9962e2124164eaa68ff34e6fdcdad84: Status 404 returned error can't find the container with id d22007646e6a6941e6ac96c7f62ebe22b9962e2124164eaa68ff34e6fdcdad84 Jun 02 13:38:14.407235 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.407207 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62363fee-6348-481f-97cf-505cc0febdcb-client-ca-bundle\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.407405 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.407243 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/62363fee-6348-481f-97cf-505cc0febdcb-metrics-server-audit-profiles\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.407405 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.407288 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/62363fee-6348-481f-97cf-505cc0febdcb-secret-metrics-server-client-certs\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.407405 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.407360 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/62363fee-6348-481f-97cf-505cc0febdcb-audit-log\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.407575 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.407437 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62363fee-6348-481f-97cf-505cc0febdcb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.407575 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.407476 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/62363fee-6348-481f-97cf-505cc0febdcb-secret-metrics-server-tls\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.407674 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.407578 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbsfd\" (UniqueName: \"kubernetes.io/projected/62363fee-6348-481f-97cf-505cc0febdcb-kube-api-access-vbsfd\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.408387 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.408339 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/62363fee-6348-481f-97cf-505cc0febdcb-metrics-server-audit-profiles\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.408736 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.408717 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/62363fee-6348-481f-97cf-505cc0febdcb-audit-log\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.408910 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.408889 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62363fee-6348-481f-97cf-505cc0febdcb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.410793 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.410768 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/62363fee-6348-481f-97cf-505cc0febdcb-client-ca-bundle\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.411701 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.411672 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/62363fee-6348-481f-97cf-505cc0febdcb-secret-metrics-server-client-certs\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.411800 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.411672 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/62363fee-6348-481f-97cf-505cc0febdcb-secret-metrics-server-tls\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.415321 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.415291 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbsfd\" (UniqueName: \"kubernetes.io/projected/62363fee-6348-481f-97cf-505cc0febdcb-kube-api-access-vbsfd\") pod \"metrics-server-5dd65878cd-vjl7z\" (UID: \"62363fee-6348-481f-97cf-505cc0febdcb\") " pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.506197 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.506117 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:14.641461 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.641421 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dd65878cd-vjl7z"] Jun 02 13:38:14.645237 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:38:14.645134 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62363fee_6348_481f_97cf_505cc0febdcb.slice/crio-f267fcbf1d949807c1576349eb2d93f077ed0d76c4ae2ccbf35db62262043981 WatchSource:0}: Error finding container f267fcbf1d949807c1576349eb2d93f077ed0d76c4ae2ccbf35db62262043981: Status 404 returned error can't find the container with id f267fcbf1d949807c1576349eb2d93f077ed0d76c4ae2ccbf35db62262043981 Jun 02 13:38:14.686245 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.686212 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-cbngg"] Jun 02 13:38:14.691313 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.691293 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cbngg" Jun 02 13:38:14.693543 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.693519 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 13:38:14.694128 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.693702 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-l7mm6\"" Jun 02 13:38:14.694684 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.694654 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-cbngg"] Jun 02 13:38:14.778164 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.778068 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j4wmd" event={"ID":"d38db827-b14d-4561-8411-d4f9e6a613ab","Type":"ContainerStarted","Data":"d22007646e6a6941e6ac96c7f62ebe22b9962e2124164eaa68ff34e6fdcdad84"} Jun 02 13:38:14.779564 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.779530 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" event={"ID":"62363fee-6348-481f-97cf-505cc0febdcb","Type":"ContainerStarted","Data":"f267fcbf1d949807c1576349eb2d93f077ed0d76c4ae2ccbf35db62262043981"} Jun 02 13:38:14.782251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.782226 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w44vl" event={"ID":"4888357e-23e9-4394-a820-4a67a1bd13b1","Type":"ContainerStarted","Data":"6d1aecf109091697eca37e8b4b7869c760588818dfc3ec7d46abf27aac2e0c43"} Jun 02 13:38:14.782352 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.782258 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w44vl" event={"ID":"4888357e-23e9-4394-a820-4a67a1bd13b1","Type":"ContainerStarted","Data":"3690313172b9f7375ffb7ab7e1b9f4093a5a5855a72cc19b12efce21a3267c88"} Jun 02 13:38:14.798689 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.798638 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w44vl" podStartSLOduration=4.449146654 podStartE2EDuration="5.798623929s" podCreationTimestamp="2026-06-02 13:38:09 +0000 UTC" firstStartedPulling="2026-06-02 13:38:11.86025718 +0000 UTC m=+168.167621743" lastFinishedPulling="2026-06-02 13:38:13.209734454 +0000 UTC m=+169.517099018" observedRunningTime="2026-06-02 13:38:14.798344193 +0000 UTC m=+171.105708818" watchObservedRunningTime="2026-06-02 13:38:14.798623929 +0000 UTC m=+171.105988512" Jun 02 13:38:14.810590 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.810557 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00bdc432-ff40-46ed-923e-fc88231bd573-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-cbngg\" (UID: \"00bdc432-ff40-46ed-923e-fc88231bd573\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cbngg" Jun 02 13:38:14.912003 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.911961 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00bdc432-ff40-46ed-923e-fc88231bd573-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-cbngg\" (UID: \"00bdc432-ff40-46ed-923e-fc88231bd573\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cbngg" Jun 02 13:38:14.915262 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:14.915237 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00bdc432-ff40-46ed-923e-fc88231bd573-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-cbngg\" (UID: \"00bdc432-ff40-46ed-923e-fc88231bd573\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cbngg" Jun 02 13:38:15.008288 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.008246 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cbngg" Jun 02 13:38:15.099894 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.099790 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6c678f89b4-x5l7j"] Jun 02 13:38:15.106481 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.106246 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.110052 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.109295 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 13:38:15.110052 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.109322 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 13:38:15.110052 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.109564 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 13:38:15.110052 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.109739 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-85bsc\"" Jun 02 13:38:15.110052 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.109851 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 13:38:15.110052 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.109740 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 13:38:15.119036 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.118885 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 13:38:15.120202 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.120175 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c678f89b4-x5l7j"] Jun 02 13:38:15.173251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.173227 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-cbngg"] Jun 02 13:38:15.215428 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.215399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/234def56-b1e3-4a38-ad3f-980e54e9442d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.215598 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.215495 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/234def56-b1e3-4a38-ad3f-980e54e9442d-federate-client-tls\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.215598 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.215526 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/234def56-b1e3-4a38-ad3f-980e54e9442d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.215721 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.215611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/234def56-b1e3-4a38-ad3f-980e54e9442d-metrics-client-ca\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.215721 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.215649 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wgzd\" (UniqueName: \"kubernetes.io/projected/234def56-b1e3-4a38-ad3f-980e54e9442d-kube-api-access-9wgzd\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.215721 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.215682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/234def56-b1e3-4a38-ad3f-980e54e9442d-telemeter-client-tls\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.215721 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.215709 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/234def56-b1e3-4a38-ad3f-980e54e9442d-serving-certs-ca-bundle\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.215912 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.215732 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/234def56-b1e3-4a38-ad3f-980e54e9442d-secret-telemeter-client\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.316590 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.316504 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/234def56-b1e3-4a38-ad3f-980e54e9442d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.316736 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.316602 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/234def56-b1e3-4a38-ad3f-980e54e9442d-federate-client-tls\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.316736 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.316630 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/234def56-b1e3-4a38-ad3f-980e54e9442d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.316736 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.316691 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/234def56-b1e3-4a38-ad3f-980e54e9442d-metrics-client-ca\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.316736 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.316715 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9wgzd\" (UniqueName: \"kubernetes.io/projected/234def56-b1e3-4a38-ad3f-980e54e9442d-kube-api-access-9wgzd\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.316736 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.316733 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/234def56-b1e3-4a38-ad3f-980e54e9442d-telemeter-client-tls\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.316985 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.316749 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/234def56-b1e3-4a38-ad3f-980e54e9442d-serving-certs-ca-bundle\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.316985 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.316775 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/234def56-b1e3-4a38-ad3f-980e54e9442d-secret-telemeter-client\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.319656 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.317970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/234def56-b1e3-4a38-ad3f-980e54e9442d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.319656 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.319414 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/234def56-b1e3-4a38-ad3f-980e54e9442d-metrics-client-ca\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.320862 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.319966 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/234def56-b1e3-4a38-ad3f-980e54e9442d-secret-telemeter-client\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.320862 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.320630 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/234def56-b1e3-4a38-ad3f-980e54e9442d-serving-certs-ca-bundle\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.324027 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.324002 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/234def56-b1e3-4a38-ad3f-980e54e9442d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.324236 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.324184 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/234def56-b1e3-4a38-ad3f-980e54e9442d-federate-client-tls\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.324975 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.324956 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/234def56-b1e3-4a38-ad3f-980e54e9442d-telemeter-client-tls\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.327615 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.327591 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wgzd\" (UniqueName: \"kubernetes.io/projected/234def56-b1e3-4a38-ad3f-980e54e9442d-kube-api-access-9wgzd\") pod \"telemeter-client-6c678f89b4-x5l7j\" (UID: \"234def56-b1e3-4a38-ad3f-980e54e9442d\") " pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:15.422399 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:15.422121 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" Jun 02 13:38:16.103391 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.102068 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 13:38:16.107299 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.107273 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.111300 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.110872 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 13:38:16.111300 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.110881 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 13:38:16.111300 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.110914 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 13:38:16.111300 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.111031 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 13:38:16.111300 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.111117 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 13:38:16.111300 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.111140 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 13:38:16.111300 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.111198 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 13:38:16.114198 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.113774 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 13:38:16.114877 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.114596 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 13:38:16.114877 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.114670 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 13:38:16.114877 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.114757 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 13:38:16.114877 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.114775 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nkvfv\"" Jun 02 13:38:16.114877 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.114838 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 13:38:16.114877 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.114848 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 13:38:16.115321 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.115298 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-767jh0a6mi5ok\"" Jun 02 13:38:16.207735 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:38:16.207690 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00bdc432_ff40_46ed_923e_fc88231bd573.slice/crio-c849be9d3cee6a2ab66ef35844e96d7c3751d059119ddea38612636eff6c0448 WatchSource:0}: Error finding container c849be9d3cee6a2ab66ef35844e96d7c3751d059119ddea38612636eff6c0448: Status 404 returned error can't find the container with id c849be9d3cee6a2ab66ef35844e96d7c3751d059119ddea38612636eff6c0448 Jun 02 13:38:16.227853 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.227824 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.227853 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.227861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-config\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.228039 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.227883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.228039 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.227905 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.228039 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.227933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.228039 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.228009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27d4d846-21cb-4884-9aa2-d02c99596667-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.228039 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.228038 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27d4d846-21cb-4884-9aa2-d02c99596667-config-out\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.228194 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.228057 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.228194 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.228131 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.228194 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.228153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.228303 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.228192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnkcm\" (UniqueName: \"kubernetes.io/projected/27d4d846-21cb-4884-9aa2-d02c99596667-kube-api-access-cnkcm\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.228303 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.228267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.228398 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.228323 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.228398 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.228343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.228398 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.228385 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.228513 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.228415 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.228513 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.228474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-web-config\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.228513 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.228493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.330700 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.330606 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.330700 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.330666 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.330700 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.330696 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.331017 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.330724 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.331017 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.330746 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.331017 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.330788 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-web-config\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.331017 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.330814 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.331017 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.330853 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.331017 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.330873 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-config\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.331017 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.330888 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.331017 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.330906 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.331017 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.330922 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.331017 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.330953 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27d4d846-21cb-4884-9aa2-d02c99596667-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.331017 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.330971 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27d4d846-21cb-4884-9aa2-d02c99596667-config-out\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.331017 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.330989 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.331528 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.331029 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.331528 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.331049 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.331528 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.331069 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cnkcm\" (UniqueName: \"kubernetes.io/projected/27d4d846-21cb-4884-9aa2-d02c99596667-kube-api-access-cnkcm\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.332720 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.332682 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.333391 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.333345 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.335115 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.334123 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.335115 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.334347 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.335115 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.334787 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.335115 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.334815 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.337020 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.336177 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.337832 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.337606 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.337832 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.337792 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27d4d846-21cb-4884-9aa2-d02c99596667-config-out\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.338053 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.338013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.339049 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.339006 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.339926 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.339905 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27d4d846-21cb-4884-9aa2-d02c99596667-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.340098 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.340008 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.340561 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.340273 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.340561 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.340520 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-config\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.340697 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.340650 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnkcm\" (UniqueName: \"kubernetes.io/projected/27d4d846-21cb-4884-9aa2-d02c99596667-kube-api-access-cnkcm\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.341192 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.341169 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-web-config\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.342058 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.342034 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.423725 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.423637 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:16.797096 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.796880 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cbngg" event={"ID":"00bdc432-ff40-46ed-923e-fc88231bd573","Type":"ContainerStarted","Data":"c849be9d3cee6a2ab66ef35844e96d7c3751d059119ddea38612636eff6c0448"} Jun 02 13:38:16.905593 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.905560 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c678f89b4-x5l7j"] Jun 02 13:38:16.910066 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:38:16.910031 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234def56_b1e3_4a38_ad3f_980e54e9442d.slice/crio-59c5d9e1f398d935697e57e12312bc6fb370a1affaa60e95c4848c44d41d056f WatchSource:0}: Error finding container 59c5d9e1f398d935697e57e12312bc6fb370a1affaa60e95c4848c44d41d056f: Status 404 returned error can't find the container with id 59c5d9e1f398d935697e57e12312bc6fb370a1affaa60e95c4848c44d41d056f Jun 02 13:38:16.931165 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:16.931116 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 13:38:16.936862 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:38:16.936623 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d4d846_21cb_4884_9aa2_d02c99596667.slice/crio-5f7998c51d551bc91fd4fc528fb62d606818d3d1b5d41e10a325d74857fc59c9 WatchSource:0}: Error finding container 5f7998c51d551bc91fd4fc528fb62d606818d3d1b5d41e10a325d74857fc59c9: Status 404 returned error can't find the container with id 5f7998c51d551bc91fd4fc528fb62d606818d3d1b5d41e10a325d74857fc59c9 Jun 02 13:38:17.805129 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:17.805089 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" event={"ID":"234def56-b1e3-4a38-ad3f-980e54e9442d","Type":"ContainerStarted","Data":"59c5d9e1f398d935697e57e12312bc6fb370a1affaa60e95c4848c44d41d056f"} Jun 02 13:38:17.809086 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:17.809055 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d2a9743-6a7b-4913-a201-776b8f45eccf","Type":"ContainerStarted","Data":"e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a"} Jun 02 13:38:17.809205 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:17.809092 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d2a9743-6a7b-4913-a201-776b8f45eccf","Type":"ContainerStarted","Data":"326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d"} Jun 02 13:38:17.809205 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:17.809106 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d2a9743-6a7b-4913-a201-776b8f45eccf","Type":"ContainerStarted","Data":"65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e"} Jun 02 13:38:17.809205 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:17.809120 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d2a9743-6a7b-4913-a201-776b8f45eccf","Type":"ContainerStarted","Data":"32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3"} Jun 02 13:38:17.809205 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:17.809132 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d2a9743-6a7b-4913-a201-776b8f45eccf","Type":"ContainerStarted","Data":"18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c"} Jun 02 13:38:17.810882 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:17.810855 2578 generic.go:358] "Generic (PLEG): container finished" podID="27d4d846-21cb-4884-9aa2-d02c99596667" containerID="868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a" exitCode=0 Jun 02 13:38:17.810994 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:17.810943 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27d4d846-21cb-4884-9aa2-d02c99596667","Type":"ContainerDied","Data":"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a"} Jun 02 13:38:17.810994 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:17.810968 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27d4d846-21cb-4884-9aa2-d02c99596667","Type":"ContainerStarted","Data":"5f7998c51d551bc91fd4fc528fb62d606818d3d1b5d41e10a325d74857fc59c9"} Jun 02 13:38:17.814233 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:17.814207 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" event={"ID":"62363fee-6348-481f-97cf-505cc0febdcb","Type":"ContainerStarted","Data":"9c553ff8e335a501b89b49041610ef607a3e243fab1553ac15256b7b6aa0ea70"} Jun 02 13:38:17.817933 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:17.817906 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j4wmd" event={"ID":"d38db827-b14d-4561-8411-d4f9e6a613ab","Type":"ContainerStarted","Data":"af643970b147046c8a895d703d44894408dcfc54334141ef0b2e96474e80eb39"} Jun 02 13:38:17.852872 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:17.852810 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" podStartSLOduration=1.7608267290000001 podStartE2EDuration="3.852793391s" podCreationTimestamp="2026-06-02 13:38:14 +0000 UTC" firstStartedPulling="2026-06-02 13:38:14.647718104 +0000 UTC m=+170.955082667" lastFinishedPulling="2026-06-02 13:38:16.739684763 +0000 UTC m=+173.047049329" observedRunningTime="2026-06-02 13:38:17.850775544 +0000 UTC m=+174.158140129" watchObservedRunningTime="2026-06-02 13:38:17.852793391 +0000 UTC m=+174.160157976" Jun 02 13:38:17.865124 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:17.865081 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j4wmd" podStartSLOduration=136.508267432 podStartE2EDuration="2m18.865068152s" podCreationTimestamp="2026-06-02 13:35:59 +0000 UTC" firstStartedPulling="2026-06-02 13:38:14.381926251 +0000 UTC m=+170.689290827" lastFinishedPulling="2026-06-02 13:38:16.738726978 +0000 UTC m=+173.046091547" observedRunningTime="2026-06-02 13:38:17.864744675 +0000 UTC m=+174.172109263" watchObservedRunningTime="2026-06-02 13:38:17.865068152 +0000 UTC m=+174.172432756" Jun 02 13:38:18.244688 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:18.244650 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:38:18.823489 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:18.823440 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cbngg" event={"ID":"00bdc432-ff40-46ed-923e-fc88231bd573","Type":"ContainerStarted","Data":"e4eff98ca817fc3da6504dc8db170a417b97bde58ec579d8bf7b3e727eec7083"} Jun 02 13:38:18.823897 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:18.823637 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cbngg" Jun 02 13:38:18.828464 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:18.828432 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d2a9743-6a7b-4913-a201-776b8f45eccf","Type":"ContainerStarted","Data":"3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5"} Jun 02 13:38:18.829773 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:18.829750 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cbngg" Jun 02 13:38:18.838480 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:18.838439 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cbngg" podStartSLOduration=2.845586955 podStartE2EDuration="4.838426059s" podCreationTimestamp="2026-06-02 13:38:14 +0000 UTC" firstStartedPulling="2026-06-02 13:38:16.23386597 +0000 UTC m=+172.541230535" lastFinishedPulling="2026-06-02 13:38:18.226705061 +0000 UTC m=+174.534069639" observedRunningTime="2026-06-02 13:38:18.837412203 +0000 UTC m=+175.144776789" watchObservedRunningTime="2026-06-02 13:38:18.838426059 +0000 UTC m=+175.145790640" Jun 02 13:38:18.891820 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:18.891759 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.660482309 podStartE2EDuration="8.891740583s" podCreationTimestamp="2026-06-02 13:38:10 +0000 UTC" firstStartedPulling="2026-06-02 13:38:11.996612454 +0000 UTC m=+168.303977017" lastFinishedPulling="2026-06-02 13:38:18.227870722 +0000 UTC m=+174.535235291" observedRunningTime="2026-06-02 13:38:18.890802652 +0000 UTC m=+175.198167238" watchObservedRunningTime="2026-06-02 13:38:18.891740583 +0000 UTC m=+175.199105170" Jun 02 13:38:18.948436 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:18.947766 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:18.948436 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:18.947907 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:18.953458 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:18.953429 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:19.748058 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:19.747991 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mwt7z" Jun 02 13:38:19.834488 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:19.834454 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" event={"ID":"234def56-b1e3-4a38-ad3f-980e54e9442d","Type":"ContainerStarted","Data":"fb9684e6028274a3df39110ae9932cd71ce7076dbca947e91fd93fe5462bac40"} Jun 02 13:38:19.834937 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:19.834495 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" event={"ID":"234def56-b1e3-4a38-ad3f-980e54e9442d","Type":"ContainerStarted","Data":"d38cd11d4e72fec779819fe132312e93379b17057119efa9d35403e78e9277cc"} Jun 02 13:38:19.834937 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:19.834516 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" event={"ID":"234def56-b1e3-4a38-ad3f-980e54e9442d","Type":"ContainerStarted","Data":"04290ef403d0a4bf8509ed88a7751b4249b2c1e14a541a545d54c8413aeff153"} Jun 02 13:38:19.840540 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:19.840518 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:19.860977 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:19.860917 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6c678f89b4-x5l7j" podStartSLOduration=2.2965132600000002 podStartE2EDuration="4.860900618s" podCreationTimestamp="2026-06-02 13:38:15 +0000 UTC" firstStartedPulling="2026-06-02 13:38:16.913724107 +0000 UTC m=+173.221088670" lastFinishedPulling="2026-06-02 13:38:19.478111462 +0000 UTC m=+175.785476028" observedRunningTime="2026-06-02 13:38:19.858020805 +0000 UTC m=+176.165385383" watchObservedRunningTime="2026-06-02 13:38:19.860900618 +0000 UTC m=+176.168265202" Jun 02 13:38:21.842939 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:21.842897 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27d4d846-21cb-4884-9aa2-d02c99596667","Type":"ContainerStarted","Data":"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a"} Jun 02 13:38:21.843418 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:21.842948 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27d4d846-21cb-4884-9aa2-d02c99596667","Type":"ContainerStarted","Data":"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e"} Jun 02 13:38:22.849219 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:22.849170 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27d4d846-21cb-4884-9aa2-d02c99596667","Type":"ContainerStarted","Data":"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0"} Jun 02 13:38:22.849219 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:22.849215 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27d4d846-21cb-4884-9aa2-d02c99596667","Type":"ContainerStarted","Data":"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182"} Jun 02 13:38:22.849738 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:22.849228 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27d4d846-21cb-4884-9aa2-d02c99596667","Type":"ContainerStarted","Data":"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5"} Jun 02 13:38:22.849738 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:22.849240 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27d4d846-21cb-4884-9aa2-d02c99596667","Type":"ContainerStarted","Data":"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583"} Jun 02 13:38:22.877188 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:22.877137 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.105965903 podStartE2EDuration="6.877120941s" podCreationTimestamp="2026-06-02 13:38:16 +0000 UTC" firstStartedPulling="2026-06-02 13:38:17.813021291 +0000 UTC m=+174.120385861" lastFinishedPulling="2026-06-02 13:38:22.584176336 +0000 UTC m=+178.891540899" observedRunningTime="2026-06-02 13:38:22.874536096 +0000 UTC m=+179.181900677" watchObservedRunningTime="2026-06-02 13:38:22.877120941 +0000 UTC m=+179.184485525" Jun 02 13:38:23.003674 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:38:23.003619 2578 configmap.go:193] Couldn't get configMap openshift-monitoring/prometheus-k8s-rulefiles-0: configmap "prometheus-k8s-rulefiles-0" not found Jun 02 13:38:23.003842 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:38:23.003697 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-k8s-rulefiles-0 podName:27d4d846-21cb-4884-9aa2-d02c99596667 nodeName:}" failed. No retries permitted until 2026-06-02 13:38:23.503677386 +0000 UTC m=+179.811041950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-k8s-rulefiles-0" (UniqueName: "kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-k8s-rulefiles-0") pod "prometheus-k8s-0" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667") : configmap "prometheus-k8s-rulefiles-0" not found Jun 02 13:38:26.424314 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:26.424269 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:38:31.968550 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:31.968513 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f55865766-t72fp"] Jun 02 13:38:34.506894 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:34.506859 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:34.507311 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:34.506928 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:41.908911 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:41.908871 2578 generic.go:358] "Generic (PLEG): container finished" podID="2a9a73d0-15c2-4604-a9cf-ae254f856b44" containerID="4aa66cd3e3fdb8aeb1db41dc29384510242d8266616d6e1f0c23ff7c4b61b866" exitCode=0 Jun 02 13:38:41.909306 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:41.908943 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4" event={"ID":"2a9a73d0-15c2-4604-a9cf-ae254f856b44","Type":"ContainerDied","Data":"4aa66cd3e3fdb8aeb1db41dc29384510242d8266616d6e1f0c23ff7c4b61b866"} Jun 02 13:38:41.909306 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:41.909251 2578 scope.go:117] "RemoveContainer" containerID="4aa66cd3e3fdb8aeb1db41dc29384510242d8266616d6e1f0c23ff7c4b61b866" Jun 02 13:38:42.913824 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:42.913785 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-p5vp4" event={"ID":"2a9a73d0-15c2-4604-a9cf-ae254f856b44","Type":"ContainerStarted","Data":"27d5abd7cbdda044b294b0b7af168686e84d53d7c5cb51cffd610ac5f8de2f4c"} Jun 02 13:38:54.511808 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:54.511773 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:54.515848 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:54.515822 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5dd65878cd-vjl7z" Jun 02 13:38:54.950726 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:54.950692 2578 generic.go:358] "Generic (PLEG): container finished" podID="9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e" containerID="08900b22dc0502ea43573f697efbb06c537a2cf120efc1f07b41591e35f9af5a" exitCode=0 Jun 02 13:38:54.950894 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:54.950766 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2" event={"ID":"9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e","Type":"ContainerDied","Data":"08900b22dc0502ea43573f697efbb06c537a2cf120efc1f07b41591e35f9af5a"} Jun 02 13:38:54.951175 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:54.951158 2578 scope.go:117] "RemoveContainer" containerID="08900b22dc0502ea43573f697efbb06c537a2cf120efc1f07b41591e35f9af5a" Jun 02 13:38:55.956268 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:55.956223 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-ssxl2" event={"ID":"9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e","Type":"ContainerStarted","Data":"2277e96c504d65d17859d5e5f44f6c78bcd566928164ed41be174d991688564a"} Jun 02 13:38:56.989378 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:56.989305 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-f55865766-t72fp" podUID="7762ef38-f288-4dfa-99ba-2302e6038f70" containerName="console" containerID="cri-o://45c9215a131c3259cf7f44422cc952ae84e00bf5c7f5fb349bc9ed6b7043b889" gracePeriod=15 Jun 02 13:38:57.233933 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.233910 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f55865766-t72fp_7762ef38-f288-4dfa-99ba-2302e6038f70/console/0.log" Jun 02 13:38:57.234053 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.233984 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:57.326618 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.326582 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-console-config\") pod \"7762ef38-f288-4dfa-99ba-2302e6038f70\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " Jun 02 13:38:57.326781 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.326628 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-service-ca\") pod \"7762ef38-f288-4dfa-99ba-2302e6038f70\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " Jun 02 13:38:57.326781 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.326682 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-oauth-serving-cert\") pod \"7762ef38-f288-4dfa-99ba-2302e6038f70\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " Jun 02 13:38:57.326781 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.326700 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jd5qt\" (UniqueName: \"kubernetes.io/projected/7762ef38-f288-4dfa-99ba-2302e6038f70-kube-api-access-jd5qt\") pod \"7762ef38-f288-4dfa-99ba-2302e6038f70\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " Jun 02 13:38:57.326781 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.326724 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7762ef38-f288-4dfa-99ba-2302e6038f70-console-serving-cert\") pod \"7762ef38-f288-4dfa-99ba-2302e6038f70\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " Jun 02 13:38:57.326781 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.326777 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7762ef38-f288-4dfa-99ba-2302e6038f70-console-oauth-config\") pod \"7762ef38-f288-4dfa-99ba-2302e6038f70\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " Jun 02 13:38:57.327032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.326799 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-trusted-ca-bundle\") pod \"7762ef38-f288-4dfa-99ba-2302e6038f70\" (UID: \"7762ef38-f288-4dfa-99ba-2302e6038f70\") " Jun 02 13:38:57.327032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.327002 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-console-config" (OuterVolumeSpecName: "console-config") pod "7762ef38-f288-4dfa-99ba-2302e6038f70" (UID: "7762ef38-f288-4dfa-99ba-2302e6038f70"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 13:38:57.327127 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.327068 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-service-ca" (OuterVolumeSpecName: "service-ca") pod "7762ef38-f288-4dfa-99ba-2302e6038f70" (UID: "7762ef38-f288-4dfa-99ba-2302e6038f70"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 13:38:57.327294 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.327268 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7762ef38-f288-4dfa-99ba-2302e6038f70" (UID: "7762ef38-f288-4dfa-99ba-2302e6038f70"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 13:38:57.327432 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.327345 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7762ef38-f288-4dfa-99ba-2302e6038f70" (UID: "7762ef38-f288-4dfa-99ba-2302e6038f70"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 13:38:57.329201 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.329170 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7762ef38-f288-4dfa-99ba-2302e6038f70-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7762ef38-f288-4dfa-99ba-2302e6038f70" (UID: "7762ef38-f288-4dfa-99ba-2302e6038f70"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:38:57.329201 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.329192 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7762ef38-f288-4dfa-99ba-2302e6038f70-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7762ef38-f288-4dfa-99ba-2302e6038f70" (UID: "7762ef38-f288-4dfa-99ba-2302e6038f70"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:38:57.329314 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.329219 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7762ef38-f288-4dfa-99ba-2302e6038f70-kube-api-access-jd5qt" (OuterVolumeSpecName: "kube-api-access-jd5qt") pod "7762ef38-f288-4dfa-99ba-2302e6038f70" (UID: "7762ef38-f288-4dfa-99ba-2302e6038f70"). InnerVolumeSpecName "kube-api-access-jd5qt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 13:38:57.427829 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.427787 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-trusted-ca-bundle\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:38:57.427829 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.427819 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-console-config\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:38:57.427829 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.427831 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-service-ca\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:38:57.427829 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.427841 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7762ef38-f288-4dfa-99ba-2302e6038f70-oauth-serving-cert\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:38:57.428078 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.427850 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd5qt\" (UniqueName: \"kubernetes.io/projected/7762ef38-f288-4dfa-99ba-2302e6038f70-kube-api-access-jd5qt\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:38:57.428078 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.427859 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7762ef38-f288-4dfa-99ba-2302e6038f70-console-serving-cert\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:38:57.428078 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.427869 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7762ef38-f288-4dfa-99ba-2302e6038f70-console-oauth-config\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:38:57.963555 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.963528 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f55865766-t72fp_7762ef38-f288-4dfa-99ba-2302e6038f70/console/0.log" Jun 02 13:38:57.963720 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.963570 2578 generic.go:358] "Generic (PLEG): container finished" podID="7762ef38-f288-4dfa-99ba-2302e6038f70" containerID="45c9215a131c3259cf7f44422cc952ae84e00bf5c7f5fb349bc9ed6b7043b889" exitCode=2 Jun 02 13:38:57.963720 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.963608 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f55865766-t72fp" event={"ID":"7762ef38-f288-4dfa-99ba-2302e6038f70","Type":"ContainerDied","Data":"45c9215a131c3259cf7f44422cc952ae84e00bf5c7f5fb349bc9ed6b7043b889"} Jun 02 13:38:57.963720 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.963647 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f55865766-t72fp" Jun 02 13:38:57.963720 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.963656 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f55865766-t72fp" event={"ID":"7762ef38-f288-4dfa-99ba-2302e6038f70","Type":"ContainerDied","Data":"59e40f93804376fd6d2a9709ca8a95de85863bfb6e04c985c9eb737759023b26"} Jun 02 13:38:57.963720 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.963674 2578 scope.go:117] "RemoveContainer" containerID="45c9215a131c3259cf7f44422cc952ae84e00bf5c7f5fb349bc9ed6b7043b889" Jun 02 13:38:57.972418 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.972400 2578 scope.go:117] "RemoveContainer" containerID="45c9215a131c3259cf7f44422cc952ae84e00bf5c7f5fb349bc9ed6b7043b889" Jun 02 13:38:57.972676 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:38:57.972656 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45c9215a131c3259cf7f44422cc952ae84e00bf5c7f5fb349bc9ed6b7043b889\": container with ID starting with 45c9215a131c3259cf7f44422cc952ae84e00bf5c7f5fb349bc9ed6b7043b889 not found: ID does not exist" containerID="45c9215a131c3259cf7f44422cc952ae84e00bf5c7f5fb349bc9ed6b7043b889" Jun 02 13:38:57.972739 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.972685 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45c9215a131c3259cf7f44422cc952ae84e00bf5c7f5fb349bc9ed6b7043b889"} err="failed to get container status \"45c9215a131c3259cf7f44422cc952ae84e00bf5c7f5fb349bc9ed6b7043b889\": rpc error: code = NotFound desc = could not find container \"45c9215a131c3259cf7f44422cc952ae84e00bf5c7f5fb349bc9ed6b7043b889\": container with ID starting with 45c9215a131c3259cf7f44422cc952ae84e00bf5c7f5fb349bc9ed6b7043b889 not found: ID does not exist" Jun 02 13:38:57.984273 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.984248 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f55865766-t72fp"] Jun 02 13:38:57.989147 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:57.989124 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f55865766-t72fp"] Jun 02 13:38:58.249563 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:38:58.249486 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7762ef38-f288-4dfa-99ba-2302e6038f70" path="/var/lib/kubelet/pods/7762ef38-f288-4dfa-99ba-2302e6038f70/volumes" Jun 02 13:39:16.424126 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:16.424086 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:16.440944 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:16.440917 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:17.037358 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:17.037332 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:30.206703 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:30.206667 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 13:39:30.207166 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:30.207119 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="alertmanager" containerID="cri-o://18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c" gracePeriod=120 Jun 02 13:39:30.207227 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:30.207179 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="kube-rbac-proxy-metric" containerID="cri-o://e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a" gracePeriod=120 Jun 02 13:39:30.207282 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:30.207223 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="kube-rbac-proxy-web" containerID="cri-o://65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e" gracePeriod=120 Jun 02 13:39:30.207282 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:30.207237 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="kube-rbac-proxy" containerID="cri-o://326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d" gracePeriod=120 Jun 02 13:39:30.207410 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:30.207264 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="config-reloader" containerID="cri-o://32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3" gracePeriod=120 Jun 02 13:39:30.207410 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:30.207286 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="prom-label-proxy" containerID="cri-o://3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5" gracePeriod=120 Jun 02 13:39:31.064031 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.063995 2578 generic.go:358] "Generic (PLEG): container finished" podID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerID="3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5" exitCode=0 Jun 02 13:39:31.064031 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.064020 2578 generic.go:358] "Generic (PLEG): container finished" podID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerID="326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d" exitCode=0 Jun 02 13:39:31.064031 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.064026 2578 generic.go:358] "Generic (PLEG): container finished" podID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerID="32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3" exitCode=0 Jun 02 13:39:31.064031 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.064031 2578 generic.go:358] "Generic (PLEG): container finished" podID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerID="18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c" exitCode=0 Jun 02 13:39:31.064325 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.064062 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d2a9743-6a7b-4913-a201-776b8f45eccf","Type":"ContainerDied","Data":"3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5"} Jun 02 13:39:31.064325 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.064092 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d2a9743-6a7b-4913-a201-776b8f45eccf","Type":"ContainerDied","Data":"326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d"} Jun 02 13:39:31.064325 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.064102 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d2a9743-6a7b-4913-a201-776b8f45eccf","Type":"ContainerDied","Data":"32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3"} Jun 02 13:39:31.064325 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.064111 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d2a9743-6a7b-4913-a201-776b8f45eccf","Type":"ContainerDied","Data":"18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c"} Jun 02 13:39:31.459132 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.459107 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:31.534667 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.534638 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy-web\") pod \"7d2a9743-6a7b-4913-a201-776b8f45eccf\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " Jun 02 13:39:31.534802 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.534674 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy\") pod \"7d2a9743-6a7b-4913-a201-776b8f45eccf\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " Jun 02 13:39:31.534802 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.534696 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-config-volume\") pod \"7d2a9743-6a7b-4913-a201-776b8f45eccf\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " Jun 02 13:39:31.534802 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.534725 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-web-config\") pod \"7d2a9743-6a7b-4913-a201-776b8f45eccf\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " Jun 02 13:39:31.534802 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.534784 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d2a9743-6a7b-4913-a201-776b8f45eccf-config-out\") pod \"7d2a9743-6a7b-4913-a201-776b8f45eccf\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " Jun 02 13:39:31.535005 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.534807 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d2a9743-6a7b-4913-a201-776b8f45eccf-tls-assets\") pod \"7d2a9743-6a7b-4913-a201-776b8f45eccf\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " Jun 02 13:39:31.535005 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.534829 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhpmz\" (UniqueName: \"kubernetes.io/projected/7d2a9743-6a7b-4913-a201-776b8f45eccf-kube-api-access-nhpmz\") pod \"7d2a9743-6a7b-4913-a201-776b8f45eccf\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " Jun 02 13:39:31.535005 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.534853 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d2a9743-6a7b-4913-a201-776b8f45eccf-metrics-client-ca\") pod \"7d2a9743-6a7b-4913-a201-776b8f45eccf\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " Jun 02 13:39:31.535005 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.534914 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-cluster-tls-config\") pod \"7d2a9743-6a7b-4913-a201-776b8f45eccf\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " Jun 02 13:39:31.535005 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.534940 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2a9743-6a7b-4913-a201-776b8f45eccf-alertmanager-trusted-ca-bundle\") pod \"7d2a9743-6a7b-4913-a201-776b8f45eccf\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " Jun 02 13:39:31.535406 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.535352 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d2a9743-6a7b-4913-a201-776b8f45eccf-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7d2a9743-6a7b-4913-a201-776b8f45eccf" (UID: "7d2a9743-6a7b-4913-a201-776b8f45eccf"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 13:39:31.536126 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.535743 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-main-tls\") pod \"7d2a9743-6a7b-4913-a201-776b8f45eccf\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " Jun 02 13:39:31.536126 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.535793 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7d2a9743-6a7b-4913-a201-776b8f45eccf\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " Jun 02 13:39:31.536126 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.535840 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d2a9743-6a7b-4913-a201-776b8f45eccf-alertmanager-main-db\") pod \"7d2a9743-6a7b-4913-a201-776b8f45eccf\" (UID: \"7d2a9743-6a7b-4913-a201-776b8f45eccf\") " Jun 02 13:39:31.536126 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.535902 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d2a9743-6a7b-4913-a201-776b8f45eccf-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7d2a9743-6a7b-4913-a201-776b8f45eccf" (UID: "7d2a9743-6a7b-4913-a201-776b8f45eccf"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 13:39:31.536392 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.536204 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d2a9743-6a7b-4913-a201-776b8f45eccf-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7d2a9743-6a7b-4913-a201-776b8f45eccf" (UID: "7d2a9743-6a7b-4913-a201-776b8f45eccf"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 13:39:31.536392 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.536274 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d2a9743-6a7b-4913-a201-776b8f45eccf-metrics-client-ca\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:31.536392 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.536297 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d2a9743-6a7b-4913-a201-776b8f45eccf-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:31.538739 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.538381 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7d2a9743-6a7b-4913-a201-776b8f45eccf" (UID: "7d2a9743-6a7b-4913-a201-776b8f45eccf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:39:31.538739 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.538660 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d2a9743-6a7b-4913-a201-776b8f45eccf-config-out" (OuterVolumeSpecName: "config-out") pod "7d2a9743-6a7b-4913-a201-776b8f45eccf" (UID: "7d2a9743-6a7b-4913-a201-776b8f45eccf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 13:39:31.538739 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.538683 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7d2a9743-6a7b-4913-a201-776b8f45eccf" (UID: "7d2a9743-6a7b-4913-a201-776b8f45eccf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:39:31.538739 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.538697 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d2a9743-6a7b-4913-a201-776b8f45eccf-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7d2a9743-6a7b-4913-a201-776b8f45eccf" (UID: "7d2a9743-6a7b-4913-a201-776b8f45eccf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 13:39:31.539008 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.538749 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7d2a9743-6a7b-4913-a201-776b8f45eccf" (UID: "7d2a9743-6a7b-4913-a201-776b8f45eccf"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:39:31.539008 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.538970 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-config-volume" (OuterVolumeSpecName: "config-volume") pod "7d2a9743-6a7b-4913-a201-776b8f45eccf" (UID: "7d2a9743-6a7b-4913-a201-776b8f45eccf"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:39:31.539120 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.539054 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d2a9743-6a7b-4913-a201-776b8f45eccf-kube-api-access-nhpmz" (OuterVolumeSpecName: "kube-api-access-nhpmz") pod "7d2a9743-6a7b-4913-a201-776b8f45eccf" (UID: "7d2a9743-6a7b-4913-a201-776b8f45eccf"). InnerVolumeSpecName "kube-api-access-nhpmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 13:39:31.539638 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.539609 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7d2a9743-6a7b-4913-a201-776b8f45eccf" (UID: "7d2a9743-6a7b-4913-a201-776b8f45eccf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:39:31.543049 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.543016 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7d2a9743-6a7b-4913-a201-776b8f45eccf" (UID: "7d2a9743-6a7b-4913-a201-776b8f45eccf"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:39:31.550410 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.550389 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-web-config" (OuterVolumeSpecName: "web-config") pod "7d2a9743-6a7b-4913-a201-776b8f45eccf" (UID: "7d2a9743-6a7b-4913-a201-776b8f45eccf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:39:31.636818 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.636730 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d2a9743-6a7b-4913-a201-776b8f45eccf-config-out\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:31.636818 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.636762 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d2a9743-6a7b-4913-a201-776b8f45eccf-tls-assets\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:31.636818 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.636772 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhpmz\" (UniqueName: \"kubernetes.io/projected/7d2a9743-6a7b-4913-a201-776b8f45eccf-kube-api-access-nhpmz\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:31.636818 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.636782 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-cluster-tls-config\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:31.636818 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.636791 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-main-tls\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:31.636818 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.636801 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:31.636818 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.636811 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d2a9743-6a7b-4913-a201-776b8f45eccf-alertmanager-main-db\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:31.636818 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.636821 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:31.637169 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.636831 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:31.637169 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.636840 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-config-volume\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:31.637169 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:31.636849 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d2a9743-6a7b-4913-a201-776b8f45eccf-web-config\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:32.069920 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.069880 2578 generic.go:358] "Generic (PLEG): container finished" podID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerID="e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a" exitCode=0 Jun 02 13:39:32.069920 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.069913 2578 generic.go:358] "Generic (PLEG): container finished" podID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerID="65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e" exitCode=0 Jun 02 13:39:32.070118 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.069961 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d2a9743-6a7b-4913-a201-776b8f45eccf","Type":"ContainerDied","Data":"e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a"} Jun 02 13:39:32.070118 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.069980 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.070118 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.070000 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d2a9743-6a7b-4913-a201-776b8f45eccf","Type":"ContainerDied","Data":"65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e"} Jun 02 13:39:32.070118 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.070012 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d2a9743-6a7b-4913-a201-776b8f45eccf","Type":"ContainerDied","Data":"a48d47f3086254b554f450a023932bd8d589f7932ba754486c2a7df79b0a68b9"} Jun 02 13:39:32.070118 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.070027 2578 scope.go:117] "RemoveContainer" containerID="3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5" Jun 02 13:39:32.077640 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.077543 2578 scope.go:117] "RemoveContainer" containerID="e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a" Jun 02 13:39:32.084302 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.084286 2578 scope.go:117] "RemoveContainer" containerID="326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d" Jun 02 13:39:32.091552 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.091258 2578 scope.go:117] "RemoveContainer" containerID="65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e" Jun 02 13:39:32.092769 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.092750 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 13:39:32.095415 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.095394 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 13:39:32.099016 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.098999 2578 scope.go:117] "RemoveContainer" containerID="32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3" Jun 02 13:39:32.106096 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.106069 2578 scope.go:117] "RemoveContainer" containerID="18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c" Jun 02 13:39:32.112847 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.112828 2578 scope.go:117] "RemoveContainer" containerID="33b9a18bd94b5eeedfaca4e5c248b4b686162753b3f9bed8307d97931393fe05" Jun 02 13:39:32.117613 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.117593 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 13:39:32.117911 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.117896 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="config-reloader" Jun 02 13:39:32.117911 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.117911 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="config-reloader" Jun 02 13:39:32.118032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.117920 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="kube-rbac-proxy" Jun 02 13:39:32.118032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.117926 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="kube-rbac-proxy" Jun 02 13:39:32.118032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.117932 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="alertmanager" Jun 02 13:39:32.118032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.117937 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="alertmanager" Jun 02 13:39:32.118032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.117944 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="kube-rbac-proxy-web" Jun 02 13:39:32.118032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.117950 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="kube-rbac-proxy-web" Jun 02 13:39:32.118032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.117962 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7762ef38-f288-4dfa-99ba-2302e6038f70" containerName="console" Jun 02 13:39:32.118032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.117968 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7762ef38-f288-4dfa-99ba-2302e6038f70" containerName="console" Jun 02 13:39:32.118032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.117975 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="prom-label-proxy" Jun 02 13:39:32.118032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.117980 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="prom-label-proxy" Jun 02 13:39:32.118032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.117988 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="kube-rbac-proxy-metric" Jun 02 13:39:32.118032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.117992 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="kube-rbac-proxy-metric" Jun 02 13:39:32.118032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.117999 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="init-config-reloader" Jun 02 13:39:32.118032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.118004 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="init-config-reloader" Jun 02 13:39:32.118737 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.118052 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="alertmanager" Jun 02 13:39:32.118737 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.118061 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="kube-rbac-proxy" Jun 02 13:39:32.118737 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.118068 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="kube-rbac-proxy-metric" Jun 02 13:39:32.118737 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.118074 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="config-reloader" Jun 02 13:39:32.118737 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.118081 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="7762ef38-f288-4dfa-99ba-2302e6038f70" containerName="console" Jun 02 13:39:32.118737 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.118088 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="prom-label-proxy" Jun 02 13:39:32.118737 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.118094 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" containerName="kube-rbac-proxy-web" Jun 02 13:39:32.120596 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.120574 2578 scope.go:117] "RemoveContainer" containerID="3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5" Jun 02 13:39:32.120857 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:39:32.120840 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5\": container with ID starting with 3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5 not found: ID does not exist" containerID="3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5" Jun 02 13:39:32.120904 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.120867 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5"} err="failed to get container status \"3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5\": rpc error: code = NotFound desc = could not find container \"3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5\": container with ID starting with 3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5 not found: ID does not exist" Jun 02 13:39:32.120904 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.120886 2578 scope.go:117] "RemoveContainer" containerID="e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a" Jun 02 13:39:32.121109 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:39:32.121083 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a\": container with ID starting with e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a not found: ID does not exist" containerID="e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a" Jun 02 13:39:32.121148 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.121116 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a"} err="failed to get container status \"e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a\": rpc error: code = NotFound desc = could not find container \"e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a\": container with ID starting with e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a not found: ID does not exist" Jun 02 13:39:32.121148 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.121132 2578 scope.go:117] "RemoveContainer" containerID="326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d" Jun 02 13:39:32.121325 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:39:32.121312 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d\": container with ID starting with 326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d not found: ID does not exist" containerID="326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d" Jun 02 13:39:32.121360 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.121332 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d"} err="failed to get container status \"326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d\": rpc error: code = NotFound desc = could not find container \"326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d\": container with ID starting with 326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d not found: ID does not exist" Jun 02 13:39:32.121360 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.121350 2578 scope.go:117] "RemoveContainer" containerID="65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e" Jun 02 13:39:32.121603 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:39:32.121579 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e\": container with ID starting with 65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e not found: ID does not exist" containerID="65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e" Jun 02 13:39:32.121659 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.121613 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e"} err="failed to get container status \"65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e\": rpc error: code = NotFound desc = could not find container \"65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e\": container with ID starting with 65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e not found: ID does not exist" Jun 02 13:39:32.121659 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.121626 2578 scope.go:117] "RemoveContainer" containerID="32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3" Jun 02 13:39:32.121859 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:39:32.121844 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3\": container with ID starting with 32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3 not found: ID does not exist" containerID="32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3" Jun 02 13:39:32.121893 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.121864 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3"} err="failed to get container status \"32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3\": rpc error: code = NotFound desc = could not find container \"32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3\": container with ID starting with 32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3 not found: ID does not exist" Jun 02 13:39:32.121893 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.121883 2578 scope.go:117] "RemoveContainer" containerID="18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c" Jun 02 13:39:32.122097 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:39:32.122084 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c\": container with ID starting with 18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c not found: ID does not exist" containerID="18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c" Jun 02 13:39:32.122142 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.122101 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c"} err="failed to get container status \"18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c\": rpc error: code = NotFound desc = could not find container \"18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c\": container with ID starting with 18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c not found: ID does not exist" Jun 02 13:39:32.122142 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.122113 2578 scope.go:117] "RemoveContainer" containerID="33b9a18bd94b5eeedfaca4e5c248b4b686162753b3f9bed8307d97931393fe05" Jun 02 13:39:32.122303 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:39:32.122288 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33b9a18bd94b5eeedfaca4e5c248b4b686162753b3f9bed8307d97931393fe05\": container with ID starting with 33b9a18bd94b5eeedfaca4e5c248b4b686162753b3f9bed8307d97931393fe05 not found: ID does not exist" containerID="33b9a18bd94b5eeedfaca4e5c248b4b686162753b3f9bed8307d97931393fe05" Jun 02 13:39:32.122339 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.122310 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33b9a18bd94b5eeedfaca4e5c248b4b686162753b3f9bed8307d97931393fe05"} err="failed to get container status \"33b9a18bd94b5eeedfaca4e5c248b4b686162753b3f9bed8307d97931393fe05\": rpc error: code = NotFound desc = could not find container \"33b9a18bd94b5eeedfaca4e5c248b4b686162753b3f9bed8307d97931393fe05\": container with ID starting with 33b9a18bd94b5eeedfaca4e5c248b4b686162753b3f9bed8307d97931393fe05 not found: ID does not exist" Jun 02 13:39:32.122339 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.122324 2578 scope.go:117] "RemoveContainer" containerID="3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5" Jun 02 13:39:32.122532 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.122512 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5"} err="failed to get container status \"3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5\": rpc error: code = NotFound desc = could not find container \"3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5\": container with ID starting with 3b904ebf749493ddb286bc7e5305e45a7a667669c5de03f57a0420b552e6b7e5 not found: ID does not exist" Jun 02 13:39:32.122570 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.122533 2578 scope.go:117] "RemoveContainer" containerID="e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a" Jun 02 13:39:32.122775 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.122757 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a"} err="failed to get container status \"e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a\": rpc error: code = NotFound desc = could not find container \"e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a\": container with ID starting with e1f4d3a0e9a9e6354e443c11ce7d58edf507239ce0e4f4c9679128122cd1448a not found: ID does not exist" Jun 02 13:39:32.122812 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.122777 2578 scope.go:117] "RemoveContainer" containerID="326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d" Jun 02 13:39:32.122999 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.122972 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d"} err="failed to get container status \"326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d\": rpc error: code = NotFound desc = could not find container \"326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d\": container with ID starting with 326c6bc73b55e924ddadac1cef7d8a06262ebb7d3455c40790de5e4daee22d5d not found: ID does not exist" Jun 02 13:39:32.122999 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.122994 2578 scope.go:117] "RemoveContainer" containerID="65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e" Jun 02 13:39:32.123160 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.123150 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.123209 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.123200 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e"} err="failed to get container status \"65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e\": rpc error: code = NotFound desc = could not find container \"65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e\": container with ID starting with 65e00cecbf9e3d3e498e97935902071d5bf5bd38e486d44268b96fcf6bf0251e not found: ID does not exist" Jun 02 13:39:32.123248 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.123211 2578 scope.go:117] "RemoveContainer" containerID="32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3" Jun 02 13:39:32.123629 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.123441 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3"} err="failed to get container status \"32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3\": rpc error: code = NotFound desc = could not find container \"32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3\": container with ID starting with 32e742a4c013a15466a672f5c524545bf2f97a3a40d574bb2b2061cfe74002f3 not found: ID does not exist" Jun 02 13:39:32.123629 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.123500 2578 scope.go:117] "RemoveContainer" containerID="18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c" Jun 02 13:39:32.123856 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.123835 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c"} err="failed to get container status \"18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c\": rpc error: code = NotFound desc = could not find container \"18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c\": container with ID starting with 18ed1486db16d30f47870b1ae0569c7ec222598179b3b219193f045c69b1ee0c not found: ID does not exist" Jun 02 13:39:32.123856 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.123856 2578 scope.go:117] "RemoveContainer" containerID="33b9a18bd94b5eeedfaca4e5c248b4b686162753b3f9bed8307d97931393fe05" Jun 02 13:39:32.124080 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.124056 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33b9a18bd94b5eeedfaca4e5c248b4b686162753b3f9bed8307d97931393fe05"} err="failed to get container status \"33b9a18bd94b5eeedfaca4e5c248b4b686162753b3f9bed8307d97931393fe05\": rpc error: code = NotFound desc = could not find container \"33b9a18bd94b5eeedfaca4e5c248b4b686162753b3f9bed8307d97931393fe05\": container with ID starting with 33b9a18bd94b5eeedfaca4e5c248b4b686162753b3f9bed8307d97931393fe05 not found: ID does not exist" Jun 02 13:39:32.125739 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.125716 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 13:39:32.125858 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.125784 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2c7pq\"" Jun 02 13:39:32.125858 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.125789 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 13:39:32.125858 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.125792 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 13:39:32.126140 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.126122 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 13:39:32.126217 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.126120 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 13:39:32.126217 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.126159 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 13:39:32.126217 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.126162 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 13:39:32.126481 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.126466 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 13:39:32.131610 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.131579 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 13:39:32.132811 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.132792 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 13:39:32.140358 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.140338 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-config-out\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.140495 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.140388 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.140495 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.140446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-web-config\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.140495 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.140464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.140495 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.140483 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.140658 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.140511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.140658 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.140563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.140658 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.140592 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.140658 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.140614 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.140658 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.140639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.140823 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.140686 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.140823 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.140725 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.140823 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.140757 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpw7n\" (UniqueName: \"kubernetes.io/projected/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-kube-api-access-xpw7n\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.241664 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.241621 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-web-config\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.241664 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.241661 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.241912 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.241694 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.241912 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.241723 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.241912 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.241781 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.241912 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.241814 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.241912 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.241845 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.241912 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.241875 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.242204 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.241907 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.242204 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.241956 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.242204 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.241981 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpw7n\" (UniqueName: \"kubernetes.io/projected/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-kube-api-access-xpw7n\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.242204 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.242037 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-config-out\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.242204 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.242086 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.242204 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.242198 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.243273 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.243197 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.243626 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.243601 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.246340 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.245938 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.246340 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.246005 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.246340 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.246238 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.246568 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.246400 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.246568 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.246435 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-config-out\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.246568 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.246498 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.251773 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.251747 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.251885 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.251771 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.251885 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.251802 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-web-config\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.254121 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.254096 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d2a9743-6a7b-4913-a201-776b8f45eccf" path="/var/lib/kubelet/pods/7d2a9743-6a7b-4913-a201-776b8f45eccf/volumes" Jun 02 13:39:32.255514 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.255495 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpw7n\" (UniqueName: \"kubernetes.io/projected/1bb7cfde-8f55-499d-9bad-c629bf4d1dc5-kube-api-access-xpw7n\") pod \"alertmanager-main-0\" (UID: \"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.433897 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.433803 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 13:39:32.564894 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:32.564760 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 13:39:32.567703 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:39:32.567672 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb7cfde_8f55_499d_9bad_c629bf4d1dc5.slice/crio-6fbb46d24b8b10928261eb88a84eaa969651fd5132bee28887f44995c6ef1544 WatchSource:0}: Error finding container 6fbb46d24b8b10928261eb88a84eaa969651fd5132bee28887f44995c6ef1544: Status 404 returned error can't find the container with id 6fbb46d24b8b10928261eb88a84eaa969651fd5132bee28887f44995c6ef1544 Jun 02 13:39:33.075344 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:33.075306 2578 generic.go:358] "Generic (PLEG): container finished" podID="1bb7cfde-8f55-499d-9bad-c629bf4d1dc5" containerID="bdb404ccb30ff38e0f30834f084bddbb7ecdf2c2d4053d73cec3419865c65f80" exitCode=0 Jun 02 13:39:33.075535 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:33.075394 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5","Type":"ContainerDied","Data":"bdb404ccb30ff38e0f30834f084bddbb7ecdf2c2d4053d73cec3419865c65f80"} Jun 02 13:39:33.075535 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:33.075427 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5","Type":"ContainerStarted","Data":"6fbb46d24b8b10928261eb88a84eaa969651fd5132bee28887f44995c6ef1544"} Jun 02 13:39:34.083661 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.083620 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5","Type":"ContainerStarted","Data":"0782cc38ad6aa88961f214e87f82a631d69d7bb5b907bb7501d87526f9cb7181"} Jun 02 13:39:34.083661 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.083656 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5","Type":"ContainerStarted","Data":"0d7883e6dfdb58177e643fb579ba3bb94c1bbf28b2538c91caa4b0fa46d30697"} Jun 02 13:39:34.083661 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.083667 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5","Type":"ContainerStarted","Data":"631e03265aaa22b4b4a33c4a94dc30a327a69364514c4b0348e8b20a68e10257"} Jun 02 13:39:34.084096 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.083677 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5","Type":"ContainerStarted","Data":"2a3afb72fc794ba9264a5408b583220f377d82e5d7088ee9aede1115d6083b64"} Jun 02 13:39:34.084096 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.083685 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5","Type":"ContainerStarted","Data":"bd1e947bf29da15310bb0c670b4adcc0c2a26b30230dc033571f98d970de260e"} Jun 02 13:39:34.084096 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.083692 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bb7cfde-8f55-499d-9bad-c629bf4d1dc5","Type":"ContainerStarted","Data":"90b93a293e3ce7324dcb96c981213acc6bde63629890333ca6466f25a0697c0a"} Jun 02 13:39:34.111077 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.111027 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.111012491 podStartE2EDuration="2.111012491s" podCreationTimestamp="2026-06-02 13:39:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 13:39:34.108986096 +0000 UTC m=+250.416350685" watchObservedRunningTime="2026-06-02 13:39:34.111012491 +0000 UTC m=+250.418377094" Jun 02 13:39:34.443891 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.443798 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 13:39:34.444303 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.444268 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="prometheus" containerID="cri-o://bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e" gracePeriod=600 Jun 02 13:39:34.444554 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.444280 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="kube-rbac-proxy" containerID="cri-o://8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182" gracePeriod=600 Jun 02 13:39:34.444661 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.444332 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="kube-rbac-proxy-web" containerID="cri-o://79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5" gracePeriod=600 Jun 02 13:39:34.444719 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.444346 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="thanos-sidecar" containerID="cri-o://bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583" gracePeriod=600 Jun 02 13:39:34.444772 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.444347 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0" gracePeriod=600 Jun 02 13:39:34.444817 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.444357 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="config-reloader" containerID="cri-o://c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a" gracePeriod=600 Jun 02 13:39:34.716712 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.716677 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.762477 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-grpc-tls\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.762542 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-k8s-rulefiles-0\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.762580 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-metrics-client-ca\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.762603 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-web-config\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.762629 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-tls\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.762665 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.762692 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-config\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.762716 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnkcm\" (UniqueName: \"kubernetes.io/projected/27d4d846-21cb-4884-9aa2-d02c99596667-kube-api-access-cnkcm\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.762767 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-metrics-client-certs\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.762810 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-k8s-db\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.762838 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-serving-certs-ca-bundle\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.762867 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27d4d846-21cb-4884-9aa2-d02c99596667-tls-assets\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.762893 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27d4d846-21cb-4884-9aa2-d02c99596667-config-out\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.762919 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.762945 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-trusted-ca-bundle\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.762988 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-kubelet-serving-ca-bundle\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.763015 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-kube-rbac-proxy\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.765251 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.763039 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-thanos-prometheus-http-client-file\") pod \"27d4d846-21cb-4884-9aa2-d02c99596667\" (UID: \"27d4d846-21cb-4884-9aa2-d02c99596667\") " Jun 02 13:39:34.766452 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.764276 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 13:39:34.766452 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.764457 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 13:39:34.766452 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.764626 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 13:39:34.766452 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.765884 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 13:39:34.768771 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.768738 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 13:39:34.768891 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.768780 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 13:39:34.771537 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.771491 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:39:34.771648 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.771572 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:39:34.771648 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.771617 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27d4d846-21cb-4884-9aa2-d02c99596667-config-out" (OuterVolumeSpecName: "config-out") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 13:39:34.771776 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.771712 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:39:34.771776 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.771733 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-config" (OuterVolumeSpecName: "config") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:39:34.772047 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.771772 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27d4d846-21cb-4884-9aa2-d02c99596667-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 13:39:34.772047 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.771778 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:39:34.772047 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.771879 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:39:34.772047 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.771932 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:39:34.772531 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.772503 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:39:34.773355 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.773331 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27d4d846-21cb-4884-9aa2-d02c99596667-kube-api-access-cnkcm" (OuterVolumeSpecName: "kube-api-access-cnkcm") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "kube-api-access-cnkcm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 13:39:34.782726 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.782693 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-web-config" (OuterVolumeSpecName: "web-config") pod "27d4d846-21cb-4884-9aa2-d02c99596667" (UID: "27d4d846-21cb-4884-9aa2-d02c99596667"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 13:39:34.864359 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864314 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:34.864359 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864349 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27d4d846-21cb-4884-9aa2-d02c99596667-tls-assets\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:34.864359 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864360 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27d4d846-21cb-4884-9aa2-d02c99596667-config-out\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:34.864359 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864393 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:34.864681 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864404 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:34.864681 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864414 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:34.864681 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864422 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-kube-rbac-proxy\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:34.864681 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864431 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:34.864681 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864441 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-grpc-tls\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:34.864681 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864450 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:34.864681 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864459 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27d4d846-21cb-4884-9aa2-d02c99596667-configmap-metrics-client-ca\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:34.864681 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864468 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-web-config\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:34.864681 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864477 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:34.864681 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864486 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:34.864681 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864495 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-config\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:34.864681 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864503 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnkcm\" (UniqueName: \"kubernetes.io/projected/27d4d846-21cb-4884-9aa2-d02c99596667-kube-api-access-cnkcm\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:34.864681 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864514 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27d4d846-21cb-4884-9aa2-d02c99596667-secret-metrics-client-certs\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:34.864681 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:34.864528 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27d4d846-21cb-4884-9aa2-d02c99596667-prometheus-k8s-db\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:39:35.090312 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.090279 2578 generic.go:358] "Generic (PLEG): container finished" podID="27d4d846-21cb-4884-9aa2-d02c99596667" containerID="a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0" exitCode=0 Jun 02 13:39:35.090312 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.090304 2578 generic.go:358] "Generic (PLEG): container finished" podID="27d4d846-21cb-4884-9aa2-d02c99596667" containerID="8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182" exitCode=0 Jun 02 13:39:35.090312 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.090311 2578 generic.go:358] "Generic (PLEG): container finished" podID="27d4d846-21cb-4884-9aa2-d02c99596667" containerID="79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5" exitCode=0 Jun 02 13:39:35.090312 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.090318 2578 generic.go:358] "Generic (PLEG): container finished" podID="27d4d846-21cb-4884-9aa2-d02c99596667" containerID="bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583" exitCode=0 Jun 02 13:39:35.090312 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.090323 2578 generic.go:358] "Generic (PLEG): container finished" podID="27d4d846-21cb-4884-9aa2-d02c99596667" containerID="c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a" exitCode=0 Jun 02 13:39:35.090917 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.090328 2578 generic.go:358] "Generic (PLEG): container finished" podID="27d4d846-21cb-4884-9aa2-d02c99596667" containerID="bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e" exitCode=0 Jun 02 13:39:35.090917 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.090359 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27d4d846-21cb-4884-9aa2-d02c99596667","Type":"ContainerDied","Data":"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0"} Jun 02 13:39:35.090917 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.090408 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.090917 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.090424 2578 scope.go:117] "RemoveContainer" containerID="a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0" Jun 02 13:39:35.090917 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.090414 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27d4d846-21cb-4884-9aa2-d02c99596667","Type":"ContainerDied","Data":"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182"} Jun 02 13:39:35.090917 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.090538 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27d4d846-21cb-4884-9aa2-d02c99596667","Type":"ContainerDied","Data":"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5"} Jun 02 13:39:35.090917 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.090556 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27d4d846-21cb-4884-9aa2-d02c99596667","Type":"ContainerDied","Data":"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583"} Jun 02 13:39:35.090917 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.090571 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27d4d846-21cb-4884-9aa2-d02c99596667","Type":"ContainerDied","Data":"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a"} Jun 02 13:39:35.090917 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.090584 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27d4d846-21cb-4884-9aa2-d02c99596667","Type":"ContainerDied","Data":"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e"} Jun 02 13:39:35.090917 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.090601 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27d4d846-21cb-4884-9aa2-d02c99596667","Type":"ContainerDied","Data":"5f7998c51d551bc91fd4fc528fb62d606818d3d1b5d41e10a325d74857fc59c9"} Jun 02 13:39:35.100292 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.100147 2578 scope.go:117] "RemoveContainer" containerID="8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182" Jun 02 13:39:35.107642 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.107625 2578 scope.go:117] "RemoveContainer" containerID="79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5" Jun 02 13:39:35.115033 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.115007 2578 scope.go:117] "RemoveContainer" containerID="bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583" Jun 02 13:39:35.116781 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.116758 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 13:39:35.122060 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.122034 2578 scope.go:117] "RemoveContainer" containerID="c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a" Jun 02 13:39:35.126712 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.126686 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 13:39:35.129708 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.129694 2578 scope.go:117] "RemoveContainer" containerID="bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e" Jun 02 13:39:35.137546 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.137526 2578 scope.go:117] "RemoveContainer" containerID="868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a" Jun 02 13:39:35.145195 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.145171 2578 scope.go:117] "RemoveContainer" containerID="a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0" Jun 02 13:39:35.145583 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:39:35.145561 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0\": container with ID starting with a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0 not found: ID does not exist" containerID="a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0" Jun 02 13:39:35.145660 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.145590 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0"} err="failed to get container status \"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0\": rpc error: code = NotFound desc = could not find container \"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0\": container with ID starting with a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0 not found: ID does not exist" Jun 02 13:39:35.145660 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.145614 2578 scope.go:117] "RemoveContainer" containerID="8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182" Jun 02 13:39:35.145879 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:39:35.145861 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182\": container with ID starting with 8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182 not found: ID does not exist" containerID="8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182" Jun 02 13:39:35.145922 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.145883 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182"} err="failed to get container status \"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182\": rpc error: code = NotFound desc = could not find container \"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182\": container with ID starting with 8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182 not found: ID does not exist" Jun 02 13:39:35.145922 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.145906 2578 scope.go:117] "RemoveContainer" containerID="79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5" Jun 02 13:39:35.146117 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:39:35.146102 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5\": container with ID starting with 79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5 not found: ID does not exist" containerID="79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5" Jun 02 13:39:35.146158 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.146119 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5"} err="failed to get container status \"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5\": rpc error: code = NotFound desc = could not find container \"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5\": container with ID starting with 79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5 not found: ID does not exist" Jun 02 13:39:35.146158 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.146132 2578 scope.go:117] "RemoveContainer" containerID="bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583" Jun 02 13:39:35.146407 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:39:35.146389 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583\": container with ID starting with bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583 not found: ID does not exist" containerID="bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583" Jun 02 13:39:35.146454 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.146414 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583"} err="failed to get container status \"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583\": rpc error: code = NotFound desc = could not find container \"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583\": container with ID starting with bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583 not found: ID does not exist" Jun 02 13:39:35.146454 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.146431 2578 scope.go:117] "RemoveContainer" containerID="c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a" Jun 02 13:39:35.146674 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:39:35.146658 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a\": container with ID starting with c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a not found: ID does not exist" containerID="c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a" Jun 02 13:39:35.146722 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.146678 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a"} err="failed to get container status \"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a\": rpc error: code = NotFound desc = could not find container \"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a\": container with ID starting with c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a not found: ID does not exist" Jun 02 13:39:35.146722 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.146691 2578 scope.go:117] "RemoveContainer" containerID="bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e" Jun 02 13:39:35.146917 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:39:35.146902 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e\": container with ID starting with bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e not found: ID does not exist" containerID="bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e" Jun 02 13:39:35.146956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.146922 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e"} err="failed to get container status \"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e\": rpc error: code = NotFound desc = could not find container \"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e\": container with ID starting with bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e not found: ID does not exist" Jun 02 13:39:35.146956 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.146938 2578 scope.go:117] "RemoveContainer" containerID="868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a" Jun 02 13:39:35.147187 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:39:35.147171 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a\": container with ID starting with 868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a not found: ID does not exist" containerID="868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a" Jun 02 13:39:35.147232 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.147191 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a"} err="failed to get container status \"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a\": rpc error: code = NotFound desc = could not find container \"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a\": container with ID starting with 868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a not found: ID does not exist" Jun 02 13:39:35.147232 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.147204 2578 scope.go:117] "RemoveContainer" containerID="a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0" Jun 02 13:39:35.147452 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.147434 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0"} err="failed to get container status \"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0\": rpc error: code = NotFound desc = could not find container \"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0\": container with ID starting with a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0 not found: ID does not exist" Jun 02 13:39:35.147501 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.147453 2578 scope.go:117] "RemoveContainer" containerID="8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182" Jun 02 13:39:35.147691 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.147634 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182"} err="failed to get container status \"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182\": rpc error: code = NotFound desc = could not find container \"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182\": container with ID starting with 8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182 not found: ID does not exist" Jun 02 13:39:35.147691 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.147683 2578 scope.go:117] "RemoveContainer" containerID="79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5" Jun 02 13:39:35.147978 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.147955 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5"} err="failed to get container status \"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5\": rpc error: code = NotFound desc = could not find container \"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5\": container with ID starting with 79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5 not found: ID does not exist" Jun 02 13:39:35.148084 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.147981 2578 scope.go:117] "RemoveContainer" containerID="bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583" Jun 02 13:39:35.148265 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.148243 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583"} err="failed to get container status \"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583\": rpc error: code = NotFound desc = could not find container \"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583\": container with ID starting with bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583 not found: ID does not exist" Jun 02 13:39:35.148333 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.148268 2578 scope.go:117] "RemoveContainer" containerID="c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a" Jun 02 13:39:35.148525 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.148491 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a"} err="failed to get container status \"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a\": rpc error: code = NotFound desc = could not find container \"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a\": container with ID starting with c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a not found: ID does not exist" Jun 02 13:39:35.148525 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.148516 2578 scope.go:117] "RemoveContainer" containerID="bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e" Jun 02 13:39:35.148790 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.148763 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e"} err="failed to get container status \"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e\": rpc error: code = NotFound desc = could not find container \"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e\": container with ID starting with bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e not found: ID does not exist" Jun 02 13:39:35.148790 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.148779 2578 scope.go:117] "RemoveContainer" containerID="868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a" Jun 02 13:39:35.148978 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.148961 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a"} err="failed to get container status \"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a\": rpc error: code = NotFound desc = could not find container \"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a\": container with ID starting with 868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a not found: ID does not exist" Jun 02 13:39:35.149023 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.148979 2578 scope.go:117] "RemoveContainer" containerID="a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0" Jun 02 13:39:35.149154 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.149140 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0"} err="failed to get container status \"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0\": rpc error: code = NotFound desc = could not find container \"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0\": container with ID starting with a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0 not found: ID does not exist" Jun 02 13:39:35.149189 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.149154 2578 scope.go:117] "RemoveContainer" containerID="8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182" Jun 02 13:39:35.149327 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.149310 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182"} err="failed to get container status \"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182\": rpc error: code = NotFound desc = could not find container \"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182\": container with ID starting with 8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182 not found: ID does not exist" Jun 02 13:39:35.149327 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.149326 2578 scope.go:117] "RemoveContainer" containerID="79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5" Jun 02 13:39:35.149549 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.149527 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5"} err="failed to get container status \"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5\": rpc error: code = NotFound desc = could not find container \"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5\": container with ID starting with 79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5 not found: ID does not exist" Jun 02 13:39:35.149591 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.149551 2578 scope.go:117] "RemoveContainer" containerID="bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583" Jun 02 13:39:35.149776 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.149756 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583"} err="failed to get container status \"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583\": rpc error: code = NotFound desc = could not find container \"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583\": container with ID starting with bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583 not found: ID does not exist" Jun 02 13:39:35.149776 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.149768 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 13:39:35.149776 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.149776 2578 scope.go:117] "RemoveContainer" containerID="c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a" Jun 02 13:39:35.149988 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.149968 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a"} err="failed to get container status \"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a\": rpc error: code = NotFound desc = could not find container \"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a\": container with ID starting with c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a not found: ID does not exist" Jun 02 13:39:35.150035 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.149991 2578 scope.go:117] "RemoveContainer" containerID="bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e" Jun 02 13:39:35.150150 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150135 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="kube-rbac-proxy-thanos" Jun 02 13:39:35.150199 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150155 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="kube-rbac-proxy-thanos" Jun 02 13:39:35.150199 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150168 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e"} err="failed to get container status \"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e\": rpc error: code = NotFound desc = could not find container \"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e\": container with ID starting with bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e not found: ID does not exist" Jun 02 13:39:35.150199 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150184 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="thanos-sidecar" Jun 02 13:39:35.150199 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150194 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="thanos-sidecar" Jun 02 13:39:35.150322 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150207 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="init-config-reloader" Jun 02 13:39:35.150322 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150213 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="init-config-reloader" Jun 02 13:39:35.150322 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150220 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="prometheus" Jun 02 13:39:35.150322 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150225 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="prometheus" Jun 02 13:39:35.150322 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150231 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="config-reloader" Jun 02 13:39:35.150322 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150236 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="config-reloader" Jun 02 13:39:35.150322 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150242 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="kube-rbac-proxy" Jun 02 13:39:35.150322 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150250 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="kube-rbac-proxy" Jun 02 13:39:35.150322 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150185 2578 scope.go:117] "RemoveContainer" containerID="868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a" Jun 02 13:39:35.150322 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150264 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="kube-rbac-proxy-web" Jun 02 13:39:35.150322 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150273 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="kube-rbac-proxy-web" Jun 02 13:39:35.150778 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150340 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="kube-rbac-proxy-thanos" Jun 02 13:39:35.150778 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150349 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="thanos-sidecar" Jun 02 13:39:35.150778 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150355 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="kube-rbac-proxy" Jun 02 13:39:35.150778 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150396 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="prometheus" Jun 02 13:39:35.150778 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150407 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="kube-rbac-proxy-web" Jun 02 13:39:35.150778 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150416 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" containerName="config-reloader" Jun 02 13:39:35.150778 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150500 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a"} err="failed to get container status \"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a\": rpc error: code = NotFound desc = could not find container \"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a\": container with ID starting with 868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a not found: ID does not exist" Jun 02 13:39:35.150778 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150525 2578 scope.go:117] "RemoveContainer" containerID="a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0" Jun 02 13:39:35.151131 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150793 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0"} err="failed to get container status \"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0\": rpc error: code = NotFound desc = could not find container \"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0\": container with ID starting with a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0 not found: ID does not exist" Jun 02 13:39:35.151131 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.150820 2578 scope.go:117] "RemoveContainer" containerID="8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182" Jun 02 13:39:35.151131 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.151055 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182"} err="failed to get container status \"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182\": rpc error: code = NotFound desc = could not find container \"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182\": container with ID starting with 8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182 not found: ID does not exist" Jun 02 13:39:35.151131 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.151075 2578 scope.go:117] "RemoveContainer" containerID="79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5" Jun 02 13:39:35.151319 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.151300 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5"} err="failed to get container status \"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5\": rpc error: code = NotFound desc = could not find container \"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5\": container with ID starting with 79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5 not found: ID does not exist" Jun 02 13:39:35.151433 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.151323 2578 scope.go:117] "RemoveContainer" containerID="bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583" Jun 02 13:39:35.151547 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.151527 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583"} err="failed to get container status \"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583\": rpc error: code = NotFound desc = could not find container \"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583\": container with ID starting with bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583 not found: ID does not exist" Jun 02 13:39:35.151587 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.151549 2578 scope.go:117] "RemoveContainer" containerID="c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a" Jun 02 13:39:35.151754 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.151736 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a"} err="failed to get container status \"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a\": rpc error: code = NotFound desc = could not find container \"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a\": container with ID starting with c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a not found: ID does not exist" Jun 02 13:39:35.151795 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.151756 2578 scope.go:117] "RemoveContainer" containerID="bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e" Jun 02 13:39:35.152012 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.151987 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e"} err="failed to get container status \"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e\": rpc error: code = NotFound desc = could not find container \"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e\": container with ID starting with bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e not found: ID does not exist" Jun 02 13:39:35.152092 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.152014 2578 scope.go:117] "RemoveContainer" containerID="868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a" Jun 02 13:39:35.152332 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.152313 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a"} err="failed to get container status \"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a\": rpc error: code = NotFound desc = could not find container \"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a\": container with ID starting with 868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a not found: ID does not exist" Jun 02 13:39:35.152432 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.152333 2578 scope.go:117] "RemoveContainer" containerID="a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0" Jun 02 13:39:35.152604 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.152587 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0"} err="failed to get container status \"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0\": rpc error: code = NotFound desc = could not find container \"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0\": container with ID starting with a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0 not found: ID does not exist" Jun 02 13:39:35.152651 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.152605 2578 scope.go:117] "RemoveContainer" containerID="8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182" Jun 02 13:39:35.153217 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.153188 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182"} err="failed to get container status \"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182\": rpc error: code = NotFound desc = could not find container \"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182\": container with ID starting with 8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182 not found: ID does not exist" Jun 02 13:39:35.153328 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.153218 2578 scope.go:117] "RemoveContainer" containerID="79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5" Jun 02 13:39:35.153525 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.153497 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5"} err="failed to get container status \"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5\": rpc error: code = NotFound desc = could not find container \"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5\": container with ID starting with 79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5 not found: ID does not exist" Jun 02 13:39:35.153525 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.153521 2578 scope.go:117] "RemoveContainer" containerID="bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583" Jun 02 13:39:35.153806 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.153783 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583"} err="failed to get container status \"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583\": rpc error: code = NotFound desc = could not find container \"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583\": container with ID starting with bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583 not found: ID does not exist" Jun 02 13:39:35.153910 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.153808 2578 scope.go:117] "RemoveContainer" containerID="c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a" Jun 02 13:39:35.154250 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.154052 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a"} err="failed to get container status \"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a\": rpc error: code = NotFound desc = could not find container \"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a\": container with ID starting with c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a not found: ID does not exist" Jun 02 13:39:35.154250 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.154087 2578 scope.go:117] "RemoveContainer" containerID="bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e" Jun 02 13:39:35.155752 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.155725 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e"} err="failed to get container status \"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e\": rpc error: code = NotFound desc = could not find container \"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e\": container with ID starting with bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e not found: ID does not exist" Jun 02 13:39:35.155858 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.155751 2578 scope.go:117] "RemoveContainer" containerID="868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a" Jun 02 13:39:35.156066 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.156045 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a"} err="failed to get container status \"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a\": rpc error: code = NotFound desc = could not find container \"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a\": container with ID starting with 868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a not found: ID does not exist" Jun 02 13:39:35.156134 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.156079 2578 scope.go:117] "RemoveContainer" containerID="a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0" Jun 02 13:39:35.156342 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.156324 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0"} err="failed to get container status \"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0\": rpc error: code = NotFound desc = could not find container \"a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0\": container with ID starting with a298b71fe30a4b0afba2922b7a31a7af0aad7810a7cb6642e81c1b6a31c876b0 not found: ID does not exist" Jun 02 13:39:35.156433 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.156343 2578 scope.go:117] "RemoveContainer" containerID="8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182" Jun 02 13:39:35.156568 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.156550 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182"} err="failed to get container status \"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182\": rpc error: code = NotFound desc = could not find container \"8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182\": container with ID starting with 8ff1065fa2db9ba24d2cd080f2fb2af42f1bac7300cebc7885542a32cd9b5182 not found: ID does not exist" Jun 02 13:39:35.156626 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.156570 2578 scope.go:117] "RemoveContainer" containerID="79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5" Jun 02 13:39:35.157287 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.157264 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5"} err="failed to get container status \"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5\": rpc error: code = NotFound desc = could not find container \"79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5\": container with ID starting with 79f446bf0a32d4ec5d283a37dfd55a06f596720692be20bb8f98199068bb36c5 not found: ID does not exist" Jun 02 13:39:35.157287 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.157287 2578 scope.go:117] "RemoveContainer" containerID="bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583" Jun 02 13:39:35.157450 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.157437 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.157536 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.157517 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583"} err="failed to get container status \"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583\": rpc error: code = NotFound desc = could not find container \"bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583\": container with ID starting with bb45199a6a65100f4cf6c231e5f2f7145cd911cb858a22aaa2ad9dd3fc29b583 not found: ID does not exist" Jun 02 13:39:35.157581 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.157537 2578 scope.go:117] "RemoveContainer" containerID="c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a" Jun 02 13:39:35.157818 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.157747 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a"} err="failed to get container status \"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a\": rpc error: code = NotFound desc = could not find container \"c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a\": container with ID starting with c7b4360bf47346c0df278e2a3d93b762fbf71ba1acc8c411e7684c8c344f3c1a not found: ID does not exist" Jun 02 13:39:35.157818 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.157776 2578 scope.go:117] "RemoveContainer" containerID="bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e" Jun 02 13:39:35.158064 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.158036 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e"} err="failed to get container status \"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e\": rpc error: code = NotFound desc = could not find container \"bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e\": container with ID starting with bea06e136d33175e63e3927c7a9d280db96fadfe2ad097c7ff6f4ddf4e64483e not found: ID does not exist" Jun 02 13:39:35.158064 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.158055 2578 scope.go:117] "RemoveContainer" containerID="868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a" Jun 02 13:39:35.158300 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.158281 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a"} err="failed to get container status \"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a\": rpc error: code = NotFound desc = could not find container \"868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a\": container with ID starting with 868e840caa6f1679979f0cc0bbce1c2f4fda3fe90a6744008700308554ac807a not found: ID does not exist" Jun 02 13:39:35.160037 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.159961 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 13:39:35.160037 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.159976 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 13:39:35.160200 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.160182 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 13:39:35.160200 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.160218 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 13:39:35.160485 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.160264 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 13:39:35.160485 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.160281 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 13:39:35.160621 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.160552 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 13:39:35.160621 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.160594 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-767jh0a6mi5ok\"" Jun 02 13:39:35.160724 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.160669 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 13:39:35.160724 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.160708 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 13:39:35.160842 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.160819 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 13:39:35.160951 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.160932 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nkvfv\"" Jun 02 13:39:35.162888 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.162871 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 13:39:35.166118 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.166092 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 13:39:35.166644 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.166623 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 13:39:35.166952 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.166925 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.167257 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.167210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.167257 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.167249 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.167408 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.167285 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.167408 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.167327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.168277 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.167411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.168277 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.167455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.168277 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.167536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.168277 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.167573 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.168277 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.167669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-config\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.168277 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.167692 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.168277 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.167729 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.168277 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.167768 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.168277 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.167808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlklm\" (UniqueName: \"kubernetes.io/projected/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-kube-api-access-zlklm\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.168277 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.167884 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.168277 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.167991 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.168277 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.168023 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.168277 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.168049 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.269457 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.269421 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.269457 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.269462 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.269722 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.269482 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.269722 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.269663 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.269827 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.269721 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.269827 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.269748 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.269827 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.269777 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.269827 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.269803 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.269997 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.269838 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.269997 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.269841 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.270460 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.270328 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.270793 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.270439 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.270793 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.270648 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.270793 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.270682 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.270793 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.270741 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-config\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.270793 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.270789 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.271059 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.270820 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.271059 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.270846 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.271059 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.270888 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zlklm\" (UniqueName: \"kubernetes.io/projected/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-kube-api-access-zlklm\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.271059 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.270929 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.272729 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.271912 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.272729 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.272535 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.272957 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.272934 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.273058 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.273034 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.273124 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.273078 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.273124 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.273079 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.273223 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.273133 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.273697 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.273674 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.273788 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.273728 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.274036 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.274013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.275751 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.275721 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.275850 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.275829 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-config\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.275904 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.275891 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.276292 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.276275 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.276499 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.276482 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.282088 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.282066 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlklm\" (UniqueName: \"kubernetes.io/projected/3f2a5643-0518-4bbc-9dd1-6b8ac111aabb-kube-api-access-zlklm\") pod \"prometheus-k8s-0\" (UID: \"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.469020 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.468926 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:35.609588 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:35.609554 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 13:39:35.612921 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:39:35.612895 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2a5643_0518_4bbc_9dd1_6b8ac111aabb.slice/crio-f6f34deb392d84f6f10e51942e2e86f499604a6e63e32d7bafbd4b14d761051e WatchSource:0}: Error finding container f6f34deb392d84f6f10e51942e2e86f499604a6e63e32d7bafbd4b14d761051e: Status 404 returned error can't find the container with id f6f34deb392d84f6f10e51942e2e86f499604a6e63e32d7bafbd4b14d761051e Jun 02 13:39:36.077537 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:36.077492 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs\") pod \"network-metrics-daemon-lvq7r\" (UID: \"ed3b2b23-30df-4e74-8662-a29c58704801\") " pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:39:36.079858 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:36.079840 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed3b2b23-30df-4e74-8662-a29c58704801-metrics-certs\") pod \"network-metrics-daemon-lvq7r\" (UID: \"ed3b2b23-30df-4e74-8662-a29c58704801\") " pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:39:36.095143 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:36.095108 2578 generic.go:358] "Generic (PLEG): container finished" podID="3f2a5643-0518-4bbc-9dd1-6b8ac111aabb" containerID="e90d1ca29cd6e4ecb44890e49e23fb2dba38319ebec22dad4a779991616018f3" exitCode=0 Jun 02 13:39:36.095551 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:36.095162 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb","Type":"ContainerDied","Data":"e90d1ca29cd6e4ecb44890e49e23fb2dba38319ebec22dad4a779991616018f3"} Jun 02 13:39:36.095551 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:36.095181 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb","Type":"ContainerStarted","Data":"f6f34deb392d84f6f10e51942e2e86f499604a6e63e32d7bafbd4b14d761051e"} Jun 02 13:39:36.247746 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:36.247723 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ddqxr\"" Jun 02 13:39:36.250236 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:36.250212 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27d4d846-21cb-4884-9aa2-d02c99596667" path="/var/lib/kubelet/pods/27d4d846-21cb-4884-9aa2-d02c99596667/volumes" Jun 02 13:39:36.256197 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:36.256167 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvq7r" Jun 02 13:39:36.425741 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:36.425590 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lvq7r"] Jun 02 13:39:36.428193 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:39:36.428164 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3b2b23_30df_4e74_8662_a29c58704801.slice/crio-01764ba36be63e1cd0970929c18af05a973780380fb36921688a40499f7503c8 WatchSource:0}: Error finding container 01764ba36be63e1cd0970929c18af05a973780380fb36921688a40499f7503c8: Status 404 returned error can't find the container with id 01764ba36be63e1cd0970929c18af05a973780380fb36921688a40499f7503c8 Jun 02 13:39:37.100941 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:37.100891 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lvq7r" event={"ID":"ed3b2b23-30df-4e74-8662-a29c58704801","Type":"ContainerStarted","Data":"01764ba36be63e1cd0970929c18af05a973780380fb36921688a40499f7503c8"} Jun 02 13:39:37.104439 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:37.104412 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb","Type":"ContainerStarted","Data":"2634caa0209e52284a1cc802193bbcd841075247fa60ee9f2527aa477dd5c473"} Jun 02 13:39:37.104585 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:37.104443 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb","Type":"ContainerStarted","Data":"ee51358b619a4d9b116b917c56160464a32200563251ec34df404619d2781401"} Jun 02 13:39:37.104585 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:37.104454 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb","Type":"ContainerStarted","Data":"d07521601e9b1f2891e253471bbd971d0264cfc29a062537961180000707d36a"} Jun 02 13:39:37.104585 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:37.104464 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb","Type":"ContainerStarted","Data":"fd5f26e3b9902f400e732f9ecd59dfea13538c3de9b0b2fdd2ae610b46989e49"} Jun 02 13:39:37.104585 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:37.104473 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb","Type":"ContainerStarted","Data":"85a3da8a8163c24f73195c421a2745917248a04c295cb13f5fe149bad6f04697"} Jun 02 13:39:37.104585 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:37.104480 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f2a5643-0518-4bbc-9dd1-6b8ac111aabb","Type":"ContainerStarted","Data":"65e85b1a5d680c70cd18518717e62e4ed8cd6e83baaaa5f9eb9a76535796f61f"} Jun 02 13:39:37.132025 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:37.131973 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.1319532900000002 podStartE2EDuration="2.13195329s" podCreationTimestamp="2026-06-02 13:39:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 13:39:37.129744221 +0000 UTC m=+253.437108808" watchObservedRunningTime="2026-06-02 13:39:37.13195329 +0000 UTC m=+253.439317875" Jun 02 13:39:38.109780 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:38.109743 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lvq7r" event={"ID":"ed3b2b23-30df-4e74-8662-a29c58704801","Type":"ContainerStarted","Data":"b45eb14db96dc7bdcb523f6707640582a68285b532f507ad3e5de4941f79faa9"} Jun 02 13:39:38.109780 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:38.109780 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lvq7r" event={"ID":"ed3b2b23-30df-4e74-8662-a29c58704801","Type":"ContainerStarted","Data":"35d52f63e1044301afa5d4d2ba0beb49a8c7ea2bd75fa5e114e01a0a7eaed534"} Jun 02 13:39:38.129806 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:38.129751 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lvq7r" podStartSLOduration=253.109761584 podStartE2EDuration="4m14.129734032s" podCreationTimestamp="2026-06-02 13:35:24 +0000 UTC" firstStartedPulling="2026-06-02 13:39:36.430098391 +0000 UTC m=+252.737462954" lastFinishedPulling="2026-06-02 13:39:37.450070838 +0000 UTC m=+253.757435402" observedRunningTime="2026-06-02 13:39:38.128703099 +0000 UTC m=+254.436067703" watchObservedRunningTime="2026-06-02 13:39:38.129734032 +0000 UTC m=+254.437098617" Jun 02 13:39:40.469104 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:40.469065 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:39:59.980743 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:59.980703 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-f8l99"] Jun 02 13:39:59.985429 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:59.985409 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8l99" Jun 02 13:39:59.987870 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:59.987846 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 13:39:59.989974 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:39:59.989952 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f8l99"] Jun 02 13:40:00.091211 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:40:00.091172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e6ff18-5362-4411-a13e-748bbeb099b3-original-pull-secret\") pod \"global-pull-secret-syncer-f8l99\" (UID: \"54e6ff18-5362-4411-a13e-748bbeb099b3\") " pod="kube-system/global-pull-secret-syncer-f8l99" Jun 02 13:40:00.091406 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:40:00.091228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54e6ff18-5362-4411-a13e-748bbeb099b3-dbus\") pod \"global-pull-secret-syncer-f8l99\" (UID: \"54e6ff18-5362-4411-a13e-748bbeb099b3\") " pod="kube-system/global-pull-secret-syncer-f8l99" Jun 02 13:40:00.091406 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:40:00.091258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54e6ff18-5362-4411-a13e-748bbeb099b3-kubelet-config\") pod \"global-pull-secret-syncer-f8l99\" (UID: \"54e6ff18-5362-4411-a13e-748bbeb099b3\") " pod="kube-system/global-pull-secret-syncer-f8l99" Jun 02 13:40:00.192649 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:40:00.192614 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e6ff18-5362-4411-a13e-748bbeb099b3-original-pull-secret\") pod \"global-pull-secret-syncer-f8l99\" (UID: \"54e6ff18-5362-4411-a13e-748bbeb099b3\") " pod="kube-system/global-pull-secret-syncer-f8l99" Jun 02 13:40:00.192837 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:40:00.192670 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54e6ff18-5362-4411-a13e-748bbeb099b3-dbus\") pod \"global-pull-secret-syncer-f8l99\" (UID: \"54e6ff18-5362-4411-a13e-748bbeb099b3\") " pod="kube-system/global-pull-secret-syncer-f8l99" Jun 02 13:40:00.192837 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:40:00.192688 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54e6ff18-5362-4411-a13e-748bbeb099b3-kubelet-config\") pod \"global-pull-secret-syncer-f8l99\" (UID: \"54e6ff18-5362-4411-a13e-748bbeb099b3\") " pod="kube-system/global-pull-secret-syncer-f8l99" Jun 02 13:40:00.192837 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:40:00.192783 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54e6ff18-5362-4411-a13e-748bbeb099b3-kubelet-config\") pod \"global-pull-secret-syncer-f8l99\" (UID: \"54e6ff18-5362-4411-a13e-748bbeb099b3\") " pod="kube-system/global-pull-secret-syncer-f8l99" Jun 02 13:40:00.192978 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:40:00.192874 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54e6ff18-5362-4411-a13e-748bbeb099b3-dbus\") pod \"global-pull-secret-syncer-f8l99\" (UID: \"54e6ff18-5362-4411-a13e-748bbeb099b3\") " pod="kube-system/global-pull-secret-syncer-f8l99" Jun 02 13:40:00.195050 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:40:00.195033 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54e6ff18-5362-4411-a13e-748bbeb099b3-original-pull-secret\") pod \"global-pull-secret-syncer-f8l99\" (UID: \"54e6ff18-5362-4411-a13e-748bbeb099b3\") " pod="kube-system/global-pull-secret-syncer-f8l99" Jun 02 13:40:00.295673 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:40:00.295589 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f8l99" Jun 02 13:40:00.423814 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:40:00.423788 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f8l99"] Jun 02 13:40:00.426445 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:40:00.426418 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e6ff18_5362_4411_a13e_748bbeb099b3.slice/crio-3170ec4b873518174bd8ad8874df57e6d531b86720ff972dfc5665fbbdc58c03 WatchSource:0}: Error finding container 3170ec4b873518174bd8ad8874df57e6d531b86720ff972dfc5665fbbdc58c03: Status 404 returned error can't find the container with id 3170ec4b873518174bd8ad8874df57e6d531b86720ff972dfc5665fbbdc58c03 Jun 02 13:40:01.186567 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:40:01.186530 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f8l99" event={"ID":"54e6ff18-5362-4411-a13e-748bbeb099b3","Type":"ContainerStarted","Data":"3170ec4b873518174bd8ad8874df57e6d531b86720ff972dfc5665fbbdc58c03"} Jun 02 13:40:05.201235 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:40:05.201172 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f8l99" event={"ID":"54e6ff18-5362-4411-a13e-748bbeb099b3","Type":"ContainerStarted","Data":"48db8c926cc898f7f824f226aa21edaa03b2439560f84f1ae5f8933f506d40fa"} Jun 02 13:40:05.218502 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:40:05.218456 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f8l99" podStartSLOduration=2.130394744 podStartE2EDuration="6.218442233s" podCreationTimestamp="2026-06-02 13:39:59 +0000 UTC" firstStartedPulling="2026-06-02 13:40:00.428348974 +0000 UTC m=+276.735713536" lastFinishedPulling="2026-06-02 13:40:04.51639646 +0000 UTC m=+280.823761025" observedRunningTime="2026-06-02 13:40:05.216802413 +0000 UTC m=+281.524166999" watchObservedRunningTime="2026-06-02 13:40:05.218442233 +0000 UTC m=+281.525806817" Jun 02 13:40:35.469842 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:40:35.469802 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:40:35.486023 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:40:35.485996 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:40:36.313900 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:40:36.313872 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 13:44:04.732728 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:44:04.732694 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-wh4k8/test-trainjob-2ddff-node-0-0-qvm9k"] Jun 02 13:44:04.735018 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:44:04.735001 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-wh4k8/test-trainjob-2ddff-node-0-0-qvm9k" Jun 02 13:44:04.737309 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:44:04.737285 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-wh4k8\"/\"default-dockercfg-w46jw\"" Jun 02 13:44:04.737431 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:44:04.737335 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-wh4k8\"/\"openshift-service-ca.crt\"" Jun 02 13:44:04.738243 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:44:04.738229 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-wh4k8\"/\"kube-root-ca.crt\"" Jun 02 13:44:04.743806 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:44:04.743784 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-wh4k8/test-trainjob-2ddff-node-0-0-qvm9k"] Jun 02 13:44:04.789045 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:44:04.789012 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwsns\" (UniqueName: \"kubernetes.io/projected/cfd3577c-f757-43ff-84d0-f332a875c405-kube-api-access-pwsns\") pod \"test-trainjob-2ddff-node-0-0-qvm9k\" (UID: \"cfd3577c-f757-43ff-84d0-f332a875c405\") " pod="test-ns-wh4k8/test-trainjob-2ddff-node-0-0-qvm9k" Jun 02 13:44:04.890137 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:44:04.890102 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwsns\" (UniqueName: \"kubernetes.io/projected/cfd3577c-f757-43ff-84d0-f332a875c405-kube-api-access-pwsns\") pod \"test-trainjob-2ddff-node-0-0-qvm9k\" (UID: \"cfd3577c-f757-43ff-84d0-f332a875c405\") " pod="test-ns-wh4k8/test-trainjob-2ddff-node-0-0-qvm9k" Jun 02 13:44:04.897854 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:44:04.897825 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwsns\" (UniqueName: \"kubernetes.io/projected/cfd3577c-f757-43ff-84d0-f332a875c405-kube-api-access-pwsns\") pod \"test-trainjob-2ddff-node-0-0-qvm9k\" (UID: \"cfd3577c-f757-43ff-84d0-f332a875c405\") " pod="test-ns-wh4k8/test-trainjob-2ddff-node-0-0-qvm9k" Jun 02 13:44:05.053071 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:44:05.053041 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-wh4k8/test-trainjob-2ddff-node-0-0-qvm9k" Jun 02 13:44:05.179049 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:44:05.179012 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-wh4k8/test-trainjob-2ddff-node-0-0-qvm9k"] Jun 02 13:44:05.182708 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:44:05.182680 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfd3577c_f757_43ff_84d0_f332a875c405.slice/crio-5b908cbc1681056b54f99e28533f20553d87b69f18e03485cd3174d2e47bb74a WatchSource:0}: Error finding container 5b908cbc1681056b54f99e28533f20553d87b69f18e03485cd3174d2e47bb74a: Status 404 returned error can't find the container with id 5b908cbc1681056b54f99e28533f20553d87b69f18e03485cd3174d2e47bb74a Jun 02 13:44:05.184588 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:44:05.184569 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 13:44:05.933781 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:44:05.933713 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-wh4k8/test-trainjob-2ddff-node-0-0-qvm9k" event={"ID":"cfd3577c-f757-43ff-84d0-f332a875c405","Type":"ContainerStarted","Data":"5b908cbc1681056b54f99e28533f20553d87b69f18e03485cd3174d2e47bb74a"} Jun 02 13:48:15.791518 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:15.791477 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-wh4k8/test-trainjob-2ddff-node-0-0-qvm9k" event={"ID":"cfd3577c-f757-43ff-84d0-f332a875c405","Type":"ContainerStarted","Data":"2133eb9dfe70e3746074ea216766f4d2e6534a936f1ea860d638baf06cb84895"} Jun 02 13:48:15.813416 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:15.813341 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-wh4k8/test-trainjob-2ddff-node-0-0-qvm9k" podStartSLOduration=2.270084623 podStartE2EDuration="4m11.813328045s" podCreationTimestamp="2026-06-02 13:44:04 +0000 UTC" firstStartedPulling="2026-06-02 13:44:05.184725959 +0000 UTC m=+521.492090522" lastFinishedPulling="2026-06-02 13:48:14.72796938 +0000 UTC m=+771.035333944" observedRunningTime="2026-06-02 13:48:15.810909973 +0000 UTC m=+772.118274559" watchObservedRunningTime="2026-06-02 13:48:15.813328045 +0000 UTC m=+772.120692627" Jun 02 13:48:16.603877 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:16.603849 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wh4k8_test-trainjob-2ddff-node-0-0-qvm9k_cfd3577c-f757-43ff-84d0-f332a875c405/node/0.log" Jun 02 13:48:19.606509 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:19.606470 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wh4k8_test-trainjob-2ddff-node-0-0-qvm9k_cfd3577c-f757-43ff-84d0-f332a875c405/node/0.log" Jun 02 13:48:20.807829 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:20.807795 2578 generic.go:358] "Generic (PLEG): container finished" podID="cfd3577c-f757-43ff-84d0-f332a875c405" containerID="2133eb9dfe70e3746074ea216766f4d2e6534a936f1ea860d638baf06cb84895" exitCode=0 Jun 02 13:48:20.808283 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:20.807837 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-wh4k8/test-trainjob-2ddff-node-0-0-qvm9k" event={"ID":"cfd3577c-f757-43ff-84d0-f332a875c405","Type":"ContainerDied","Data":"2133eb9dfe70e3746074ea216766f4d2e6534a936f1ea860d638baf06cb84895"} Jun 02 13:48:22.025080 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:22.025058 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-wh4k8/test-trainjob-2ddff-node-0-0-qvm9k" Jun 02 13:48:22.104877 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:22.104786 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwsns\" (UniqueName: \"kubernetes.io/projected/cfd3577c-f757-43ff-84d0-f332a875c405-kube-api-access-pwsns\") pod \"cfd3577c-f757-43ff-84d0-f332a875c405\" (UID: \"cfd3577c-f757-43ff-84d0-f332a875c405\") " Jun 02 13:48:22.107164 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:22.107131 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfd3577c-f757-43ff-84d0-f332a875c405-kube-api-access-pwsns" (OuterVolumeSpecName: "kube-api-access-pwsns") pod "cfd3577c-f757-43ff-84d0-f332a875c405" (UID: "cfd3577c-f757-43ff-84d0-f332a875c405"). InnerVolumeSpecName "kube-api-access-pwsns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 13:48:22.205897 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:22.205861 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwsns\" (UniqueName: \"kubernetes.io/projected/cfd3577c-f757-43ff-84d0-f332a875c405-kube-api-access-pwsns\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:48:22.602599 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:22.602567 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wh4k8_test-trainjob-2ddff-node-0-0-qvm9k_cfd3577c-f757-43ff-84d0-f332a875c405/node/0.log" Jun 02 13:48:22.813980 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:22.813951 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-wh4k8/test-trainjob-2ddff-node-0-0-qvm9k" Jun 02 13:48:22.814147 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:22.813984 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-wh4k8/test-trainjob-2ddff-node-0-0-qvm9k" event={"ID":"cfd3577c-f757-43ff-84d0-f332a875c405","Type":"ContainerDied","Data":"5b908cbc1681056b54f99e28533f20553d87b69f18e03485cd3174d2e47bb74a"} Jun 02 13:48:22.814147 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:22.814014 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b908cbc1681056b54f99e28533f20553d87b69f18e03485cd3174d2e47bb74a" Jun 02 13:48:22.938950 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:22.938840 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wh4k8_test-trainjob-2ddff-node-0-0-qvm9k_cfd3577c-f757-43ff-84d0-f332a875c405/node/0.log" Jun 02 13:48:24.302243 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.302209 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ksths/must-gather-szrsg"] Jun 02 13:48:24.302652 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.302562 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfd3577c-f757-43ff-84d0-f332a875c405" containerName="node" Jun 02 13:48:24.302652 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.302573 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd3577c-f757-43ff-84d0-f332a875c405" containerName="node" Jun 02 13:48:24.302652 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.302622 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="cfd3577c-f757-43ff-84d0-f332a875c405" containerName="node" Jun 02 13:48:24.322128 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.322104 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ksths/must-gather-szrsg"] Jun 02 13:48:24.322265 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.322207 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ksths/must-gather-szrsg" Jun 02 13:48:24.325424 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.325398 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ksths\"/\"openshift-service-ca.crt\"" Jun 02 13:48:24.326482 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.326465 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ksths\"/\"default-dockercfg-76h4k\"" Jun 02 13:48:24.326599 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.326533 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ksths\"/\"kube-root-ca.crt\"" Jun 02 13:48:24.424454 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.424407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0752f221-759e-4a1e-ae31-37f2c2afdea0-must-gather-output\") pod \"must-gather-szrsg\" (UID: \"0752f221-759e-4a1e-ae31-37f2c2afdea0\") " pod="openshift-must-gather-ksths/must-gather-szrsg" Jun 02 13:48:24.424627 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.424547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd48z\" (UniqueName: \"kubernetes.io/projected/0752f221-759e-4a1e-ae31-37f2c2afdea0-kube-api-access-gd48z\") pod \"must-gather-szrsg\" (UID: \"0752f221-759e-4a1e-ae31-37f2c2afdea0\") " pod="openshift-must-gather-ksths/must-gather-szrsg" Jun 02 13:48:24.525585 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.525554 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0752f221-759e-4a1e-ae31-37f2c2afdea0-must-gather-output\") pod \"must-gather-szrsg\" (UID: \"0752f221-759e-4a1e-ae31-37f2c2afdea0\") " pod="openshift-must-gather-ksths/must-gather-szrsg" Jun 02 13:48:24.525752 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.525614 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gd48z\" (UniqueName: \"kubernetes.io/projected/0752f221-759e-4a1e-ae31-37f2c2afdea0-kube-api-access-gd48z\") pod \"must-gather-szrsg\" (UID: \"0752f221-759e-4a1e-ae31-37f2c2afdea0\") " pod="openshift-must-gather-ksths/must-gather-szrsg" Jun 02 13:48:24.525900 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.525867 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0752f221-759e-4a1e-ae31-37f2c2afdea0-must-gather-output\") pod \"must-gather-szrsg\" (UID: \"0752f221-759e-4a1e-ae31-37f2c2afdea0\") " pod="openshift-must-gather-ksths/must-gather-szrsg" Jun 02 13:48:24.533179 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.533150 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd48z\" (UniqueName: \"kubernetes.io/projected/0752f221-759e-4a1e-ae31-37f2c2afdea0-kube-api-access-gd48z\") pod \"must-gather-szrsg\" (UID: \"0752f221-759e-4a1e-ae31-37f2c2afdea0\") " pod="openshift-must-gather-ksths/must-gather-szrsg" Jun 02 13:48:24.642262 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.642175 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ksths/must-gather-szrsg" Jun 02 13:48:24.764954 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.764919 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ksths/must-gather-szrsg"] Jun 02 13:48:24.768070 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:48:24.768046 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0752f221_759e_4a1e_ae31_37f2c2afdea0.slice/crio-8098b82976fbca61186fb7c609b51bf1971ed6a3bd58c2a364aed8360849b4a2 WatchSource:0}: Error finding container 8098b82976fbca61186fb7c609b51bf1971ed6a3bd58c2a364aed8360849b4a2: Status 404 returned error can't find the container with id 8098b82976fbca61186fb7c609b51bf1971ed6a3bd58c2a364aed8360849b4a2 Jun 02 13:48:24.821874 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:24.821832 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ksths/must-gather-szrsg" event={"ID":"0752f221-759e-4a1e-ae31-37f2c2afdea0","Type":"ContainerStarted","Data":"8098b82976fbca61186fb7c609b51bf1971ed6a3bd58c2a364aed8360849b4a2"} Jun 02 13:48:27.969881 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:27.969841 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-wh4k8/test-trainjob-2ddff-node-0-0-qvm9k"] Jun 02 13:48:27.971752 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:27.971723 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-wh4k8/test-trainjob-2ddff-node-0-0-qvm9k"] Jun 02 13:48:28.249961 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:28.249888 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfd3577c-f757-43ff-84d0-f332a875c405" path="/var/lib/kubelet/pods/cfd3577c-f757-43ff-84d0-f332a875c405/volumes" Jun 02 13:48:32.853665 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:32.853625 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ksths/must-gather-szrsg" event={"ID":"0752f221-759e-4a1e-ae31-37f2c2afdea0","Type":"ContainerStarted","Data":"a5b06643c71233d71716672dc5c2b99e9f6f7cd4d8549ce8754477bb9d69c00f"} Jun 02 13:48:32.853665 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:32.853669 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ksths/must-gather-szrsg" event={"ID":"0752f221-759e-4a1e-ae31-37f2c2afdea0","Type":"ContainerStarted","Data":"ec7ac0f1b8449e6ff0a48aae90c6bab5550aae19b534efc057ecc01189500837"} Jun 02 13:48:32.868073 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:48:32.868012 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-ksths/must-gather-szrsg" podStartSLOduration=1.564338588 podStartE2EDuration="8.867994895s" podCreationTimestamp="2026-06-02 13:48:24 +0000 UTC" firstStartedPulling="2026-06-02 13:48:24.770137545 +0000 UTC m=+781.077502108" lastFinishedPulling="2026-06-02 13:48:32.073793849 +0000 UTC m=+788.381158415" observedRunningTime="2026-06-02 13:48:32.867005991 +0000 UTC m=+789.174370576" watchObservedRunningTime="2026-06-02 13:48:32.867994895 +0000 UTC m=+789.175359480" Jun 02 13:49:21.026983 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:21.026946 2578 generic.go:358] "Generic (PLEG): container finished" podID="0752f221-759e-4a1e-ae31-37f2c2afdea0" containerID="ec7ac0f1b8449e6ff0a48aae90c6bab5550aae19b534efc057ecc01189500837" exitCode=0 Jun 02 13:49:21.027412 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:21.026996 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ksths/must-gather-szrsg" event={"ID":"0752f221-759e-4a1e-ae31-37f2c2afdea0","Type":"ContainerDied","Data":"ec7ac0f1b8449e6ff0a48aae90c6bab5550aae19b534efc057ecc01189500837"} Jun 02 13:49:21.027412 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:21.027293 2578 scope.go:117] "RemoveContainer" containerID="ec7ac0f1b8449e6ff0a48aae90c6bab5550aae19b534efc057ecc01189500837" Jun 02 13:49:21.956903 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:21.956870 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ksths_must-gather-szrsg_0752f221-759e-4a1e-ae31-37f2c2afdea0/gather/0.log" Jun 02 13:49:24.875322 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:24.875283 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f8l99_54e6ff18-5362-4411-a13e-748bbeb099b3/global-pull-secret-syncer/0.log" Jun 02 13:49:24.973646 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:24.973604 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qpfnp_c0e798ef-026f-4d2d-bbbf-8e52bda3bf94/konnectivity-agent/0.log" Jun 02 13:49:25.027261 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:25.027230 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-124.ec2.internal_51cf72cd0e936b57f6d1dce1f14e8f86/haproxy/0.log" Jun 02 13:49:27.340797 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:27.340758 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-ksths/must-gather-szrsg"] Jun 02 13:49:27.341210 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:27.340988 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-ksths/must-gather-szrsg" podUID="0752f221-759e-4a1e-ae31-37f2c2afdea0" containerName="copy" containerID="cri-o://a5b06643c71233d71716672dc5c2b99e9f6f7cd4d8549ce8754477bb9d69c00f" gracePeriod=2 Jun 02 13:49:27.343160 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:27.343127 2578 status_manager.go:895] "Failed to get status for pod" podUID="0752f221-759e-4a1e-ae31-37f2c2afdea0" pod="openshift-must-gather-ksths/must-gather-szrsg" err="pods \"must-gather-szrsg\" is forbidden: User \"system:node:ip-10-0-130-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ksths\": no relationship found between node 'ip-10-0-130-124.ec2.internal' and this object" Jun 02 13:49:27.344243 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:27.344216 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-ksths/must-gather-szrsg"] Jun 02 13:49:27.573487 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:27.573463 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ksths_must-gather-szrsg_0752f221-759e-4a1e-ae31-37f2c2afdea0/copy/0.log" Jun 02 13:49:27.573865 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:27.573850 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ksths/must-gather-szrsg" Jun 02 13:49:27.575740 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:27.575715 2578 status_manager.go:895] "Failed to get status for pod" podUID="0752f221-759e-4a1e-ae31-37f2c2afdea0" pod="openshift-must-gather-ksths/must-gather-szrsg" err="pods \"must-gather-szrsg\" is forbidden: User \"system:node:ip-10-0-130-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ksths\": no relationship found between node 'ip-10-0-130-124.ec2.internal' and this object" Jun 02 13:49:27.718187 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:27.718103 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd48z\" (UniqueName: \"kubernetes.io/projected/0752f221-759e-4a1e-ae31-37f2c2afdea0-kube-api-access-gd48z\") pod \"0752f221-759e-4a1e-ae31-37f2c2afdea0\" (UID: \"0752f221-759e-4a1e-ae31-37f2c2afdea0\") " Jun 02 13:49:27.718187 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:27.718149 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0752f221-759e-4a1e-ae31-37f2c2afdea0-must-gather-output\") pod \"0752f221-759e-4a1e-ae31-37f2c2afdea0\" (UID: \"0752f221-759e-4a1e-ae31-37f2c2afdea0\") " Jun 02 13:49:27.720353 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:27.720318 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0752f221-759e-4a1e-ae31-37f2c2afdea0-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "0752f221-759e-4a1e-ae31-37f2c2afdea0" (UID: "0752f221-759e-4a1e-ae31-37f2c2afdea0"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 13:49:27.720481 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:27.720426 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0752f221-759e-4a1e-ae31-37f2c2afdea0-kube-api-access-gd48z" (OuterVolumeSpecName: "kube-api-access-gd48z") pod "0752f221-759e-4a1e-ae31-37f2c2afdea0" (UID: "0752f221-759e-4a1e-ae31-37f2c2afdea0"). InnerVolumeSpecName "kube-api-access-gd48z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 13:49:27.819525 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:27.819485 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd48z\" (UniqueName: \"kubernetes.io/projected/0752f221-759e-4a1e-ae31-37f2c2afdea0-kube-api-access-gd48z\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:49:27.819525 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:27.819518 2578 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0752f221-759e-4a1e-ae31-37f2c2afdea0-must-gather-output\") on node \"ip-10-0-130-124.ec2.internal\" DevicePath \"\"" Jun 02 13:49:28.038461 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.038433 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bb7cfde-8f55-499d-9bad-c629bf4d1dc5/alertmanager/0.log" Jun 02 13:49:28.052294 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.052272 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ksths_must-gather-szrsg_0752f221-759e-4a1e-ae31-37f2c2afdea0/copy/0.log" Jun 02 13:49:28.052623 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.052604 2578 generic.go:358] "Generic (PLEG): container finished" podID="0752f221-759e-4a1e-ae31-37f2c2afdea0" containerID="a5b06643c71233d71716672dc5c2b99e9f6f7cd4d8549ce8754477bb9d69c00f" exitCode=143 Jun 02 13:49:28.052720 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.052672 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ksths/must-gather-szrsg" Jun 02 13:49:28.052720 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.052704 2578 scope.go:117] "RemoveContainer" containerID="a5b06643c71233d71716672dc5c2b99e9f6f7cd4d8549ce8754477bb9d69c00f" Jun 02 13:49:28.054932 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.054905 2578 status_manager.go:895] "Failed to get status for pod" podUID="0752f221-759e-4a1e-ae31-37f2c2afdea0" pod="openshift-must-gather-ksths/must-gather-szrsg" err="pods \"must-gather-szrsg\" is forbidden: User \"system:node:ip-10-0-130-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ksths\": no relationship found between node 'ip-10-0-130-124.ec2.internal' and this object" Jun 02 13:49:28.060406 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.060386 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bb7cfde-8f55-499d-9bad-c629bf4d1dc5/config-reloader/0.log" Jun 02 13:49:28.061732 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.061706 2578 scope.go:117] "RemoveContainer" containerID="ec7ac0f1b8449e6ff0a48aae90c6bab5550aae19b534efc057ecc01189500837" Jun 02 13:49:28.063574 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.063549 2578 status_manager.go:895] "Failed to get status for pod" podUID="0752f221-759e-4a1e-ae31-37f2c2afdea0" pod="openshift-must-gather-ksths/must-gather-szrsg" err="pods \"must-gather-szrsg\" is forbidden: User \"system:node:ip-10-0-130-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ksths\": no relationship found between node 'ip-10-0-130-124.ec2.internal' and this object" Jun 02 13:49:28.073815 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.073796 2578 scope.go:117] "RemoveContainer" containerID="a5b06643c71233d71716672dc5c2b99e9f6f7cd4d8549ce8754477bb9d69c00f" Jun 02 13:49:28.074067 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:49:28.074046 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5b06643c71233d71716672dc5c2b99e9f6f7cd4d8549ce8754477bb9d69c00f\": container with ID starting with a5b06643c71233d71716672dc5c2b99e9f6f7cd4d8549ce8754477bb9d69c00f not found: ID does not exist" containerID="a5b06643c71233d71716672dc5c2b99e9f6f7cd4d8549ce8754477bb9d69c00f" Jun 02 13:49:28.074163 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.074077 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5b06643c71233d71716672dc5c2b99e9f6f7cd4d8549ce8754477bb9d69c00f"} err="failed to get container status \"a5b06643c71233d71716672dc5c2b99e9f6f7cd4d8549ce8754477bb9d69c00f\": rpc error: code = NotFound desc = could not find container \"a5b06643c71233d71716672dc5c2b99e9f6f7cd4d8549ce8754477bb9d69c00f\": container with ID starting with a5b06643c71233d71716672dc5c2b99e9f6f7cd4d8549ce8754477bb9d69c00f not found: ID does not exist" Jun 02 13:49:28.074163 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.074095 2578 scope.go:117] "RemoveContainer" containerID="ec7ac0f1b8449e6ff0a48aae90c6bab5550aae19b534efc057ecc01189500837" Jun 02 13:49:28.074477 ip-10-0-130-124 kubenswrapper[2578]: E0602 13:49:28.074451 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec7ac0f1b8449e6ff0a48aae90c6bab5550aae19b534efc057ecc01189500837\": container with ID starting with ec7ac0f1b8449e6ff0a48aae90c6bab5550aae19b534efc057ecc01189500837 not found: ID does not exist" containerID="ec7ac0f1b8449e6ff0a48aae90c6bab5550aae19b534efc057ecc01189500837" Jun 02 13:49:28.074538 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.074489 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec7ac0f1b8449e6ff0a48aae90c6bab5550aae19b534efc057ecc01189500837"} err="failed to get container status \"ec7ac0f1b8449e6ff0a48aae90c6bab5550aae19b534efc057ecc01189500837\": rpc error: code = NotFound desc = could not find container \"ec7ac0f1b8449e6ff0a48aae90c6bab5550aae19b534efc057ecc01189500837\": container with ID starting with ec7ac0f1b8449e6ff0a48aae90c6bab5550aae19b534efc057ecc01189500837 not found: ID does not exist" Jun 02 13:49:28.084324 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.084282 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bb7cfde-8f55-499d-9bad-c629bf4d1dc5/kube-rbac-proxy-web/0.log" Jun 02 13:49:28.105529 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.105511 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bb7cfde-8f55-499d-9bad-c629bf4d1dc5/kube-rbac-proxy/0.log" Jun 02 13:49:28.125211 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.125189 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bb7cfde-8f55-499d-9bad-c629bf4d1dc5/kube-rbac-proxy-metric/0.log" Jun 02 13:49:28.145644 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.145622 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bb7cfde-8f55-499d-9bad-c629bf4d1dc5/prom-label-proxy/0.log" Jun 02 13:49:28.197098 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.197064 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bb7cfde-8f55-499d-9bad-c629bf4d1dc5/init-config-reloader/0.log" Jun 02 13:49:28.229172 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.229136 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-gnkt8_b81ad2a5-97a5-452d-beb1-12eb06143da5/cluster-monitoring-operator/0.log" Jun 02 13:49:28.249147 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.249107 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0752f221-759e-4a1e-ae31-37f2c2afdea0" path="/var/lib/kubelet/pods/0752f221-759e-4a1e-ae31-37f2c2afdea0/volumes" Jun 02 13:49:28.314553 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.314524 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5dd65878cd-vjl7z_62363fee-6348-481f-97cf-505cc0febdcb/metrics-server/0.log" Jun 02 13:49:28.340665 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.340644 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-cbngg_00bdc432-ff40-46ed-923e-fc88231bd573/monitoring-plugin/0.log" Jun 02 13:49:28.519308 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.519280 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w44vl_4888357e-23e9-4394-a820-4a67a1bd13b1/node-exporter/0.log" Jun 02 13:49:28.539895 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.539868 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w44vl_4888357e-23e9-4394-a820-4a67a1bd13b1/kube-rbac-proxy/0.log" Jun 02 13:49:28.558624 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.558601 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w44vl_4888357e-23e9-4394-a820-4a67a1bd13b1/init-textfile/0.log" Jun 02 13:49:28.583562 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.583482 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-bcwhd_cd53e096-2775-40eb-8018-51a34e96cfbf/kube-rbac-proxy-main/0.log" Jun 02 13:49:28.601492 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.601470 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-bcwhd_cd53e096-2775-40eb-8018-51a34e96cfbf/kube-rbac-proxy-self/0.log" Jun 02 13:49:28.619434 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.619405 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-bcwhd_cd53e096-2775-40eb-8018-51a34e96cfbf/openshift-state-metrics/0.log" Jun 02 13:49:28.653587 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.653562 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f2a5643-0518-4bbc-9dd1-6b8ac111aabb/prometheus/0.log" Jun 02 13:49:28.676610 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.676583 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f2a5643-0518-4bbc-9dd1-6b8ac111aabb/config-reloader/0.log" Jun 02 13:49:28.696522 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.696498 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f2a5643-0518-4bbc-9dd1-6b8ac111aabb/thanos-sidecar/0.log" Jun 02 13:49:28.714427 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.714408 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f2a5643-0518-4bbc-9dd1-6b8ac111aabb/kube-rbac-proxy-web/0.log" Jun 02 13:49:28.733990 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.733971 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f2a5643-0518-4bbc-9dd1-6b8ac111aabb/kube-rbac-proxy/0.log" Jun 02 13:49:28.755677 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.755655 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f2a5643-0518-4bbc-9dd1-6b8ac111aabb/kube-rbac-proxy-thanos/0.log" Jun 02 13:49:28.776050 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.776018 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3f2a5643-0518-4bbc-9dd1-6b8ac111aabb/init-config-reloader/0.log" Jun 02 13:49:28.801428 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.801399 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-dkw27_942a4254-2d0b-4bc1-8794-62a8c55f6012/prometheus-operator/0.log" Jun 02 13:49:28.814998 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.814977 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-dkw27_942a4254-2d0b-4bc1-8794-62a8c55f6012/kube-rbac-proxy/0.log" Jun 02 13:49:28.835988 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.835921 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-gtdrr_7c7048b8-5719-4068-a3eb-87cad5153992/prometheus-operator-admission-webhook/0.log" Jun 02 13:49:28.865610 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.865585 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c678f89b4-x5l7j_234def56-b1e3-4a38-ad3f-980e54e9442d/telemeter-client/0.log" Jun 02 13:49:28.887292 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.887272 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c678f89b4-x5l7j_234def56-b1e3-4a38-ad3f-980e54e9442d/reload/0.log" Jun 02 13:49:28.906030 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:28.906009 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c678f89b4-x5l7j_234def56-b1e3-4a38-ad3f-980e54e9442d/kube-rbac-proxy/0.log" Jun 02 13:49:31.170753 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.170725 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-9l68n_6a41cad0-8b20-4e6f-9697-93ac76a9225a/volume-data-source-validator/0.log" Jun 02 13:49:31.740791 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.740757 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp"] Jun 02 13:49:31.741099 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.741087 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0752f221-759e-4a1e-ae31-37f2c2afdea0" containerName="gather" Jun 02 13:49:31.741142 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.741100 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0752f221-759e-4a1e-ae31-37f2c2afdea0" containerName="gather" Jun 02 13:49:31.741142 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.741110 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0752f221-759e-4a1e-ae31-37f2c2afdea0" containerName="copy" Jun 02 13:49:31.741142 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.741116 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0752f221-759e-4a1e-ae31-37f2c2afdea0" containerName="copy" Jun 02 13:49:31.741226 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.741174 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="0752f221-759e-4a1e-ae31-37f2c2afdea0" containerName="copy" Jun 02 13:49:31.741226 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.741185 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="0752f221-759e-4a1e-ae31-37f2c2afdea0" containerName="gather" Jun 02 13:49:31.744668 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.744646 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:31.747067 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.747040 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m6zxs\"/\"kube-root-ca.crt\"" Jun 02 13:49:31.747195 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.747179 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m6zxs\"/\"openshift-service-ca.crt\"" Jun 02 13:49:31.748054 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.748035 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m6zxs\"/\"default-dockercfg-l44nb\"" Jun 02 13:49:31.754284 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.754254 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp"] Jun 02 13:49:31.824831 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.824795 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mwt7z_53a5bd7b-7795-4be2-8547-eb90b389c051/dns/0.log" Jun 02 13:49:31.842400 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.842360 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mwt7z_53a5bd7b-7795-4be2-8547-eb90b389c051/kube-rbac-proxy/0.log" Jun 02 13:49:31.856066 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.856039 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91364059-8dab-4bc5-943b-95fa0b995873-proc\") pod \"perf-node-gather-daemonset-79qvp\" (UID: \"91364059-8dab-4bc5-943b-95fa0b995873\") " pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:31.856204 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.856087 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91364059-8dab-4bc5-943b-95fa0b995873-podres\") pod \"perf-node-gather-daemonset-79qvp\" (UID: \"91364059-8dab-4bc5-943b-95fa0b995873\") " pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:31.856204 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.856127 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91364059-8dab-4bc5-943b-95fa0b995873-lib-modules\") pod \"perf-node-gather-daemonset-79qvp\" (UID: \"91364059-8dab-4bc5-943b-95fa0b995873\") " pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:31.856204 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.856146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91364059-8dab-4bc5-943b-95fa0b995873-sys\") pod \"perf-node-gather-daemonset-79qvp\" (UID: \"91364059-8dab-4bc5-943b-95fa0b995873\") " pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:31.856204 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.856172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7spq8\" (UniqueName: \"kubernetes.io/projected/91364059-8dab-4bc5-943b-95fa0b995873-kube-api-access-7spq8\") pod \"perf-node-gather-daemonset-79qvp\" (UID: \"91364059-8dab-4bc5-943b-95fa0b995873\") " pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:31.882742 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.882716 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nlnt5_037c8b1f-f090-4b5a-972c-f681ef9bcff6/dns-node-resolver/0.log" Jun 02 13:49:31.957637 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.957601 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91364059-8dab-4bc5-943b-95fa0b995873-proc\") pod \"perf-node-gather-daemonset-79qvp\" (UID: \"91364059-8dab-4bc5-943b-95fa0b995873\") " pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:31.957835 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.957655 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91364059-8dab-4bc5-943b-95fa0b995873-podres\") pod \"perf-node-gather-daemonset-79qvp\" (UID: \"91364059-8dab-4bc5-943b-95fa0b995873\") " pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:31.957835 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.957673 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91364059-8dab-4bc5-943b-95fa0b995873-lib-modules\") pod \"perf-node-gather-daemonset-79qvp\" (UID: \"91364059-8dab-4bc5-943b-95fa0b995873\") " pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:31.957835 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.957693 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91364059-8dab-4bc5-943b-95fa0b995873-sys\") pod \"perf-node-gather-daemonset-79qvp\" (UID: \"91364059-8dab-4bc5-943b-95fa0b995873\") " pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:31.957835 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.957727 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7spq8\" (UniqueName: \"kubernetes.io/projected/91364059-8dab-4bc5-943b-95fa0b995873-kube-api-access-7spq8\") pod \"perf-node-gather-daemonset-79qvp\" (UID: \"91364059-8dab-4bc5-943b-95fa0b995873\") " pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:31.957835 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.957751 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91364059-8dab-4bc5-943b-95fa0b995873-proc\") pod \"perf-node-gather-daemonset-79qvp\" (UID: \"91364059-8dab-4bc5-943b-95fa0b995873\") " pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:31.957835 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.957778 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91364059-8dab-4bc5-943b-95fa0b995873-podres\") pod \"perf-node-gather-daemonset-79qvp\" (UID: \"91364059-8dab-4bc5-943b-95fa0b995873\") " pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:31.957835 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.957802 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91364059-8dab-4bc5-943b-95fa0b995873-lib-modules\") pod \"perf-node-gather-daemonset-79qvp\" (UID: \"91364059-8dab-4bc5-943b-95fa0b995873\") " pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:31.958079 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.957953 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91364059-8dab-4bc5-943b-95fa0b995873-sys\") pod \"perf-node-gather-daemonset-79qvp\" (UID: \"91364059-8dab-4bc5-943b-95fa0b995873\") " pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:31.966031 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:31.966006 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7spq8\" (UniqueName: \"kubernetes.io/projected/91364059-8dab-4bc5-943b-95fa0b995873-kube-api-access-7spq8\") pod \"perf-node-gather-daemonset-79qvp\" (UID: \"91364059-8dab-4bc5-943b-95fa0b995873\") " pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:32.056000 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:32.055971 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:32.186633 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:32.186601 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp"] Jun 02 13:49:32.189735 ip-10-0-130-124 kubenswrapper[2578]: W0602 13:49:32.189708 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod91364059_8dab_4bc5_943b_95fa0b995873.slice/crio-41284dd45b139f5ed4279c569db1f636dc817ced95ac6423cdd5f2fe5d5cb986 WatchSource:0}: Error finding container 41284dd45b139f5ed4279c569db1f636dc817ced95ac6423cdd5f2fe5d5cb986: Status 404 returned error can't find the container with id 41284dd45b139f5ed4279c569db1f636dc817ced95ac6423cdd5f2fe5d5cb986 Jun 02 13:49:32.191704 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:32.191686 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 13:49:32.337740 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:32.337661 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nkl7l_9ac71bf8-ef94-4cee-b3aa-07599cf27742/node-ca/0.log" Jun 02 13:49:32.945359 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:32.945328 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-86658498b7-lrbfc_fedc3d80-29d5-4bc9-829d-abcbecbbcf5f/router/0.log" Jun 02 13:49:33.070788 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:33.070750 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" event={"ID":"91364059-8dab-4bc5-943b-95fa0b995873","Type":"ContainerStarted","Data":"6f5fca917d4b07da69b1de38a7171f819e422e2deee8dda69490e7c1a8f6a05c"} Jun 02 13:49:33.070788 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:33.070787 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" event={"ID":"91364059-8dab-4bc5-943b-95fa0b995873","Type":"ContainerStarted","Data":"41284dd45b139f5ed4279c569db1f636dc817ced95ac6423cdd5f2fe5d5cb986"} Jun 02 13:49:33.071032 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:33.070812 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:33.086870 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:33.086822 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" podStartSLOduration=2.086808404 podStartE2EDuration="2.086808404s" podCreationTimestamp="2026-06-02 13:49:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 13:49:33.085001977 +0000 UTC m=+849.392366575" watchObservedRunningTime="2026-06-02 13:49:33.086808404 +0000 UTC m=+849.394172988" Jun 02 13:49:33.218771 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:33.218666 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j4wmd_d38db827-b14d-4561-8411-d4f9e6a613ab/serve-healthcheck-canary/0.log" Jun 02 13:49:33.639942 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:33.639912 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j5g46_c42bf850-7ec6-45a4-afb4-0a1a4408391b/kube-rbac-proxy/0.log" Jun 02 13:49:33.657246 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:33.657223 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j5g46_c42bf850-7ec6-45a4-afb4-0a1a4408391b/exporter/0.log" Jun 02 13:49:33.675499 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:33.675461 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j5g46_c42bf850-7ec6-45a4-afb4-0a1a4408391b/extractor/0.log" Jun 02 13:49:38.172627 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:38.172597 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-p5vp4_2a9a73d0-15c2-4604-a9cf-ae254f856b44/kube-storage-version-migrator-operator/1.log" Jun 02 13:49:38.174867 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:38.174842 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-p5vp4_2a9a73d0-15c2-4604-a9cf-ae254f856b44/kube-storage-version-migrator-operator/0.log" Jun 02 13:49:38.923660 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:38.923630 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99k8j_6cc10233-1c0c-4b74-8965-e49b0d97d906/kube-multus-additional-cni-plugins/0.log" Jun 02 13:49:38.942011 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:38.941979 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99k8j_6cc10233-1c0c-4b74-8965-e49b0d97d906/egress-router-binary-copy/0.log" Jun 02 13:49:38.962357 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:38.962330 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99k8j_6cc10233-1c0c-4b74-8965-e49b0d97d906/cni-plugins/0.log" Jun 02 13:49:38.979844 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:38.979814 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99k8j_6cc10233-1c0c-4b74-8965-e49b0d97d906/bond-cni-plugin/0.log" Jun 02 13:49:38.997517 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:38.997493 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99k8j_6cc10233-1c0c-4b74-8965-e49b0d97d906/routeoverride-cni/0.log" Jun 02 13:49:39.014614 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:39.014591 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99k8j_6cc10233-1c0c-4b74-8965-e49b0d97d906/whereabouts-cni-bincopy/0.log" Jun 02 13:49:39.031593 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:39.031570 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99k8j_6cc10233-1c0c-4b74-8965-e49b0d97d906/whereabouts-cni/0.log" Jun 02 13:49:39.085001 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:39.084969 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m6zxs/perf-node-gather-daemonset-79qvp" Jun 02 13:49:39.362736 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:39.362705 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fn2z4_598c8188-4f93-4742-8ae8-7c96abe18894/kube-multus/0.log" Jun 02 13:49:39.419213 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:39.419186 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lvq7r_ed3b2b23-30df-4e74-8662-a29c58704801/network-metrics-daemon/0.log" Jun 02 13:49:39.435516 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:39.435490 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lvq7r_ed3b2b23-30df-4e74-8662-a29c58704801/kube-rbac-proxy/0.log" Jun 02 13:49:40.426795 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:40.426761 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ck8pc_3554d7b2-3288-4d6c-bc33-ddf4f5ddda33/ovn-controller/0.log" Jun 02 13:49:40.450465 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:40.450440 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ck8pc_3554d7b2-3288-4d6c-bc33-ddf4f5ddda33/ovn-acl-logging/0.log" Jun 02 13:49:40.473701 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:40.473669 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ck8pc_3554d7b2-3288-4d6c-bc33-ddf4f5ddda33/kube-rbac-proxy-node/0.log" Jun 02 13:49:40.495926 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:40.495901 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ck8pc_3554d7b2-3288-4d6c-bc33-ddf4f5ddda33/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 13:49:40.512303 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:40.512279 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ck8pc_3554d7b2-3288-4d6c-bc33-ddf4f5ddda33/northd/0.log" Jun 02 13:49:40.530577 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:40.530549 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ck8pc_3554d7b2-3288-4d6c-bc33-ddf4f5ddda33/nbdb/0.log" Jun 02 13:49:40.551692 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:40.551660 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ck8pc_3554d7b2-3288-4d6c-bc33-ddf4f5ddda33/sbdb/0.log" Jun 02 13:49:40.711332 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:40.711303 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ck8pc_3554d7b2-3288-4d6c-bc33-ddf4f5ddda33/ovnkube-controller/0.log" Jun 02 13:49:41.916312 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:41.916284 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-rck6h_9c643b49-721f-4cf7-8bb3-d7348acc04f3/network-check-target-container/0.log" Jun 02 13:49:42.789700 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:42.789631 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-sxmj2_ee5c0940-9302-4e41-b978-7e2d26e5f929/iptables-alerter/0.log" Jun 02 13:49:43.283665 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:43.283634 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-7rw8k_4413c4bb-65b3-4015-af69-84d1d7d6ec9c/tuned/0.log" Jun 02 13:49:44.773674 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:44.773640 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-755bbf9bfb-rmzb4_58239f28-f968-483a-ac96-f5151dc81a6d/cluster-samples-operator/0.log" Jun 02 13:49:44.787804 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:44.787776 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-755bbf9bfb-rmzb4_58239f28-f968-483a-ac96-f5151dc81a6d/cluster-samples-operator-watch/0.log" Jun 02 13:49:45.595616 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:45.595584 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-69877444c-ssxl2_9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e/service-ca-operator/1.log" Jun 02 13:49:45.597867 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:45.597843 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-69877444c-ssxl2_9f21eedb-8ea5-4b4e-b00a-4e20d6dd635e/service-ca-operator/0.log" Jun 02 13:49:45.883329 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:45.883247 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-685df94d57-pstbv_d1843e90-5a14-4d5a-836c-3f99a4400a61/service-ca-controller/0.log" Jun 02 13:49:46.210292 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:46.210197 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-6xgwk_cc5bda26-742f-4ea7-a266-9c97e87606b9/csi-driver/0.log" Jun 02 13:49:46.229190 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:46.229164 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-6xgwk_cc5bda26-742f-4ea7-a266-9c97e87606b9/csi-node-driver-registrar/0.log" Jun 02 13:49:46.247477 ip-10-0-130-124 kubenswrapper[2578]: I0602 13:49:46.247452 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-6xgwk_cc5bda26-742f-4ea7-a266-9c97e87606b9/csi-liveness-probe/0.log"