Jun 02 15:11:54.615129 ip-10-0-128-172 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 15:11:54.615140 ip-10-0-128-172 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 15:11:54.615147 ip-10-0-128-172 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 15:11:54.615395 ip-10-0-128-172 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 15:12:04.861502 ip-10-0-128-172 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 15:12:04.861521 ip-10-0-128-172 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9eed7ac7dd3c430a9351fe49e390a750 -- Jun 02 15:14:40.294004 ip-10-0-128-172 systemd[1]: Starting Kubernetes Kubelet... Jun 02 15:14:40.747520 ip-10-0-128-172 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:14:40.747520 ip-10-0-128-172 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 15:14:40.747520 ip-10-0-128-172 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:14:40.747520 ip-10-0-128-172 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 15:14:40.747520 ip-10-0-128-172 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:14:40.750535 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.750430 2566 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 15:14:40.757611 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757588 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:14:40.757611 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757608 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:14:40.757611 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757613 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:14:40.757611 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757616 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757620 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757624 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757628 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757632 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757635 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757639 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757642 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757646 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757649 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757653 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757656 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757660 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757664 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757667 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757671 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757674 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757678 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757682 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757686 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:14:40.757871 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757718 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757724 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757732 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757738 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757742 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757746 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757751 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757755 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757759 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757763 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757767 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757771 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757775 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757780 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757784 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757788 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757792 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757796 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757799 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:14:40.758745 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757803 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757807 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757811 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757816 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757822 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757828 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757834 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757839 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757843 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757847 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757851 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757855 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757859 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757863 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757868 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757872 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757876 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757880 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757884 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:14:40.759387 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757888 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757892 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757896 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757900 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757904 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757908 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757913 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757917 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757921 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757925 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757929 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757933 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757937 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757941 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757945 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757951 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757958 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757965 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757969 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757973 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:14:40.760085 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757977 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757982 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757986 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757990 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.757994 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758650 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758660 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758666 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758672 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758676 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758680 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758684 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758688 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758692 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758717 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758723 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758728 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758733 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758737 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758741 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:14:40.760949 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758746 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758750 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758754 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758758 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758762 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758766 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758770 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758774 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758779 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758784 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758789 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758793 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758797 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758802 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758806 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758809 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758813 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758817 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758821 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758825 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:14:40.761569 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758831 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758836 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758840 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758844 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758848 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758852 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758856 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758860 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758864 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758870 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758876 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758881 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758886 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758890 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758894 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758900 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758904 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758908 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758912 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:14:40.762148 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758917 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758921 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758925 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758930 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758934 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758939 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758943 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758947 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758951 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758955 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758959 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758963 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758968 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758972 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758976 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758980 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758984 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758988 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758991 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758995 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:14:40.762722 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.758999 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.759003 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.759007 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.759011 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.759015 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.759019 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.759024 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.759028 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.759032 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.759036 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.759040 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.759044 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759832 2566 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759849 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759861 2566 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759868 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759876 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759882 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759889 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759896 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759901 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 15:14:40.763409 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759906 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759911 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759916 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759922 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759927 2566 flags.go:64] FLAG: --cgroup-root="" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759931 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759937 2566 flags.go:64] FLAG: --client-ca-file="" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759941 2566 flags.go:64] FLAG: --cloud-config="" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759946 2566 flags.go:64] FLAG: --cloud-provider="external" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759950 2566 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759956 2566 flags.go:64] FLAG: --cluster-domain="" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759961 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759967 2566 flags.go:64] FLAG: --config-dir="" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759972 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759978 2566 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759984 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759989 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759994 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.759999 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760004 2566 flags.go:64] FLAG: --contention-profiling="false" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760009 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760013 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760019 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760023 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760030 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 15:14:40.763939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760034 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760039 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760044 2566 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760050 2566 flags.go:64] FLAG: --enable-server="true" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760054 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760062 2566 flags.go:64] FLAG: --event-burst="100" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760067 2566 flags.go:64] FLAG: --event-qps="50" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760072 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760077 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760082 2566 flags.go:64] FLAG: --eviction-hard="" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760088 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760092 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760097 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760102 2566 flags.go:64] FLAG: --eviction-soft="" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760107 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760111 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760116 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760121 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760126 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760133 2566 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760137 2566 flags.go:64] FLAG: --feature-gates="" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760144 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760149 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760154 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760159 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760164 2566 flags.go:64] FLAG: --healthz-port="10248" Jun 02 15:14:40.764625 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760169 2566 flags.go:64] FLAG: --help="false" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760174 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-128-172.ec2.internal" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760180 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760184 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760189 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760195 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760200 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760205 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760210 2566 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760215 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760221 2566 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760226 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760231 2566 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760236 2566 flags.go:64] FLAG: --kube-reserved="" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760240 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760246 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760254 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760259 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760264 2566 flags.go:64] FLAG: --lock-file="" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760268 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760273 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760278 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760294 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 15:14:40.765275 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760299 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760305 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760309 2566 flags.go:64] FLAG: --logging-format="text" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760314 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760319 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760324 2566 flags.go:64] FLAG: --manifest-url="" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760328 2566 flags.go:64] FLAG: --manifest-url-header="" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760336 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760342 2566 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760348 2566 flags.go:64] FLAG: --max-pods="110" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760354 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760358 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760363 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760367 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760372 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760377 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760382 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760393 2566 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760398 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760403 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760408 2566 flags.go:64] FLAG: --pod-cidr="" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760413 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760421 2566 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760426 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 15:14:40.765850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760433 2566 flags.go:64] FLAG: --pods-per-core="0" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760438 2566 flags.go:64] FLAG: --port="10250" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760444 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760449 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09aee97b949a362c4" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760454 2566 flags.go:64] FLAG: --qos-reserved="" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760459 2566 flags.go:64] FLAG: --read-only-port="10255" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760464 2566 flags.go:64] FLAG: --register-node="true" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760469 2566 flags.go:64] FLAG: --register-schedulable="true" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760474 2566 flags.go:64] FLAG: --register-with-taints="" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760479 2566 flags.go:64] FLAG: --registry-burst="10" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760484 2566 flags.go:64] FLAG: --registry-qps="5" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760488 2566 flags.go:64] FLAG: --reserved-cpus="" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760493 2566 flags.go:64] FLAG: --reserved-memory="" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760499 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760504 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760510 2566 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760514 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760519 2566 flags.go:64] FLAG: --runonce="false" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760523 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760528 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760533 2566 flags.go:64] FLAG: --seccomp-default="false" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760537 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760543 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760547 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760552 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760557 2566 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 15:14:40.766414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760562 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760566 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760571 2566 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760576 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760581 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760586 2566 flags.go:64] FLAG: --system-cgroups="" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760592 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760601 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760606 2566 flags.go:64] FLAG: --tls-cert-file="" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760611 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760618 2566 flags.go:64] FLAG: --tls-min-version="" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760622 2566 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760627 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760632 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760636 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760641 2566 flags.go:64] FLAG: --v="2" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760647 2566 flags.go:64] FLAG: --version="false" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760653 2566 flags.go:64] FLAG: --vmodule="" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760660 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.760666 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760834 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760843 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760848 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760852 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:14:40.767101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760856 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760861 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760865 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760869 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760873 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760878 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760882 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760886 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760890 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760894 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760898 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760902 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760907 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760910 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760921 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760925 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760931 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760935 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760939 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760943 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:14:40.767726 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760948 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760951 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760955 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760959 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760962 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760966 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760971 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760975 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760978 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760983 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760988 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760992 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.760996 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761000 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761005 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761009 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761013 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761017 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761021 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:14:40.768237 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761026 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761030 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761034 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761038 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761042 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761046 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761051 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761056 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761060 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761065 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761070 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761074 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761078 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761082 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761087 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761091 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761095 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761099 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761103 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:14:40.768691 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761109 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761114 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761118 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761122 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761127 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761131 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761135 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761139 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761143 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761146 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761150 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761154 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761158 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761162 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761166 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761171 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761175 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761179 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761183 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761187 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:14:40.769196 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761196 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:14:40.769681 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761202 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:14:40.769681 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761208 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:14:40.769681 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.761214 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:14:40.769681 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.762088 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:14:40.769681 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.768660 2566 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 15:14:40.769681 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.768679 2566 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 15:14:40.769681 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768744 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:14:40.769681 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768751 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:14:40.769681 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768755 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:14:40.769681 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768758 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:14:40.769681 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768760 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:14:40.769681 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768763 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:14:40.769681 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768766 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:14:40.769681 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768769 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:14:40.769681 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768771 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768774 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768776 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768778 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768781 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768783 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768786 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768788 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768791 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768793 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768796 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768799 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768802 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768804 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768806 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768809 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768811 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768813 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768816 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768819 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:14:40.770073 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768821 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768824 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768826 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768830 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768832 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768835 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768837 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768840 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768843 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768845 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768848 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768850 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768852 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768855 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768857 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768860 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768862 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768864 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768867 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768870 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:14:40.770601 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768872 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768875 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768877 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768880 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768882 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768885 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768888 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768890 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768892 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768895 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768897 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768899 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768902 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768905 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768907 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768910 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768913 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768915 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768918 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768920 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:14:40.771101 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768922 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:14:40.771584 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768925 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:14:40.771584 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768928 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:14:40.771584 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768930 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:14:40.771584 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768933 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:14:40.771584 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768935 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:14:40.771584 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768938 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:14:40.771584 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768940 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:14:40.771584 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768944 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:14:40.771584 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768947 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:14:40.771584 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768949 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:14:40.771584 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768953 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:14:40.771584 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768957 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:14:40.771584 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768960 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:14:40.771584 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768962 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:14:40.771584 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768965 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:14:40.771584 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768967 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:14:40.771584 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.768970 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:14:40.772112 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.768975 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:14:40.772112 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769076 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:14:40.772112 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769080 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:14:40.772112 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769082 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:14:40.772112 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769085 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:14:40.772112 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769088 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:14:40.772112 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769091 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:14:40.772112 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769093 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:14:40.772112 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769096 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:14:40.772112 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769099 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:14:40.772112 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769101 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:14:40.772112 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769104 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:14:40.772112 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769107 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:14:40.772112 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769109 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:14:40.772112 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769113 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769116 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769119 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769121 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769124 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769126 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769128 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769131 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769133 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769136 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769138 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769140 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769143 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769145 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769148 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769150 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769152 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769155 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769158 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769160 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:14:40.772463 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769162 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769164 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769167 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769169 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769172 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769174 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769177 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769179 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769181 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769184 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769187 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769189 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769191 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769194 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769196 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769199 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769202 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769204 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769207 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769209 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:14:40.772958 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769212 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769214 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769216 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769219 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769221 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769223 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769226 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769228 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769230 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769233 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769237 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769240 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769243 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769245 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769248 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769250 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769253 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769256 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769258 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:14:40.773432 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769261 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:14:40.773899 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769263 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:14:40.773899 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769265 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:14:40.773899 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769268 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:14:40.773899 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769270 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:14:40.773899 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769272 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:14:40.773899 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769275 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:14:40.773899 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769277 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:14:40.773899 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769279 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:14:40.773899 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769282 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:14:40.773899 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769284 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:14:40.773899 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769287 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:14:40.773899 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769289 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:14:40.773899 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:40.769291 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:14:40.773899 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.769296 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:14:40.773899 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.769889 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 15:14:40.773899 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.771821 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 15:14:40.774291 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.772782 2566 server.go:1019] "Starting client certificate rotation" Jun 02 15:14:40.774291 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.772882 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 15:14:40.774291 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.772922 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 15:14:40.795056 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.795034 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 15:14:40.797118 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.797100 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 15:14:40.812022 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.811998 2566 log.go:25] "Validated CRI v1 runtime API" Jun 02 15:14:40.819837 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.819816 2566 log.go:25] "Validated CRI v1 image API" Jun 02 15:14:40.821830 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.821811 2566 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 15:14:40.826329 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.826309 2566 fs.go:135] Filesystem UUIDs: map[46d5e9d6-f71f-49ab-a6ad-9ef2c621a20f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 fe45f3d4-0dc3-4693-947a-c0490130346f:/dev/nvme0n1p4] Jun 02 15:14:40.826384 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.826329 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 15:14:40.830662 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.830543 2566 manager.go:217] Machine: {Timestamp:2026-06-02 15:14:40.830012288 +0000 UTC m=+0.415663281 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2499998 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec249716251a2676c3b1a9516d8e4bcd SystemUUID:ec249716-251a-2676-c3b1-a9516d8e4bcd BootID:9eed7ac7-dd3c-430a-9351-fe49e390a750 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:13:90:65:cf:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:13:90:65:cf:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:5b:2e:d7:93:ca Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 15:14:40.830662 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.830655 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 15:14:40.830795 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.830750 2566 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 15:14:40.832531 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.832503 2566 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 15:14:40.832682 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.832535 2566 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-172.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 15:14:40.832741 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.832694 2566 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 15:14:40.832741 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.832720 2566 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 15:14:40.832741 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.832729 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 15:14:40.833605 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.833595 2566 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 15:14:40.834591 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.834581 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 02 15:14:40.834893 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.834883 2566 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 15:14:40.837466 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.837456 2566 kubelet.go:491] "Attempting to sync node with API server" Jun 02 15:14:40.837501 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.837472 2566 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 15:14:40.837501 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.837484 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 15:14:40.837501 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.837493 2566 kubelet.go:397] "Adding apiserver pod source" Jun 02 15:14:40.837623 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.837503 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 15:14:40.837839 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.837818 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 15:14:40.838831 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.838816 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 15:14:40.838893 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.838844 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 15:14:40.842871 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.842849 2566 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 15:14:40.844898 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.844881 2566 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 15:14:40.847339 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.847325 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 15:14:40.847414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.847342 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 15:14:40.847414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.847349 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 15:14:40.847414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.847354 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 15:14:40.847414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.847363 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 15:14:40.847414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.847368 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 15:14:40.847414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.847374 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 15:14:40.847414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.847379 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 15:14:40.847414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.847387 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 15:14:40.847414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.847393 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 15:14:40.847414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.847405 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 15:14:40.847414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.847410 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 15:14:40.848453 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.848441 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 15:14:40.848489 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.848457 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 15:14:40.848739 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:40.848687 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 15:14:40.848806 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:40.848748 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-172.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 15:14:40.851571 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.851558 2566 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 15:14:40.851622 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.851594 2566 server.go:1295] "Started kubelet" Jun 02 15:14:40.851753 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.851688 2566 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 15:14:40.851838 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.851766 2566 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 15:14:40.852544 ip-10-0-128-172 systemd[1]: Started Kubernetes Kubelet. Jun 02 15:14:40.853261 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.853236 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 15:14:40.853340 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.853313 2566 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 15:14:40.857992 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.857965 2566 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-172.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 15:14:40.858859 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.858843 2566 server.go:317] "Adding debug handlers to kubelet server" Jun 02 15:14:40.862450 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:40.862427 2566 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 15:14:40.864129 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.864108 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 15:14:40.864693 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.864678 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 15:14:40.864803 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.864756 2566 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 15:14:40.864803 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.864771 2566 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 15:14:40.864908 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.864877 2566 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 15:14:40.864966 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.864922 2566 reconstruct.go:97] "Volume reconstruction finished" Jun 02 15:14:40.864966 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.864930 2566 reconciler.go:26] "Reconciler: start to sync state" Jun 02 15:14:40.865671 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.865653 2566 factory.go:153] Registering CRI-O factory Jun 02 15:14:40.865671 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.865673 2566 factory.go:223] Registration of the crio container factory successfully Jun 02 15:14:40.865823 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.865752 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 15:14:40.865823 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.865762 2566 factory.go:55] Registering systemd factory Jun 02 15:14:40.865823 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.865769 2566 factory.go:223] Registration of the systemd container factory successfully Jun 02 15:14:40.865823 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.865785 2566 factory.go:103] Registering Raw factory Jun 02 15:14:40.865823 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.865798 2566 manager.go:1196] Started watching for new ooms in manager Jun 02 15:14:40.866099 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.866076 2566 manager.go:319] Starting recovery of all containers Jun 02 15:14:40.866614 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:40.866594 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jun 02 15:14:40.866859 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:40.865668 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-172.ec2.internal.18b54c72268bb325 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-172.ec2.internal,UID:ip-10-0-128-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-172.ec2.internal,},FirstTimestamp:2026-06-02 15:14:40.851571493 +0000 UTC m=+0.437222484,LastTimestamp:2026-06-02 15:14:40.851571493 +0000 UTC m=+0.437222484,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-172.ec2.internal,}" Jun 02 15:14:40.873478 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.873313 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dj9p8" Jun 02 15:14:40.875898 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:40.875863 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 15:14:40.876072 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:40.876047 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-172.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 15:14:40.876919 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.876905 2566 manager.go:324] Recovery completed Jun 02 15:14:40.881360 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.881348 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:14:40.882298 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.882282 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dj9p8" Jun 02 15:14:40.883284 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.883258 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:14:40.883362 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.883290 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:14:40.883362 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.883300 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:14:40.883850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.883836 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 15:14:40.883850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.883848 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 15:14:40.883973 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.883861 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 02 15:14:40.886214 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.886203 2566 policy_none.go:49] "None policy: Start" Jun 02 15:14:40.886254 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.886218 2566 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 15:14:40.886254 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.886228 2566 state_mem.go:35] "Initializing new in-memory state store" Jun 02 15:14:40.928383 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.928365 2566 manager.go:341] "Starting Device Plugin manager" Jun 02 15:14:40.940944 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:40.928407 2566 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 15:14:40.940944 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.928417 2566 server.go:85] "Starting device plugin registration server" Jun 02 15:14:40.940944 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.928680 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 15:14:40.940944 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.928694 2566 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 15:14:40.940944 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.928822 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 15:14:40.940944 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.928893 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 15:14:40.940944 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.928902 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 15:14:40.940944 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:40.929486 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 15:14:40.940944 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:40.929529 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-172.ec2.internal\" not found" Jun 02 15:14:40.992271 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.992234 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 15:14:40.993510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.993490 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 15:14:40.993510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.993509 2566 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 15:14:40.993647 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.993527 2566 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 15:14:40.993647 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.993533 2566 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 15:14:40.993647 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:40.993570 2566 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 15:14:40.996540 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:40.996521 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:14:41.029562 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.029484 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:14:41.031322 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.031295 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:14:41.031454 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.031332 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:14:41.031454 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.031348 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:14:41.031454 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.031384 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-172.ec2.internal" Jun 02 15:14:41.045641 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.045615 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-172.ec2.internal" Jun 02 15:14:41.045641 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:41.045643 2566 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-172.ec2.internal\": node \"ip-10-0-128-172.ec2.internal\" not found" Jun 02 15:14:41.069146 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:41.069121 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jun 02 15:14:41.093800 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.093759 2566 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal"] Jun 02 15:14:41.093870 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.093845 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:14:41.095770 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.095755 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:14:41.095846 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.095781 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:14:41.095846 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.095793 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:14:41.096900 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.096888 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:14:41.097078 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.097060 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jun 02 15:14:41.097138 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.097099 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:14:41.097627 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.097611 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:14:41.097714 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.097642 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:14:41.097714 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.097611 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:14:41.097714 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.097679 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:14:41.097714 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.097652 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:14:41.097844 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.097714 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:14:41.098877 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.098863 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" Jun 02 15:14:41.098939 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.098893 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:14:41.099545 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.099531 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:14:41.099630 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.099555 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:14:41.099630 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.099565 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:14:41.119475 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:41.119447 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-172.ec2.internal\" not found" node="ip-10-0-128-172.ec2.internal" Jun 02 15:14:41.123783 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:41.123766 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-172.ec2.internal\" not found" node="ip-10-0-128-172.ec2.internal" Jun 02 15:14:41.166525 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.166494 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9e938b4c5ad2016df02d26d5058dc76f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal\" (UID: \"9e938b4c5ad2016df02d26d5058dc76f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jun 02 15:14:41.166633 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.166534 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e938b4c5ad2016df02d26d5058dc76f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal\" (UID: \"9e938b4c5ad2016df02d26d5058dc76f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jun 02 15:14:41.166633 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.166550 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c965875c7d97cdd2b7f7dc64a963ce12-config\") pod \"kube-apiserver-proxy-ip-10-0-128-172.ec2.internal\" (UID: \"c965875c7d97cdd2b7f7dc64a963ce12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" Jun 02 15:14:41.169588 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:41.169574 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jun 02 15:14:41.267243 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.267212 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9e938b4c5ad2016df02d26d5058dc76f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal\" (UID: \"9e938b4c5ad2016df02d26d5058dc76f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jun 02 15:14:41.267338 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.267247 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e938b4c5ad2016df02d26d5058dc76f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal\" (UID: \"9e938b4c5ad2016df02d26d5058dc76f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jun 02 15:14:41.267338 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.267264 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c965875c7d97cdd2b7f7dc64a963ce12-config\") pod \"kube-apiserver-proxy-ip-10-0-128-172.ec2.internal\" (UID: \"c965875c7d97cdd2b7f7dc64a963ce12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" Jun 02 15:14:41.267338 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.267315 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c965875c7d97cdd2b7f7dc64a963ce12-config\") pod \"kube-apiserver-proxy-ip-10-0-128-172.ec2.internal\" (UID: \"c965875c7d97cdd2b7f7dc64a963ce12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" Jun 02 15:14:41.267338 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.267329 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e938b4c5ad2016df02d26d5058dc76f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal\" (UID: \"9e938b4c5ad2016df02d26d5058dc76f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jun 02 15:14:41.267456 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.267356 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9e938b4c5ad2016df02d26d5058dc76f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal\" (UID: \"9e938b4c5ad2016df02d26d5058dc76f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jun 02 15:14:41.270301 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:41.270287 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jun 02 15:14:41.371164 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:41.371097 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jun 02 15:14:41.423293 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.423260 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jun 02 15:14:41.427917 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.427895 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" Jun 02 15:14:41.471949 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:41.471920 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jun 02 15:14:41.572442 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:41.572410 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jun 02 15:14:41.673017 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:41.672942 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jun 02 15:14:41.772469 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.772435 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 15:14:41.773134 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.772609 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 15:14:41.773514 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:41.773496 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jun 02 15:14:41.865004 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.864978 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 15:14:41.874268 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:41.874247 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jun 02 15:14:41.876745 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.876726 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 15:14:41.884414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.884383 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 15:09:40 +0000 UTC" deadline="2027-10-30 02:20:12.140647232 +0000 UTC" Jun 02 15:14:41.884414 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.884413 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12347h5m30.256236991s" Jun 02 15:14:41.907745 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.907719 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kwmw2" Jun 02 15:14:41.916119 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.916097 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kwmw2" Jun 02 15:14:41.948498 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:41.948471 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e938b4c5ad2016df02d26d5058dc76f.slice/crio-25d4e9a4c5e3a18e1a833a3b1f76828927e40fb72856db861359b1c039fec7e2 WatchSource:0}: Error finding container 25d4e9a4c5e3a18e1a833a3b1f76828927e40fb72856db861359b1c039fec7e2: Status 404 returned error can't find the container with id 25d4e9a4c5e3a18e1a833a3b1f76828927e40fb72856db861359b1c039fec7e2 Jun 02 15:14:41.948720 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:41.948681 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc965875c7d97cdd2b7f7dc64a963ce12.slice/crio-30d26def84599314aea6f4eecb69633816c0304a65ebe74a211ba0cabf1faff8 WatchSource:0}: Error finding container 30d26def84599314aea6f4eecb69633816c0304a65ebe74a211ba0cabf1faff8: Status 404 returned error can't find the container with id 30d26def84599314aea6f4eecb69633816c0304a65ebe74a211ba0cabf1faff8 Jun 02 15:14:41.952379 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.952362 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:14:41.974726 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:41.974688 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jun 02 15:14:41.996793 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.996743 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" event={"ID":"9e938b4c5ad2016df02d26d5058dc76f","Type":"ContainerStarted","Data":"25d4e9a4c5e3a18e1a833a3b1f76828927e40fb72856db861359b1c039fec7e2"} Jun 02 15:14:41.997647 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:41.997624 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" event={"ID":"c965875c7d97cdd2b7f7dc64a963ce12","Type":"ContainerStarted","Data":"30d26def84599314aea6f4eecb69633816c0304a65ebe74a211ba0cabf1faff8"} Jun 02 15:14:42.060503 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.060472 2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:14:42.074980 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:42.074958 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jun 02 15:14:42.083585 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.083562 2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:14:42.175346 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:42.175310 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jun 02 15:14:42.275884 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:42.275800 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jun 02 15:14:42.376673 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:42.376643 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jun 02 15:14:42.384241 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.384220 2566 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:14:42.465388 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.465351 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" Jun 02 15:14:42.477198 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.477166 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 15:14:42.478019 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.477991 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jun 02 15:14:42.489084 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.489052 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 15:14:42.840387 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.840358 2566 apiserver.go:52] "Watching apiserver" Jun 02 15:14:42.847102 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.847080 2566 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 15:14:42.849164 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.849131 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-vpzdk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal","openshift-multus/multus-additional-cni-plugins-ws4sb","openshift-network-operator/iptables-alerter-z7fp7","openshift-ovn-kubernetes/ovnkube-node-mlbxc","kube-system/konnectivity-agent-84jcn","openshift-cluster-node-tuning-operator/tuned-2s766","openshift-dns/node-resolver-7zgg4","openshift-multus/multus-7g7rb","openshift-multus/network-metrics-daemon-md8jp","openshift-network-diagnostics/network-check-target-6xl9v","kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv"] Jun 02 15:14:42.850606 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.850585 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.852340 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.851681 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.853506 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.852764 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z7fp7" Jun 02 15:14:42.854196 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.854177 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.854818 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.854504 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kr6qn\"" Jun 02 15:14:42.854818 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.854731 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 15:14:42.854818 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.854749 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 15:14:42.854818 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.854757 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:14:42.856345 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.855506 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 15:14:42.856345 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.855964 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 15:14:42.856724 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.856685 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 15:14:42.857874 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.857849 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 15:14:42.859636 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.859018 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 15:14:42.859636 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.859069 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 15:14:42.859636 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.859216 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:14:42.859636 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.859295 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mqh57\"" Jun 02 15:14:42.859636 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.859613 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-84jcn" Jun 02 15:14:42.859892 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.859024 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zgj6j\"" Jun 02 15:14:42.860829 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.860808 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 15:14:42.860909 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.860895 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mxqvg\"" Jun 02 15:14:42.860991 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.860970 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 15:14:42.861366 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.861263 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 15:14:42.861461 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.861443 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 15:14:42.861646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.861629 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 15:14:42.862190 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.862172 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vpzdk" Jun 02 15:14:42.862888 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.862754 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 15:14:42.863748 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.863331 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7zgg4" Jun 02 15:14:42.863748 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.863423 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.864264 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.864246 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 15:14:42.864350 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.864281 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9rc9k\"" Jun 02 15:14:42.864497 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.864481 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 15:14:42.865875 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.865855 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 15:14:42.865996 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.865980 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:42.866070 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:42.866048 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:14:42.866134 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.866100 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 15:14:42.866217 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.866201 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:14:42.866305 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.866285 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 15:14:42.866442 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.866426 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zg9kc\"" Jun 02 15:14:42.866442 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:42.866289 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:14:42.866569 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.866440 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 15:14:42.866961 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.866946 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 15:14:42.867164 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.867149 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 15:14:42.867280 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.867264 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:42.867510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.867493 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2k8dj\"" Jun 02 15:14:42.868274 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.867874 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nhnww\"" Jun 02 15:14:42.869670 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.869651 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 15:14:42.870352 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.870325 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 15:14:42.870438 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.870363 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rszzp\"" Jun 02 15:14:42.870659 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.870636 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 15:14:42.876818 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.876798 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-systemd-units\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.876904 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.876833 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f747a7ca-d127-4064-95aa-13e4dafe9d22-iptables-alerter-script\") pod \"iptables-alerter-z7fp7\" (UID: \"f747a7ca-d127-4064-95aa-13e4dafe9d22\") " pod="openshift-network-operator/iptables-alerter-z7fp7" Jun 02 15:14:42.876904 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.876860 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-log-socket\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.876904 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.876886 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvqk6\" (UniqueName: \"kubernetes.io/projected/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-kube-api-access-vvqk6\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.877057 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.876912 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-os-release\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.877057 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.876936 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-systemd\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.877057 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.876979 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f747a7ca-d127-4064-95aa-13e4dafe9d22-host-slash\") pod \"iptables-alerter-z7fp7\" (UID: \"f747a7ca-d127-4064-95aa-13e4dafe9d22\") " pod="openshift-network-operator/iptables-alerter-z7fp7" Jun 02 15:14:42.877057 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877012 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee7fa008-6c9e-4db5-9cb5-11f5b181e582-serviceca\") pod \"node-ca-vpzdk\" (UID: \"ee7fa008-6c9e-4db5-9cb5-11f5b181e582\") " pod="openshift-image-registry/node-ca-vpzdk" Jun 02 15:14:42.877057 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877038 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fftkr\" (UniqueName: \"kubernetes.io/projected/ee7fa008-6c9e-4db5-9cb5-11f5b181e582-kube-api-access-fftkr\") pod \"node-ca-vpzdk\" (UID: \"ee7fa008-6c9e-4db5-9cb5-11f5b181e582\") " pod="openshift-image-registry/node-ca-vpzdk" Jun 02 15:14:42.877297 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877065 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-multus-socket-dir-parent\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.877297 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877088 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-run-netns\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.877297 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877136 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-etc-openvswitch\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.877297 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877160 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3399fc44-4af2-4e59-8a97-a22f8110b914-env-overrides\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.877297 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877183 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3399fc44-4af2-4e59-8a97-a22f8110b914-ovnkube-script-lib\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.877297 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877217 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.877297 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877245 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-multus-conf-dir\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.877297 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877276 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-multus-daemon-config\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.877661 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877327 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zm7j\" (UniqueName: \"kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j\") pod \"network-check-target-6xl9v\" (UID: \"9f1fef37-4e7b-4565-a20d-8e4d7994625e\") " pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:14:42.877661 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877370 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-sys\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.877661 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877396 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-node-log\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.877661 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877446 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-multus-cni-dir\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.877661 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877474 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-host\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.877661 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877499 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-run-ovn\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.877661 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877520 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee7fa008-6c9e-4db5-9cb5-11f5b181e582-host\") pod \"node-ca-vpzdk\" (UID: \"ee7fa008-6c9e-4db5-9cb5-11f5b181e582\") " pod="openshift-image-registry/node-ca-vpzdk" Jun 02 15:14:42.877661 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877541 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81690d60-d545-4a62-805e-c966443073b4-tmp-dir\") pod \"node-resolver-7zgg4\" (UID: \"81690d60-d545-4a62-805e-c966443073b4\") " pod="openshift-dns/node-resolver-7zgg4" Jun 02 15:14:42.877661 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877578 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-run-k8s-cni-cncf-io\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.877661 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877597 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-kubernetes\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.877661 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877612 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-cnibin\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.877661 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877628 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-sysconfig\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.878133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877664 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-var-lib-openvswitch\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.878133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877694 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-cni-binary-copy\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.878133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877759 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-slash\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.878133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877799 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sjlf\" (UniqueName: \"kubernetes.io/projected/81690d60-d545-4a62-805e-c966443073b4-kube-api-access-5sjlf\") pod \"node-resolver-7zgg4\" (UID: \"81690d60-d545-4a62-805e-c966443073b4\") " pod="openshift-dns/node-resolver-7zgg4" Jun 02 15:14:42.878133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877830 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-os-release\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.878133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877852 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-hostroot\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.878133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877876 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsg98\" (UniqueName: \"kubernetes.io/projected/f747a7ca-d127-4064-95aa-13e4dafe9d22-kube-api-access-zsg98\") pod \"iptables-alerter-z7fp7\" (UID: \"f747a7ca-d127-4064-95aa-13e4dafe9d22\") " pod="openshift-network-operator/iptables-alerter-z7fp7" Jun 02 15:14:42.878133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877898 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-run-netns\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.878133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877916 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpmdp\" (UniqueName: \"kubernetes.io/projected/4814aa17-8f1d-4de5-80a7-f0d823d2c818-kube-api-access-jpmdp\") pod \"network-metrics-daemon-md8jp\" (UID: \"4814aa17-8f1d-4de5-80a7-f0d823d2c818\") " pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:42.878133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877930 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-var-lib-kubelet\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.878133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877947 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-cnibin\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.878133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877975 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs\") pod \"network-metrics-daemon-md8jp\" (UID: \"4814aa17-8f1d-4de5-80a7-f0d823d2c818\") " pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:42.878133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.877993 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-run\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.878133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878007 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6wzq\" (UniqueName: \"kubernetes.io/projected/366b12b3-4c11-478e-a8e2-ff79880ae709-kube-api-access-m6wzq\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.878133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878070 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-cni-netd\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.878133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878089 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3399fc44-4af2-4e59-8a97-a22f8110b914-ovn-node-metrics-cert\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.878878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878120 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa0e7977-049c-4213-8732-790894fcc011-agent-certs\") pod \"konnectivity-agent-84jcn\" (UID: \"fa0e7977-049c-4213-8732-790894fcc011\") " pod="kube-system/konnectivity-agent-84jcn" Jun 02 15:14:42.878878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878141 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-cni-binary-copy\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.878878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878155 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-var-lib-cni-multus\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.878878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878170 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-etc-kubernetes\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.878878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878189 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x64qs\" (UniqueName: \"kubernetes.io/projected/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-kube-api-access-x64qs\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.878878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878208 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/366b12b3-4c11-478e-a8e2-ff79880ae709-tmp\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.878878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878222 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-var-lib-cni-bin\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.878878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878239 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-run-systemd\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.878878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878255 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-sysctl-d\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.878878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878276 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-lib-modules\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.878878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878306 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-run-openvswitch\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.878878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878330 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81690d60-d545-4a62-805e-c966443073b4-hosts-file\") pod \"node-resolver-7zgg4\" (UID: \"81690d60-d545-4a62-805e-c966443073b4\") " pod="openshift-dns/node-resolver-7zgg4" Jun 02 15:14:42.878878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878353 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.878878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878376 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-run-multus-certs\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.878878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878400 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-sysctl-conf\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.878878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878418 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-tuned\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.878878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878452 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-kubelet\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.879675 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878493 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3399fc44-4af2-4e59-8a97-a22f8110b914-ovnkube-config\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.879675 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5knq\" (UniqueName: \"kubernetes.io/projected/3399fc44-4af2-4e59-8a97-a22f8110b914-kube-api-access-x5knq\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.879675 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878585 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.879675 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878609 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-modprobe-d\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.879675 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878635 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-run-ovn-kubernetes\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.879675 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878659 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.879675 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878685 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-system-cni-dir\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.879675 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878737 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-cni-bin\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.879675 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878754 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa0e7977-049c-4213-8732-790894fcc011-konnectivity-ca\") pod \"konnectivity-agent-84jcn\" (UID: \"fa0e7977-049c-4213-8732-790894fcc011\") " pod="kube-system/konnectivity-agent-84jcn" Jun 02 15:14:42.879675 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878769 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-system-cni-dir\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.879675 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.878790 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-var-lib-kubelet\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.916826 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.916786 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 15:09:41 +0000 UTC" deadline="2028-01-13 05:09:23.442538975 +0000 UTC" Jun 02 15:14:42.916937 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.916827 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14149h54m40.525715661s" Jun 02 15:14:42.965916 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.965890 2566 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 15:14:42.979049 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979022 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zsg98\" (UniqueName: \"kubernetes.io/projected/f747a7ca-d127-4064-95aa-13e4dafe9d22-kube-api-access-zsg98\") pod \"iptables-alerter-z7fp7\" (UID: \"f747a7ca-d127-4064-95aa-13e4dafe9d22\") " pod="openshift-network-operator/iptables-alerter-z7fp7" Jun 02 15:14:42.979181 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979059 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-run-netns\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.979181 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979085 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jpmdp\" (UniqueName: \"kubernetes.io/projected/4814aa17-8f1d-4de5-80a7-f0d823d2c818-kube-api-access-jpmdp\") pod \"network-metrics-daemon-md8jp\" (UID: \"4814aa17-8f1d-4de5-80a7-f0d823d2c818\") " pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:42.979181 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979106 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-var-lib-kubelet\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.979181 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979127 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-cnibin\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.979181 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979152 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs\") pod \"network-metrics-daemon-md8jp\" (UID: \"4814aa17-8f1d-4de5-80a7-f0d823d2c818\") " pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:42.979181 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979172 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-run\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.979461 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979197 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m6wzq\" (UniqueName: \"kubernetes.io/projected/366b12b3-4c11-478e-a8e2-ff79880ae709-kube-api-access-m6wzq\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.979461 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979223 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-cni-netd\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.979461 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979263 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3399fc44-4af2-4e59-8a97-a22f8110b914-ovn-node-metrics-cert\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.979461 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979288 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa0e7977-049c-4213-8732-790894fcc011-agent-certs\") pod \"konnectivity-agent-84jcn\" (UID: \"fa0e7977-049c-4213-8732-790894fcc011\") " pod="kube-system/konnectivity-agent-84jcn" Jun 02 15:14:42.979461 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979313 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-cni-binary-copy\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.979461 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:42.979334 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:14:42.979461 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979387 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-var-lib-cni-multus\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.979461 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979401 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-cni-netd\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.979461 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:42.979452 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs podName:4814aa17-8f1d-4de5-80a7-f0d823d2c818 nodeName:}" failed. No retries permitted until 2026-06-02 15:14:43.479400619 +0000 UTC m=+3.065051602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs") pod "network-metrics-daemon-md8jp" (UID: "4814aa17-8f1d-4de5-80a7-f0d823d2c818") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979506 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-var-lib-kubelet\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979552 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-cnibin\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979338 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-var-lib-cni-multus\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979589 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-etc-kubernetes\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979615 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x64qs\" (UniqueName: \"kubernetes.io/projected/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-kube-api-access-x64qs\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979644 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-registration-dir\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979670 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-device-dir\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979694 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/366b12b3-4c11-478e-a8e2-ff79880ae709-tmp\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979741 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-var-lib-cni-bin\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979767 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-run-systemd\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979784 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979790 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-sysctl-d\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979816 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-lib-modules\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979839 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-run-openvswitch\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979860 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81690d60-d545-4a62-805e-c966443073b4-hosts-file\") pod \"node-resolver-7zgg4\" (UID: \"81690d60-d545-4a62-805e-c966443073b4\") " pod="openshift-dns/node-resolver-7zgg4" Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979881 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979902 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-run-multus-certs\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.979932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979923 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx7q9\" (UniqueName: \"kubernetes.io/projected/9165ab25-b39d-481f-9983-2c6c4bfdd78b-kube-api-access-jx7q9\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:42.980828 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979946 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-sysctl-conf\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.980828 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.979979 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-tuned\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.980828 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980009 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-kubelet\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.980828 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980034 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3399fc44-4af2-4e59-8a97-a22f8110b914-ovnkube-config\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.980828 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980058 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5knq\" (UniqueName: \"kubernetes.io/projected/3399fc44-4af2-4e59-8a97-a22f8110b914-kube-api-access-x5knq\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.980828 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980075 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.980828 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980098 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-modprobe-d\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.980828 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980125 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-run-ovn-kubernetes\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.980828 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980154 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-etc-kubernetes\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.980828 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980156 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.980828 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980171 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-cni-binary-copy\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.980828 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980196 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-system-cni-dir\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.980828 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980224 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-cni-bin\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.980828 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980239 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-run\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.980828 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980243 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa0e7977-049c-4213-8732-790894fcc011-konnectivity-ca\") pod \"konnectivity-agent-84jcn\" (UID: \"fa0e7977-049c-4213-8732-790894fcc011\") " pod="kube-system/konnectivity-agent-84jcn" Jun 02 15:14:42.980828 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980283 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-system-cni-dir\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.980828 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980315 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-var-lib-kubelet\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.981692 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980347 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-systemd-units\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.981692 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980374 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f747a7ca-d127-4064-95aa-13e4dafe9d22-iptables-alerter-script\") pod \"iptables-alerter-z7fp7\" (UID: \"f747a7ca-d127-4064-95aa-13e4dafe9d22\") " pod="openshift-network-operator/iptables-alerter-z7fp7" Jun 02 15:14:42.981692 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980399 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-log-socket\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.981692 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980426 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqk6\" (UniqueName: \"kubernetes.io/projected/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-kube-api-access-vvqk6\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.981692 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980453 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-os-release\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.981692 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980469 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-systemd-units\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.981692 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980479 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-systemd\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.981692 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980514 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f747a7ca-d127-4064-95aa-13e4dafe9d22-host-slash\") pod \"iptables-alerter-z7fp7\" (UID: \"f747a7ca-d127-4064-95aa-13e4dafe9d22\") " pod="openshift-network-operator/iptables-alerter-z7fp7" Jun 02 15:14:42.981692 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980531 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-systemd\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.981692 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980543 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee7fa008-6c9e-4db5-9cb5-11f5b181e582-serviceca\") pod \"node-ca-vpzdk\" (UID: \"ee7fa008-6c9e-4db5-9cb5-11f5b181e582\") " pod="openshift-image-registry/node-ca-vpzdk" Jun 02 15:14:42.981692 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980588 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fftkr\" (UniqueName: \"kubernetes.io/projected/ee7fa008-6c9e-4db5-9cb5-11f5b181e582-kube-api-access-fftkr\") pod \"node-ca-vpzdk\" (UID: \"ee7fa008-6c9e-4db5-9cb5-11f5b181e582\") " pod="openshift-image-registry/node-ca-vpzdk" Jun 02 15:14:42.981692 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980600 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa0e7977-049c-4213-8732-790894fcc011-konnectivity-ca\") pod \"konnectivity-agent-84jcn\" (UID: \"fa0e7977-049c-4213-8732-790894fcc011\") " pod="kube-system/konnectivity-agent-84jcn" Jun 02 15:14:42.981692 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980615 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-multus-socket-dir-parent\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.981692 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980671 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-system-cni-dir\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.981692 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980732 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-var-lib-kubelet\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.981692 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980760 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-run-netns\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.981692 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980771 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f747a7ca-d127-4064-95aa-13e4dafe9d22-host-slash\") pod \"iptables-alerter-z7fp7\" (UID: \"f747a7ca-d127-4064-95aa-13e4dafe9d22\") " pod="openshift-network-operator/iptables-alerter-z7fp7" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980934 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-multus-socket-dir-parent\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.980974 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f747a7ca-d127-4064-95aa-13e4dafe9d22-iptables-alerter-script\") pod \"iptables-alerter-z7fp7\" (UID: \"f747a7ca-d127-4064-95aa-13e4dafe9d22\") " pod="openshift-network-operator/iptables-alerter-z7fp7" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981031 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-log-socket\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981123 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-run-netns\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981156 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee7fa008-6c9e-4db5-9cb5-11f5b181e582-serviceca\") pod \"node-ca-vpzdk\" (UID: \"ee7fa008-6c9e-4db5-9cb5-11f5b181e582\") " pod="openshift-image-registry/node-ca-vpzdk" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981155 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-etc-openvswitch\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981186 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-etc-openvswitch\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981212 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-run-netns\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981218 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3399fc44-4af2-4e59-8a97-a22f8110b914-env-overrides\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981257 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3399fc44-4af2-4e59-8a97-a22f8110b914-ovnkube-script-lib\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981288 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981302 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-sysctl-conf\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981315 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-multus-conf-dir\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981337 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-var-lib-cni-bin\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981343 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-multus-daemon-config\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981370 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zm7j\" (UniqueName: \"kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j\") pod \"network-check-target-6xl9v\" (UID: \"9f1fef37-4e7b-4565-a20d-8e4d7994625e\") " pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981380 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-run-systemd\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.982510 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981396 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-sys\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981424 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-node-log\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981449 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-multus-cni-dir\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981452 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-os-release\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981451 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-multus-conf-dir\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981486 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-sysctl-d\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981491 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-sys-fs\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981524 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-multus-cni-dir\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981540 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-run-openvswitch\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981543 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81690d60-d545-4a62-805e-c966443073b4-hosts-file\") pod \"node-resolver-7zgg4\" (UID: \"81690d60-d545-4a62-805e-c966443073b4\") " pod="openshift-dns/node-resolver-7zgg4" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.981631 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-lib-modules\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982013 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-multus-daemon-config\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982033 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982126 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-sys\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982130 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3399fc44-4af2-4e59-8a97-a22f8110b914-env-overrides\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982162 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-host\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982192 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-run-ovn\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982217 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee7fa008-6c9e-4db5-9cb5-11f5b181e582-host\") pod \"node-ca-vpzdk\" (UID: \"ee7fa008-6c9e-4db5-9cb5-11f5b181e582\") " pod="openshift-image-registry/node-ca-vpzdk" Jun 02 15:14:42.984016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982243 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81690d60-d545-4a62-805e-c966443073b4-tmp-dir\") pod \"node-resolver-7zgg4\" (UID: \"81690d60-d545-4a62-805e-c966443073b4\") " pod="openshift-dns/node-resolver-7zgg4" Jun 02 15:14:42.984880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982269 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-run-k8s-cni-cncf-io\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.984880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982298 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-kubernetes\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.984880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982304 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-kubelet\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.984880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982324 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-cnibin\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.984880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982349 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-sysconfig\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.984880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982374 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-var-lib-openvswitch\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.984880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982400 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-cni-binary-copy\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.984880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982430 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:42.984880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982540 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-socket-dir\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:42.984880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982585 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-slash\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.984880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982614 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5sjlf\" (UniqueName: \"kubernetes.io/projected/81690d60-d545-4a62-805e-c966443073b4-kube-api-access-5sjlf\") pod \"node-resolver-7zgg4\" (UID: \"81690d60-d545-4a62-805e-c966443073b4\") " pod="openshift-dns/node-resolver-7zgg4" Jun 02 15:14:42.984880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982640 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-os-release\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.984880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982678 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-hostroot\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.984880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982724 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-etc-selinux\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:42.984880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982730 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3399fc44-4af2-4e59-8a97-a22f8110b914-ovnkube-config\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.984880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982818 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-host\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.984880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982858 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-run-ovn\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982908 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee7fa008-6c9e-4db5-9cb5-11f5b181e582-host\") pod \"node-ca-vpzdk\" (UID: \"ee7fa008-6c9e-4db5-9cb5-11f5b181e582\") " pod="openshift-image-registry/node-ca-vpzdk" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982966 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3399fc44-4af2-4e59-8a97-a22f8110b914-ovnkube-script-lib\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.982966 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983048 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-modprobe-d\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983050 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-system-cni-dir\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983089 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-cni-bin\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983095 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-run-ovn-kubernetes\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983130 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-run-multus-certs\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983155 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81690d60-d545-4a62-805e-c966443073b4-tmp-dir\") pod \"node-resolver-7zgg4\" (UID: \"81690d60-d545-4a62-805e-c966443073b4\") " pod="openshift-dns/node-resolver-7zgg4" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983159 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-node-log\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983198 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-cnibin\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983244 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-kubernetes\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983280 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-host-run-k8s-cni-cncf-io\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983312 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-host-slash\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983524 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-sysconfig\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983593 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-os-release\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983607 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.985646 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983632 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-hostroot\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.986476 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983678 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3399fc44-4af2-4e59-8a97-a22f8110b914-var-lib-openvswitch\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.986476 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983735 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3399fc44-4af2-4e59-8a97-a22f8110b914-ovn-node-metrics-cert\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:42.986476 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983803 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-cni-binary-copy\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.986476 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.983789 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.986476 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.984109 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa0e7977-049c-4213-8732-790894fcc011-agent-certs\") pod \"konnectivity-agent-84jcn\" (UID: \"fa0e7977-049c-4213-8732-790894fcc011\") " pod="kube-system/konnectivity-agent-84jcn" Jun 02 15:14:42.987676 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.987419 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/366b12b3-4c11-478e-a8e2-ff79880ae709-etc-tuned\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.988991 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:42.988967 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:14:42.989088 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:42.988994 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:14:42.989088 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:42.989013 2566 projected.go:194] Error preparing data for projected volume kube-api-access-4zm7j for pod openshift-network-diagnostics/network-check-target-6xl9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:14:42.989191 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:42.989123 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j podName:9f1fef37-4e7b-4565-a20d-8e4d7994625e nodeName:}" failed. No retries permitted until 2026-06-02 15:14:43.489101938 +0000 UTC m=+3.074752930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4zm7j" (UniqueName: "kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j") pod "network-check-target-6xl9v" (UID: "9f1fef37-4e7b-4565-a20d-8e4d7994625e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:14:42.989652 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.989628 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/366b12b3-4c11-478e-a8e2-ff79880ae709-tmp\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.990818 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.990611 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x64qs\" (UniqueName: \"kubernetes.io/projected/9ca3a2de-9281-482c-b7be-6a283c9a6cb9-kube-api-access-x64qs\") pod \"multus-7g7rb\" (UID: \"9ca3a2de-9281-482c-b7be-6a283c9a6cb9\") " pod="openshift-multus/multus-7g7rb" Jun 02 15:14:42.990818 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.990768 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpmdp\" (UniqueName: \"kubernetes.io/projected/4814aa17-8f1d-4de5-80a7-f0d823d2c818-kube-api-access-jpmdp\") pod \"network-metrics-daemon-md8jp\" (UID: \"4814aa17-8f1d-4de5-80a7-f0d823d2c818\") " pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:42.990991 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.990972 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsg98\" (UniqueName: \"kubernetes.io/projected/f747a7ca-d127-4064-95aa-13e4dafe9d22-kube-api-access-zsg98\") pod \"iptables-alerter-z7fp7\" (UID: \"f747a7ca-d127-4064-95aa-13e4dafe9d22\") " pod="openshift-network-operator/iptables-alerter-z7fp7" Jun 02 15:14:42.992309 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.992105 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvqk6\" (UniqueName: \"kubernetes.io/projected/6b4a2cb3-34d0-41a5-9c84-d7cd4e818043-kube-api-access-vvqk6\") pod \"multus-additional-cni-plugins-ws4sb\" (UID: \"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043\") " pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:42.992309 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.992134 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6wzq\" (UniqueName: \"kubernetes.io/projected/366b12b3-4c11-478e-a8e2-ff79880ae709-kube-api-access-m6wzq\") pod \"tuned-2s766\" (UID: \"366b12b3-4c11-478e-a8e2-ff79880ae709\") " pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:42.992309 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.992165 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fftkr\" (UniqueName: \"kubernetes.io/projected/ee7fa008-6c9e-4db5-9cb5-11f5b181e582-kube-api-access-fftkr\") pod \"node-ca-vpzdk\" (UID: \"ee7fa008-6c9e-4db5-9cb5-11f5b181e582\") " pod="openshift-image-registry/node-ca-vpzdk" Jun 02 15:14:42.992525 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.992419 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sjlf\" (UniqueName: \"kubernetes.io/projected/81690d60-d545-4a62-805e-c966443073b4-kube-api-access-5sjlf\") pod \"node-resolver-7zgg4\" (UID: \"81690d60-d545-4a62-805e-c966443073b4\") " pod="openshift-dns/node-resolver-7zgg4" Jun 02 15:14:42.994669 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:42.994651 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5knq\" (UniqueName: \"kubernetes.io/projected/3399fc44-4af2-4e59-8a97-a22f8110b914-kube-api-access-x5knq\") pod \"ovnkube-node-mlbxc\" (UID: \"3399fc44-4af2-4e59-8a97-a22f8110b914\") " pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:43.083638 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.083599 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-registration-dir\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:43.083638 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.083642 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-device-dir\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:43.083903 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.083675 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jx7q9\" (UniqueName: \"kubernetes.io/projected/9165ab25-b39d-481f-9983-2c6c4bfdd78b-kube-api-access-jx7q9\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:43.083903 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.083742 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-registration-dir\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:43.083903 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.083761 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-sys-fs\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:43.083903 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.083758 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-device-dir\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:43.083903 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.083800 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:43.083903 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.083808 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-sys-fs\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:43.083903 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.083826 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-socket-dir\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:43.083903 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.083854 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-etc-selinux\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:43.084283 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.083887 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:43.084283 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.083990 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-etc-selinux\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:43.084283 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.084029 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9165ab25-b39d-481f-9983-2c6c4bfdd78b-socket-dir\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:43.092616 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.092558 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx7q9\" (UniqueName: \"kubernetes.io/projected/9165ab25-b39d-481f-9983-2c6c4bfdd78b-kube-api-access-jx7q9\") pod \"aws-ebs-csi-driver-node-q24jv\" (UID: \"9165ab25-b39d-481f-9983-2c6c4bfdd78b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:43.165570 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.165539 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2s766" Jun 02 15:14:43.171349 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.171320 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ws4sb" Jun 02 15:14:43.184240 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.184220 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z7fp7" Jun 02 15:14:43.190188 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.190166 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:14:43.199809 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.199784 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-84jcn" Jun 02 15:14:43.204446 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.204428 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:14:43.205465 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.205451 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vpzdk" Jun 02 15:14:43.213921 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.213901 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7zgg4" Jun 02 15:14:43.222520 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.222495 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7g7rb" Jun 02 15:14:43.229169 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.229148 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" Jun 02 15:14:43.486364 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.486276 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs\") pod \"network-metrics-daemon-md8jp\" (UID: \"4814aa17-8f1d-4de5-80a7-f0d823d2c818\") " pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:43.486512 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:43.486402 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:14:43.486512 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:43.486461 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs podName:4814aa17-8f1d-4de5-80a7-f0d823d2c818 nodeName:}" failed. No retries permitted until 2026-06-02 15:14:44.486446085 +0000 UTC m=+4.072097064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs") pod "network-metrics-daemon-md8jp" (UID: "4814aa17-8f1d-4de5-80a7-f0d823d2c818") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:14:43.587155 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.587120 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zm7j\" (UniqueName: \"kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j\") pod \"network-check-target-6xl9v\" (UID: \"9f1fef37-4e7b-4565-a20d-8e4d7994625e\") " pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:14:43.587316 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:43.587264 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:14:43.587316 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:43.587285 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:14:43.587316 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:43.587299 2566 projected.go:194] Error preparing data for projected volume kube-api-access-4zm7j for pod openshift-network-diagnostics/network-check-target-6xl9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:14:43.587484 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:43.587360 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j podName:9f1fef37-4e7b-4565-a20d-8e4d7994625e nodeName:}" failed. No retries permitted until 2026-06-02 15:14:44.587340017 +0000 UTC m=+4.172990996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zm7j" (UniqueName: "kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j") pod "network-check-target-6xl9v" (UID: "9f1fef37-4e7b-4565-a20d-8e4d7994625e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:14:43.632832 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:43.632623 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ca3a2de_9281_482c_b7be_6a283c9a6cb9.slice/crio-4436fcf789436f5b27587a84155c2d258181cd9f86c220d4ac9f8b543e401956 WatchSource:0}: Error finding container 4436fcf789436f5b27587a84155c2d258181cd9f86c220d4ac9f8b543e401956: Status 404 returned error can't find the container with id 4436fcf789436f5b27587a84155c2d258181cd9f86c220d4ac9f8b543e401956 Jun 02 15:14:43.636228 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:43.636173 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa0e7977_049c_4213_8732_790894fcc011.slice/crio-90390e2311236ddb53eb56a3d5c31c5aa42d9cc6bc39101e44552b785efe1b74 WatchSource:0}: Error finding container 90390e2311236ddb53eb56a3d5c31c5aa42d9cc6bc39101e44552b785efe1b74: Status 404 returned error can't find the container with id 90390e2311236ddb53eb56a3d5c31c5aa42d9cc6bc39101e44552b785efe1b74 Jun 02 15:14:43.637790 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:43.637764 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81690d60_d545_4a62_805e_c966443073b4.slice/crio-0808b1535d0df28a83f379151303d30b36b9debb489687641d4ad4d49e063673 WatchSource:0}: Error finding container 0808b1535d0df28a83f379151303d30b36b9debb489687641d4ad4d49e063673: Status 404 returned error can't find the container with id 0808b1535d0df28a83f379151303d30b36b9debb489687641d4ad4d49e063673 Jun 02 15:14:43.640399 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:43.640376 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9165ab25_b39d_481f_9983_2c6c4bfdd78b.slice/crio-97167097d1966e323a6d57d2ebdb9eadd9c0d1dd2ef0cf78893684743b77d904 WatchSource:0}: Error finding container 97167097d1966e323a6d57d2ebdb9eadd9c0d1dd2ef0cf78893684743b77d904: Status 404 returned error can't find the container with id 97167097d1966e323a6d57d2ebdb9eadd9c0d1dd2ef0cf78893684743b77d904 Jun 02 15:14:43.641204 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:43.641180 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4a2cb3_34d0_41a5_9c84_d7cd4e818043.slice/crio-3f4dbe0baca0d12b5456432cba2f298748e1a523b1086a66538fddf6669661ff WatchSource:0}: Error finding container 3f4dbe0baca0d12b5456432cba2f298748e1a523b1086a66538fddf6669661ff: Status 404 returned error can't find the container with id 3f4dbe0baca0d12b5456432cba2f298748e1a523b1086a66538fddf6669661ff Jun 02 15:14:43.642366 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:43.642287 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod366b12b3_4c11_478e_a8e2_ff79880ae709.slice/crio-f0f8eba0e6ea558e16a9921400988c3d90e8f9ca14c3971e2bddd04a3b502fe1 WatchSource:0}: Error finding container f0f8eba0e6ea558e16a9921400988c3d90e8f9ca14c3971e2bddd04a3b502fe1: Status 404 returned error can't find the container with id f0f8eba0e6ea558e16a9921400988c3d90e8f9ca14c3971e2bddd04a3b502fe1 Jun 02 15:14:43.643353 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:43.643332 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee7fa008_6c9e_4db5_9cb5_11f5b181e582.slice/crio-1f4997cdd2aee4880274b9a175e86510539e44b4c397df35b5b19b6d63075d77 WatchSource:0}: Error finding container 1f4997cdd2aee4880274b9a175e86510539e44b4c397df35b5b19b6d63075d77: Status 404 returned error can't find the container with id 1f4997cdd2aee4880274b9a175e86510539e44b4c397df35b5b19b6d63075d77 Jun 02 15:14:43.644628 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:43.644352 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3399fc44_4af2_4e59_8a97_a22f8110b914.slice/crio-ddc2793788366e116e00125d7f72ac58c09b08c314593c38c0e09fc8e1fc8f1a WatchSource:0}: Error finding container ddc2793788366e116e00125d7f72ac58c09b08c314593c38c0e09fc8e1fc8f1a: Status 404 returned error can't find the container with id ddc2793788366e116e00125d7f72ac58c09b08c314593c38c0e09fc8e1fc8f1a Jun 02 15:14:43.646773 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:14:43.645371 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf747a7ca_d127_4064_95aa_13e4dafe9d22.slice/crio-ea03284942a173fdaff1245616ef9e2414040675727c213e981ec250239258eb WatchSource:0}: Error finding container ea03284942a173fdaff1245616ef9e2414040675727c213e981ec250239258eb: Status 404 returned error can't find the container with id ea03284942a173fdaff1245616ef9e2414040675727c213e981ec250239258eb Jun 02 15:14:43.917812 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.917646 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 15:09:41 +0000 UTC" deadline="2028-02-11 20:17:09.7707079 +0000 UTC" Jun 02 15:14:43.917812 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.917811 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14861h2m25.852899405s" Jun 02 15:14:43.994674 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:43.994190 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:14:43.994674 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:43.994313 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:14:44.001520 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.001487 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" event={"ID":"9165ab25-b39d-481f-9983-2c6c4bfdd78b","Type":"ContainerStarted","Data":"97167097d1966e323a6d57d2ebdb9eadd9c0d1dd2ef0cf78893684743b77d904"} Jun 02 15:14:44.003195 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.003165 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-84jcn" event={"ID":"fa0e7977-049c-4213-8732-790894fcc011","Type":"ContainerStarted","Data":"90390e2311236ddb53eb56a3d5c31c5aa42d9cc6bc39101e44552b785efe1b74"} Jun 02 15:14:44.008066 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.007934 2566 generic.go:358] "Generic (PLEG): container finished" podID="9e938b4c5ad2016df02d26d5058dc76f" containerID="80fea874cb3e65f56a06ad99813ff34ad74cc63a5be95ca5927f1356bc4714c0" exitCode=0 Jun 02 15:14:44.008066 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.008012 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" event={"ID":"9e938b4c5ad2016df02d26d5058dc76f","Type":"ContainerDied","Data":"80fea874cb3e65f56a06ad99813ff34ad74cc63a5be95ca5927f1356bc4714c0"} Jun 02 15:14:44.010430 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.010403 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z7fp7" event={"ID":"f747a7ca-d127-4064-95aa-13e4dafe9d22","Type":"ContainerStarted","Data":"ea03284942a173fdaff1245616ef9e2414040675727c213e981ec250239258eb"} Jun 02 15:14:44.019371 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.019346 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" event={"ID":"3399fc44-4af2-4e59-8a97-a22f8110b914","Type":"ContainerStarted","Data":"ddc2793788366e116e00125d7f72ac58c09b08c314593c38c0e09fc8e1fc8f1a"} Jun 02 15:14:44.024210 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.023737 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws4sb" event={"ID":"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043","Type":"ContainerStarted","Data":"3f4dbe0baca0d12b5456432cba2f298748e1a523b1086a66538fddf6669661ff"} Jun 02 15:14:44.026270 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.025980 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7g7rb" event={"ID":"9ca3a2de-9281-482c-b7be-6a283c9a6cb9","Type":"ContainerStarted","Data":"4436fcf789436f5b27587a84155c2d258181cd9f86c220d4ac9f8b543e401956"} Jun 02 15:14:44.028361 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.028336 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" event={"ID":"c965875c7d97cdd2b7f7dc64a963ce12","Type":"ContainerStarted","Data":"20909aac9b9a7257c49c2f84a64315f791fa4ceec27cf15e5ed586240bbea1bf"} Jun 02 15:14:44.030527 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.030495 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vpzdk" event={"ID":"ee7fa008-6c9e-4db5-9cb5-11f5b181e582","Type":"ContainerStarted","Data":"1f4997cdd2aee4880274b9a175e86510539e44b4c397df35b5b19b6d63075d77"} Jun 02 15:14:44.031795 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.031751 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7zgg4" event={"ID":"81690d60-d545-4a62-805e-c966443073b4","Type":"ContainerStarted","Data":"0808b1535d0df28a83f379151303d30b36b9debb489687641d4ad4d49e063673"} Jun 02 15:14:44.033311 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.033287 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2s766" event={"ID":"366b12b3-4c11-478e-a8e2-ff79880ae709","Type":"ContainerStarted","Data":"f0f8eba0e6ea558e16a9921400988c3d90e8f9ca14c3971e2bddd04a3b502fe1"} Jun 02 15:14:44.051315 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.051262 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" podStartSLOduration=2.051244547 podStartE2EDuration="2.051244547s" podCreationTimestamp="2026-06-02 15:14:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:14:44.049957026 +0000 UTC m=+3.635608027" watchObservedRunningTime="2026-06-02 15:14:44.051244547 +0000 UTC m=+3.636895551" Jun 02 15:14:44.494155 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.494060 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs\") pod \"network-metrics-daemon-md8jp\" (UID: \"4814aa17-8f1d-4de5-80a7-f0d823d2c818\") " pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:44.494325 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:44.494228 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:14:44.494325 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:44.494296 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs podName:4814aa17-8f1d-4de5-80a7-f0d823d2c818 nodeName:}" failed. No retries permitted until 2026-06-02 15:14:46.494275792 +0000 UTC m=+6.079926787 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs") pod "network-metrics-daemon-md8jp" (UID: "4814aa17-8f1d-4de5-80a7-f0d823d2c818") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:14:44.529822 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.529792 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-rjsmb"] Jun 02 15:14:44.534965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.534941 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:44.535090 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:44.535021 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjsmb" podUID="734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e" Jun 02 15:14:44.596152 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.595354 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret\") pod \"global-pull-secret-syncer-rjsmb\" (UID: \"734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e\") " pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:44.596152 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.595436 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zm7j\" (UniqueName: \"kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j\") pod \"network-check-target-6xl9v\" (UID: \"9f1fef37-4e7b-4565-a20d-8e4d7994625e\") " pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:14:44.596152 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.595475 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-kubelet-config\") pod \"global-pull-secret-syncer-rjsmb\" (UID: \"734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e\") " pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:44.596152 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.595501 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-dbus\") pod \"global-pull-secret-syncer-rjsmb\" (UID: \"734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e\") " pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:44.596152 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:44.595667 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:14:44.596152 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:44.595683 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:14:44.596152 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:44.595695 2566 projected.go:194] Error preparing data for projected volume kube-api-access-4zm7j for pod openshift-network-diagnostics/network-check-target-6xl9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:14:44.596152 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:44.595773 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j podName:9f1fef37-4e7b-4565-a20d-8e4d7994625e nodeName:}" failed. No retries permitted until 2026-06-02 15:14:46.595754647 +0000 UTC m=+6.181405640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zm7j" (UniqueName: "kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j") pod "network-check-target-6xl9v" (UID: "9f1fef37-4e7b-4565-a20d-8e4d7994625e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:14:44.696721 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.696275 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret\") pod \"global-pull-secret-syncer-rjsmb\" (UID: \"734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e\") " pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:44.696721 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.696382 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-kubelet-config\") pod \"global-pull-secret-syncer-rjsmb\" (UID: \"734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e\") " pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:44.696721 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.696410 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-dbus\") pod \"global-pull-secret-syncer-rjsmb\" (UID: \"734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e\") " pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:44.696721 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.696605 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-dbus\") pod \"global-pull-secret-syncer-rjsmb\" (UID: \"734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e\") " pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:44.696721 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:44.696650 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:14:44.696721 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.696671 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-kubelet-config\") pod \"global-pull-secret-syncer-rjsmb\" (UID: \"734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e\") " pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:44.696721 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:44.696730 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret podName:734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e nodeName:}" failed. No retries permitted until 2026-06-02 15:14:45.196691856 +0000 UTC m=+4.782342839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret") pod "global-pull-secret-syncer-rjsmb" (UID: "734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:14:44.997018 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:44.996989 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:44.997507 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:44.997130 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:14:45.057416 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:45.057383 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" event={"ID":"9e938b4c5ad2016df02d26d5058dc76f","Type":"ContainerStarted","Data":"e988930d745293b2453bcc829ce9209d6556ebc415d8361802dfe0ef5dcbcc09"} Jun 02 15:14:45.201150 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:45.201112 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret\") pod \"global-pull-secret-syncer-rjsmb\" (UID: \"734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e\") " pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:45.201335 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:45.201308 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:14:45.201403 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:45.201372 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret podName:734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e nodeName:}" failed. No retries permitted until 2026-06-02 15:14:46.201351165 +0000 UTC m=+5.787002199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret") pod "global-pull-secret-syncer-rjsmb" (UID: "734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:14:45.994780 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:45.994274 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:45.994780 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:45.994296 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:14:45.994780 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:45.994410 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjsmb" podUID="734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e" Jun 02 15:14:45.994780 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:45.994594 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:14:46.211303 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:46.211263 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret\") pod \"global-pull-secret-syncer-rjsmb\" (UID: \"734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e\") " pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:46.211822 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:46.211425 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:14:46.211822 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:46.211492 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret podName:734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e nodeName:}" failed. No retries permitted until 2026-06-02 15:14:48.211472684 +0000 UTC m=+7.797123672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret") pod "global-pull-secret-syncer-rjsmb" (UID: "734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:14:46.513754 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:46.513716 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs\") pod \"network-metrics-daemon-md8jp\" (UID: \"4814aa17-8f1d-4de5-80a7-f0d823d2c818\") " pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:46.513936 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:46.513889 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:14:46.513992 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:46.513953 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs podName:4814aa17-8f1d-4de5-80a7-f0d823d2c818 nodeName:}" failed. No retries permitted until 2026-06-02 15:14:50.513934862 +0000 UTC m=+10.099585843 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs") pod "network-metrics-daemon-md8jp" (UID: "4814aa17-8f1d-4de5-80a7-f0d823d2c818") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:14:46.614661 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:46.614535 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zm7j\" (UniqueName: \"kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j\") pod \"network-check-target-6xl9v\" (UID: \"9f1fef37-4e7b-4565-a20d-8e4d7994625e\") " pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:14:46.614848 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:46.614738 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:14:46.614848 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:46.614766 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:14:46.614848 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:46.614781 2566 projected.go:194] Error preparing data for projected volume kube-api-access-4zm7j for pod openshift-network-diagnostics/network-check-target-6xl9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:14:46.614848 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:46.614842 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j podName:9f1fef37-4e7b-4565-a20d-8e4d7994625e nodeName:}" failed. No retries permitted until 2026-06-02 15:14:50.614823238 +0000 UTC m=+10.200474232 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zm7j" (UniqueName: "kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j") pod "network-check-target-6xl9v" (UID: "9f1fef37-4e7b-4565-a20d-8e4d7994625e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:14:46.995012 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:46.994944 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:46.995135 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:46.995054 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:14:47.994302 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:47.994267 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:47.994846 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:47.994392 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjsmb" podUID="734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e" Jun 02 15:14:47.994846 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:47.994831 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:14:47.994940 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:47.994906 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:14:48.229863 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:48.229822 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret\") pod \"global-pull-secret-syncer-rjsmb\" (UID: \"734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e\") " pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:48.230070 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:48.230012 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:14:48.230070 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:48.230065 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret podName:734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e nodeName:}" failed. No retries permitted until 2026-06-02 15:14:52.230052024 +0000 UTC m=+11.815703004 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret") pod "global-pull-secret-syncer-rjsmb" (UID: "734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:14:48.995825 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:48.995791 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:48.996238 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:48.995918 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:14:49.994854 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:49.994358 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:49.994854 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:49.994399 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:14:49.994854 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:49.994493 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjsmb" podUID="734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e" Jun 02 15:14:49.994854 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:49.994625 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:14:50.548548 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:50.548508 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs\") pod \"network-metrics-daemon-md8jp\" (UID: \"4814aa17-8f1d-4de5-80a7-f0d823d2c818\") " pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:50.549030 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:50.548722 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:14:50.549030 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:50.548787 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs podName:4814aa17-8f1d-4de5-80a7-f0d823d2c818 nodeName:}" failed. No retries permitted until 2026-06-02 15:14:58.548767085 +0000 UTC m=+18.134418073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs") pod "network-metrics-daemon-md8jp" (UID: "4814aa17-8f1d-4de5-80a7-f0d823d2c818") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:14:50.648986 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:50.648949 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zm7j\" (UniqueName: \"kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j\") pod \"network-check-target-6xl9v\" (UID: \"9f1fef37-4e7b-4565-a20d-8e4d7994625e\") " pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:14:50.649137 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:50.649098 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:14:50.649137 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:50.649116 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:14:50.649137 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:50.649127 2566 projected.go:194] Error preparing data for projected volume kube-api-access-4zm7j for pod openshift-network-diagnostics/network-check-target-6xl9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:14:50.649292 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:50.649183 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j podName:9f1fef37-4e7b-4565-a20d-8e4d7994625e nodeName:}" failed. No retries permitted until 2026-06-02 15:14:58.649166136 +0000 UTC m=+18.234817133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zm7j" (UniqueName: "kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j") pod "network-check-target-6xl9v" (UID: "9f1fef37-4e7b-4565-a20d-8e4d7994625e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:14:50.995105 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:50.995032 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:50.995264 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:50.995170 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:14:51.995044 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:51.994786 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:14:51.995044 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:51.994820 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:51.995044 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:51.994921 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:14:51.995044 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:51.995011 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjsmb" podUID="734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e" Jun 02 15:14:52.261138 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:52.261053 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret\") pod \"global-pull-secret-syncer-rjsmb\" (UID: \"734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e\") " pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:52.261286 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:52.261189 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:14:52.261286 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:52.261250 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret podName:734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e nodeName:}" failed. No retries permitted until 2026-06-02 15:15:00.26123158 +0000 UTC m=+19.846882581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret") pod "global-pull-secret-syncer-rjsmb" (UID: "734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:14:52.994151 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:52.994114 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:52.994310 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:52.994240 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:14:53.994589 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:53.994503 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:14:53.994589 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:53.994545 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:53.995088 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:53.994638 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:14:53.995088 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:53.994750 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjsmb" podUID="734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e" Jun 02 15:14:54.993864 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:54.993828 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:54.994019 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:54.993973 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:14:55.994680 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:55.994637 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:14:55.995159 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:55.994638 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:55.995159 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:55.994753 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:14:55.995159 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:55.994837 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjsmb" podUID="734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e" Jun 02 15:14:56.994617 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:56.994582 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:56.994789 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:56.994744 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:14:57.994782 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:57.994742 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:57.995205 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:57.994742 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:14:57.995205 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:57.994887 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjsmb" podUID="734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e" Jun 02 15:14:57.995205 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:57.994956 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:14:58.604792 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:58.604747 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs\") pod \"network-metrics-daemon-md8jp\" (UID: \"4814aa17-8f1d-4de5-80a7-f0d823d2c818\") " pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:58.604981 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:58.604913 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:14:58.605038 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:58.604992 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs podName:4814aa17-8f1d-4de5-80a7-f0d823d2c818 nodeName:}" failed. No retries permitted until 2026-06-02 15:15:14.604970886 +0000 UTC m=+34.190621880 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs") pod "network-metrics-daemon-md8jp" (UID: "4814aa17-8f1d-4de5-80a7-f0d823d2c818") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:14:58.705836 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:58.705803 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zm7j\" (UniqueName: \"kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j\") pod \"network-check-target-6xl9v\" (UID: \"9f1fef37-4e7b-4565-a20d-8e4d7994625e\") " pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:14:58.706008 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:58.705952 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:14:58.706008 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:58.705971 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:14:58.706008 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:58.705982 2566 projected.go:194] Error preparing data for projected volume kube-api-access-4zm7j for pod openshift-network-diagnostics/network-check-target-6xl9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:14:58.706141 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:58.706043 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j podName:9f1fef37-4e7b-4565-a20d-8e4d7994625e nodeName:}" failed. No retries permitted until 2026-06-02 15:15:14.706024138 +0000 UTC m=+34.291675119 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zm7j" (UniqueName: "kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j") pod "network-check-target-6xl9v" (UID: "9f1fef37-4e7b-4565-a20d-8e4d7994625e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:14:58.994903 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:58.994821 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:14:58.995363 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:58.994956 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:14:59.994513 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:59.994478 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:14:59.994513 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:14:59.994495 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:14:59.994753 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:59.994604 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjsmb" podUID="734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e" Jun 02 15:14:59.994806 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:14:59.994745 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:15:00.317146 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:00.317034 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret\") pod \"global-pull-secret-syncer-rjsmb\" (UID: \"734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e\") " pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:15:00.317541 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:00.317201 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:15:00.317541 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:00.317288 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret podName:734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e nodeName:}" failed. No retries permitted until 2026-06-02 15:15:16.317264612 +0000 UTC m=+35.902915782 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret") pod "global-pull-secret-syncer-rjsmb" (UID: "734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:15:00.995358 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:00.995331 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:15:00.995559 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:00.995440 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:15:01.994265 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:01.994237 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:15:01.994617 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:01.994307 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:15:01.994617 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:01.994416 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:15:01.994617 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:01.994548 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjsmb" podUID="734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e" Jun 02 15:15:02.101217 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.101196 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/ovn-acl-logging/0.log" Jun 02 15:15:02.101461 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.101441 2566 generic.go:358] "Generic (PLEG): container finished" podID="3399fc44-4af2-4e59-8a97-a22f8110b914" containerID="50ce7ba51648273afba6da3242d0c19e6abce124b728a5fbc3bbfdae3e586693" exitCode=1 Jun 02 15:15:02.101514 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.101499 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" event={"ID":"3399fc44-4af2-4e59-8a97-a22f8110b914","Type":"ContainerStarted","Data":"98a19e756d3acb7dfacc75a3acfe53d1b724f0aa3af4895543d717bbd260bc48"} Jun 02 15:15:02.101549 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.101524 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" event={"ID":"3399fc44-4af2-4e59-8a97-a22f8110b914","Type":"ContainerDied","Data":"50ce7ba51648273afba6da3242d0c19e6abce124b728a5fbc3bbfdae3e586693"} Jun 02 15:15:02.101549 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.101535 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" event={"ID":"3399fc44-4af2-4e59-8a97-a22f8110b914","Type":"ContainerStarted","Data":"4354976c43a5ec19b3bd913816f62479fd165d2967bd151c8e96cdec64b6ee5e"} Jun 02 15:15:02.102588 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.102568 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws4sb" event={"ID":"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043","Type":"ContainerStarted","Data":"f899bd6cabdbae1bff8d26890b9e6c0de5ed276d0dd94d1d4ab4d62389530ca8"} Jun 02 15:15:02.104329 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.104298 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7g7rb" event={"ID":"9ca3a2de-9281-482c-b7be-6a283c9a6cb9","Type":"ContainerStarted","Data":"ac9a327de239d2b05bb974f12f46b0e486edd673b19bece3aef8708a12daa0e7"} Jun 02 15:15:02.109503 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.109472 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vpzdk" event={"ID":"ee7fa008-6c9e-4db5-9cb5-11f5b181e582","Type":"ContainerStarted","Data":"1c00b6036df73ae561c315dc85dd8ef7ebe63049058a3a05608d036fd92e59aa"} Jun 02 15:15:02.110876 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.110856 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7zgg4" event={"ID":"81690d60-d545-4a62-805e-c966443073b4","Type":"ContainerStarted","Data":"83c5f7cd8b5039cc3f19f9c475f086985c0720a46726bfa63d75659a17a6be57"} Jun 02 15:15:02.112176 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.112155 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2s766" event={"ID":"366b12b3-4c11-478e-a8e2-ff79880ae709","Type":"ContainerStarted","Data":"c28ee845ec79c835019e42768ca6dc0e446bc375e3e7fdcc3cc7983358bf4c67"} Jun 02 15:15:02.113433 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.113415 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" event={"ID":"9165ab25-b39d-481f-9983-2c6c4bfdd78b","Type":"ContainerStarted","Data":"81a4c1dd3255ff0a1ffa9d6861d6941ad51ede73875e8917e461fe82024901d4"} Jun 02 15:15:02.114652 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.114632 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-84jcn" event={"ID":"fa0e7977-049c-4213-8732-790894fcc011","Type":"ContainerStarted","Data":"5743b72e4da36decbb87345c8db1c8670729c4d424104957465a6a1908fd7525"} Jun 02 15:15:02.128668 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.128632 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" podStartSLOduration=20.128620644 podStartE2EDuration="20.128620644s" podCreationTimestamp="2026-06-02 15:14:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:14:45.08450383 +0000 UTC m=+4.670154833" watchObservedRunningTime="2026-06-02 15:15:02.128620644 +0000 UTC m=+21.714271645" Jun 02 15:15:02.145370 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.145326 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-7g7rb" podStartSLOduration=3.139474202 podStartE2EDuration="21.145313974s" podCreationTimestamp="2026-06-02 15:14:41 +0000 UTC" firstStartedPulling="2026-06-02 15:14:43.634990311 +0000 UTC m=+3.220641308" lastFinishedPulling="2026-06-02 15:15:01.640830095 +0000 UTC m=+21.226481080" observedRunningTime="2026-06-02 15:15:02.144892412 +0000 UTC m=+21.730543413" watchObservedRunningTime="2026-06-02 15:15:02.145313974 +0000 UTC m=+21.730964974" Jun 02 15:15:02.158850 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.158808 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vpzdk" podStartSLOduration=3.232904766 podStartE2EDuration="21.158796282s" podCreationTimestamp="2026-06-02 15:14:41 +0000 UTC" firstStartedPulling="2026-06-02 15:14:43.645633805 +0000 UTC m=+3.231284786" lastFinishedPulling="2026-06-02 15:15:01.571525314 +0000 UTC m=+21.157176302" observedRunningTime="2026-06-02 15:15:02.158791482 +0000 UTC m=+21.744442483" watchObservedRunningTime="2026-06-02 15:15:02.158796282 +0000 UTC m=+21.744447284" Jun 02 15:15:02.174197 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.174157 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-7zgg4" podStartSLOduration=3.235202761 podStartE2EDuration="21.174146108s" podCreationTimestamp="2026-06-02 15:14:41 +0000 UTC" firstStartedPulling="2026-06-02 15:14:43.640338107 +0000 UTC m=+3.225989085" lastFinishedPulling="2026-06-02 15:15:01.57928144 +0000 UTC m=+21.164932432" observedRunningTime="2026-06-02 15:15:02.174033759 +0000 UTC m=+21.759684759" watchObservedRunningTime="2026-06-02 15:15:02.174146108 +0000 UTC m=+21.759797108" Jun 02 15:15:02.198960 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.198915 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2s766" podStartSLOduration=3.264895315 podStartE2EDuration="21.198903435s" podCreationTimestamp="2026-06-02 15:14:41 +0000 UTC" firstStartedPulling="2026-06-02 15:14:43.644478035 +0000 UTC m=+3.230129030" lastFinishedPulling="2026-06-02 15:15:01.578486148 +0000 UTC m=+21.164137150" observedRunningTime="2026-06-02 15:15:02.198600431 +0000 UTC m=+21.784251432" watchObservedRunningTime="2026-06-02 15:15:02.198903435 +0000 UTC m=+21.784554435" Jun 02 15:15:02.993948 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:02.993785 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:15:02.994094 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:02.994068 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:15:03.057458 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.057435 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 15:15:03.118483 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.118452 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" event={"ID":"9165ab25-b39d-481f-9983-2c6c4bfdd78b","Type":"ContainerStarted","Data":"457cb12629ba6e2493722094c5ed39547d7637e8b710493f1b4fc20025b4b18d"} Jun 02 15:15:03.119678 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.119655 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z7fp7" event={"ID":"f747a7ca-d127-4064-95aa-13e4dafe9d22","Type":"ContainerStarted","Data":"deb4ffb35006cacb98fef90d216c19172a6bf284f5faa1d9cac8e7213942753a"} Jun 02 15:15:03.122026 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.122007 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/ovn-acl-logging/0.log" Jun 02 15:15:03.122343 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.122325 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" event={"ID":"3399fc44-4af2-4e59-8a97-a22f8110b914","Type":"ContainerStarted","Data":"8e9ed730c3ff8632fdc07ad4f8a48451c43ee7b75a9e0b89a1b15543add95f50"} Jun 02 15:15:03.122396 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.122348 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" event={"ID":"3399fc44-4af2-4e59-8a97-a22f8110b914","Type":"ContainerStarted","Data":"890f40fd7028b8744fb373af15cc9c4c5f347bdf2181160cd5251af7b1c85c06"} Jun 02 15:15:03.122396 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.122358 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" event={"ID":"3399fc44-4af2-4e59-8a97-a22f8110b914","Type":"ContainerStarted","Data":"8bfb2fe968bfcf83fff55eb35067d5f68c22a8235506f6ca5ec74febb1571c9f"} Jun 02 15:15:03.123509 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.123489 2566 generic.go:358] "Generic (PLEG): container finished" podID="6b4a2cb3-34d0-41a5-9c84-d7cd4e818043" containerID="f899bd6cabdbae1bff8d26890b9e6c0de5ed276d0dd94d1d4ab4d62389530ca8" exitCode=0 Jun 02 15:15:03.123617 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.123591 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws4sb" event={"ID":"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043","Type":"ContainerDied","Data":"f899bd6cabdbae1bff8d26890b9e6c0de5ed276d0dd94d1d4ab4d62389530ca8"} Jun 02 15:15:03.135401 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.135331 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z7fp7" podStartSLOduration=4.202478738 podStartE2EDuration="22.135319262s" podCreationTimestamp="2026-06-02 15:14:41 +0000 UTC" firstStartedPulling="2026-06-02 15:14:43.647139519 +0000 UTC m=+3.232790513" lastFinishedPulling="2026-06-02 15:15:01.579980042 +0000 UTC m=+21.165631037" observedRunningTime="2026-06-02 15:15:03.135019424 +0000 UTC m=+22.720670425" watchObservedRunningTime="2026-06-02 15:15:03.135319262 +0000 UTC m=+22.720970262" Jun 02 15:15:03.135561 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.135529 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-84jcn" podStartSLOduration=4.202992587 podStartE2EDuration="22.135525703s" podCreationTimestamp="2026-06-02 15:14:41 +0000 UTC" firstStartedPulling="2026-06-02 15:14:43.639033333 +0000 UTC m=+3.224684316" lastFinishedPulling="2026-06-02 15:15:01.571566452 +0000 UTC m=+21.157217432" observedRunningTime="2026-06-02 15:15:02.214456041 +0000 UTC m=+21.800107053" watchObservedRunningTime="2026-06-02 15:15:03.135525703 +0000 UTC m=+22.721176704" Jun 02 15:15:03.582867 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.582833 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-84jcn" Jun 02 15:15:03.583544 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.583524 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-84jcn" Jun 02 15:15:03.945847 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.945678 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T15:15:03.057454055Z","UUID":"1cdd81f6-4a52-41a0-86dc-1789d3177679","Handler":null,"Name":"","Endpoint":""} Jun 02 15:15:03.947579 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.947557 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 15:15:03.947687 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.947588 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 15:15:03.994300 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.994272 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:15:03.994464 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:03.994276 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:15:03.994464 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:03.994391 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:15:03.994588 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:03.994472 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjsmb" podUID="734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e" Jun 02 15:15:04.994376 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:04.994345 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:15:04.994781 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:04.994478 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:15:05.129528 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:05.129483 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" event={"ID":"9165ab25-b39d-481f-9983-2c6c4bfdd78b","Type":"ContainerStarted","Data":"a2ff90ac8e41095e932f813c7b0e0ade8aa918e04fa4e849acfd894fb42fd0fa"} Jun 02 15:15:05.132449 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:05.132428 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/ovn-acl-logging/0.log" Jun 02 15:15:05.132825 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:05.132802 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" event={"ID":"3399fc44-4af2-4e59-8a97-a22f8110b914","Type":"ContainerStarted","Data":"abda5c135526f07b817434628b2f988b402518008b33d6abd00be2eedba761c6"} Jun 02 15:15:05.132909 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:05.132873 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 15:15:05.149243 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:05.149204 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q24jv" podStartSLOduration=3.7619869980000002 podStartE2EDuration="24.149190785s" podCreationTimestamp="2026-06-02 15:14:41 +0000 UTC" firstStartedPulling="2026-06-02 15:14:43.642282596 +0000 UTC m=+3.227933582" lastFinishedPulling="2026-06-02 15:15:04.029486388 +0000 UTC m=+23.615137369" observedRunningTime="2026-06-02 15:15:05.148918567 +0000 UTC m=+24.734569559" watchObservedRunningTime="2026-06-02 15:15:05.149190785 +0000 UTC m=+24.734841787" Jun 02 15:15:05.980246 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:05.980021 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-84jcn" Jun 02 15:15:05.980639 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:05.980616 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-84jcn" Jun 02 15:15:05.993840 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:05.993817 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:15:05.993959 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:05.993861 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:15:05.994022 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:05.993951 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:15:05.994083 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:05.994045 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjsmb" podUID="734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e" Jun 02 15:15:06.993986 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:06.993914 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:15:06.994423 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:06.994028 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:15:07.994355 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:07.994322 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:15:07.994836 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:07.994322 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:15:07.994836 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:07.994432 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjsmb" podUID="734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e" Jun 02 15:15:07.994836 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:07.994482 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:15:08.994069 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:08.993888 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:15:08.994234 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:08.994149 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:15:09.141553 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:09.141517 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/ovn-acl-logging/0.log" Jun 02 15:15:09.142221 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:09.141879 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" event={"ID":"3399fc44-4af2-4e59-8a97-a22f8110b914","Type":"ContainerStarted","Data":"aa5a06f50be2ae649bdb35ebea735b3be9e1156745c32b7b9380273ee8d1182e"} Jun 02 15:15:09.142292 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:09.142263 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:15:09.142366 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:09.142350 2566 scope.go:117] "RemoveContainer" containerID="50ce7ba51648273afba6da3242d0c19e6abce124b728a5fbc3bbfdae3e586693" Jun 02 15:15:09.143600 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:09.143576 2566 generic.go:358] "Generic (PLEG): container finished" podID="6b4a2cb3-34d0-41a5-9c84-d7cd4e818043" containerID="b614368ec70dc9181abe77ec82b9b2eff6b8917a928d89710bee505c13608cc3" exitCode=0 Jun 02 15:15:09.143688 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:09.143629 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws4sb" event={"ID":"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043","Type":"ContainerDied","Data":"b614368ec70dc9181abe77ec82b9b2eff6b8917a928d89710bee505c13608cc3"} Jun 02 15:15:09.158689 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:09.158668 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:15:09.994185 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:09.994158 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:15:09.994292 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:09.994158 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:15:09.994292 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:09.994265 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjsmb" podUID="734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e" Jun 02 15:15:09.994362 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:09.994313 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:15:10.148651 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:10.148629 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/ovn-acl-logging/0.log" Jun 02 15:15:10.148996 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:10.148939 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" event={"ID":"3399fc44-4af2-4e59-8a97-a22f8110b914","Type":"ContainerStarted","Data":"a841955ddd53577b592949201bbbb8886ca45285306a7d4a85960d8c6ed4031b"} Jun 02 15:15:10.149158 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:10.149138 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:15:10.149232 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:10.149170 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:15:10.150900 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:10.150877 2566 generic.go:358] "Generic (PLEG): container finished" podID="6b4a2cb3-34d0-41a5-9c84-d7cd4e818043" containerID="513de95be4121b90c04732e9514b12584396772f7939849924ae5c368f828d26" exitCode=0 Jun 02 15:15:10.150995 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:10.150911 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws4sb" event={"ID":"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043","Type":"ContainerDied","Data":"513de95be4121b90c04732e9514b12584396772f7939849924ae5c368f828d26"} Jun 02 15:15:10.166366 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:10.166346 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:15:10.198600 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:10.198552 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" podStartSLOduration=11.192586947 podStartE2EDuration="29.19853664s" podCreationTimestamp="2026-06-02 15:14:41 +0000 UTC" firstStartedPulling="2026-06-02 15:14:43.646618781 +0000 UTC m=+3.232269760" lastFinishedPulling="2026-06-02 15:15:01.652568458 +0000 UTC m=+21.238219453" observedRunningTime="2026-06-02 15:15:10.198190368 +0000 UTC m=+29.783841370" watchObservedRunningTime="2026-06-02 15:15:10.19853664 +0000 UTC m=+29.784187644" Jun 02 15:15:10.481797 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:10.481765 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-md8jp"] Jun 02 15:15:10.481940 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:10.481906 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:15:10.482047 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:10.482022 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:15:10.483396 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:10.483374 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rjsmb"] Jun 02 15:15:10.483475 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:10.483455 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:15:10.483534 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:10.483519 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjsmb" podUID="734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e" Jun 02 15:15:10.494283 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:10.494261 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6xl9v"] Jun 02 15:15:10.494378 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:10.494366 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:15:10.494482 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:10.494462 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:15:11.994748 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:11.994718 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:15:11.995217 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:11.994722 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:15:11.995217 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:11.994817 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjsmb" podUID="734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e" Jun 02 15:15:11.995217 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:11.994884 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:15:11.995217 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:11.994722 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:15:11.995217 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:11.994999 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:15:12.157060 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:12.157025 2566 generic.go:358] "Generic (PLEG): container finished" podID="6b4a2cb3-34d0-41a5-9c84-d7cd4e818043" containerID="1f1aa211adfd0e1ba1695f30c62830ed89b7896c07224780ddd9b36f4476cf0a" exitCode=0 Jun 02 15:15:12.157228 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:12.157104 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws4sb" event={"ID":"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043","Type":"ContainerDied","Data":"1f1aa211adfd0e1ba1695f30c62830ed89b7896c07224780ddd9b36f4476cf0a"} Jun 02 15:15:13.994769 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:13.994673 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:15:13.995312 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:13.994686 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:15:13.995312 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:13.994799 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjsmb" podUID="734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e" Jun 02 15:15:13.995312 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:13.994685 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:15:13.995312 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:13.994886 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:15:13.995312 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:13.994928 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6xl9v" podUID="9f1fef37-4e7b-4565-a20d-8e4d7994625e" Jun 02 15:15:14.625713 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:14.625659 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs\") pod \"network-metrics-daemon-md8jp\" (UID: \"4814aa17-8f1d-4de5-80a7-f0d823d2c818\") " pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:15:14.625884 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:14.625836 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:15:14.625956 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:14.625912 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs podName:4814aa17-8f1d-4de5-80a7-f0d823d2c818 nodeName:}" failed. No retries permitted until 2026-06-02 15:15:46.625892384 +0000 UTC m=+66.211543375 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs") pod "network-metrics-daemon-md8jp" (UID: "4814aa17-8f1d-4de5-80a7-f0d823d2c818") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:15:14.728020 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:14.726679 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zm7j\" (UniqueName: \"kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j\") pod \"network-check-target-6xl9v\" (UID: \"9f1fef37-4e7b-4565-a20d-8e4d7994625e\") " pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:15:14.728020 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:14.726828 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:15:14.728020 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:14.726859 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:15:14.728020 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:14.726872 2566 projected.go:194] Error preparing data for projected volume kube-api-access-4zm7j for pod openshift-network-diagnostics/network-check-target-6xl9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:15:14.728020 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:14.726940 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j podName:9f1fef37-4e7b-4565-a20d-8e4d7994625e nodeName:}" failed. No retries permitted until 2026-06-02 15:15:46.726920653 +0000 UTC m=+66.312571649 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zm7j" (UniqueName: "kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j") pod "network-check-target-6xl9v" (UID: "9f1fef37-4e7b-4565-a20d-8e4d7994625e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:15:15.706302 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.706227 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeReady" Jun 02 15:15:15.706954 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.706373 2566 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 15:15:15.760717 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.760669 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b49x5"] Jun 02 15:15:15.778242 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.778217 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6j6m8"] Jun 02 15:15:15.778403 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.778386 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:15.781133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.781097 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mpbdm\"" Jun 02 15:15:15.781365 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.781338 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 15:15:15.781517 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.781412 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 15:15:15.798080 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.798058 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6j6m8"] Jun 02 15:15:15.798080 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.798084 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b49x5"] Jun 02 15:15:15.798211 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.798164 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6j6m8" Jun 02 15:15:15.800731 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.800692 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 15:15:15.800832 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.800792 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 15:15:15.800832 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.800812 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 15:15:15.801099 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.801082 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bnxnd\"" Jun 02 15:15:15.937130 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.937094 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vplxg\" (UniqueName: \"kubernetes.io/projected/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-kube-api-access-vplxg\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:15.937323 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.937164 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-config-volume\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:15.937323 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.937195 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert\") pod \"ingress-canary-6j6m8\" (UID: \"e75e6c78-7324-4e26-b921-1d69f6192acf\") " pod="openshift-ingress-canary/ingress-canary-6j6m8" Jun 02 15:15:15.937323 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.937238 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:15.937478 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.937342 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-tmp-dir\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:15.937478 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.937379 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkvkv\" (UniqueName: \"kubernetes.io/projected/e75e6c78-7324-4e26-b921-1d69f6192acf-kube-api-access-bkvkv\") pod \"ingress-canary-6j6m8\" (UID: \"e75e6c78-7324-4e26-b921-1d69f6192acf\") " pod="openshift-ingress-canary/ingress-canary-6j6m8" Jun 02 15:15:15.994179 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.994099 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:15:15.994179 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.994140 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:15:15.994390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:15.994099 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:15:16.001303 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.001279 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 15:15:16.001489 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.001469 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 15:15:16.001823 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.001803 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tzzwr\"" Jun 02 15:15:16.001927 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.001862 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 15:15:16.001927 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.001881 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fgjbw\"" Jun 02 15:15:16.003103 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.002932 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 15:15:16.037969 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.037940 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-config-volume\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:16.038113 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.037977 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert\") pod \"ingress-canary-6j6m8\" (UID: \"e75e6c78-7324-4e26-b921-1d69f6192acf\") " pod="openshift-ingress-canary/ingress-canary-6j6m8" Jun 02 15:15:16.038113 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.038012 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:16.038113 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.038050 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-tmp-dir\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:16.038113 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.038073 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkvkv\" (UniqueName: \"kubernetes.io/projected/e75e6c78-7324-4e26-b921-1d69f6192acf-kube-api-access-bkvkv\") pod \"ingress-canary-6j6m8\" (UID: \"e75e6c78-7324-4e26-b921-1d69f6192acf\") " pod="openshift-ingress-canary/ingress-canary-6j6m8" Jun 02 15:15:16.038113 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:16.038103 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:15:16.038327 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.038129 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vplxg\" (UniqueName: \"kubernetes.io/projected/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-kube-api-access-vplxg\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:16.038327 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:16.038172 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert podName:e75e6c78-7324-4e26-b921-1d69f6192acf nodeName:}" failed. No retries permitted until 2026-06-02 15:15:16.538152753 +0000 UTC m=+36.123803753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert") pod "ingress-canary-6j6m8" (UID: "e75e6c78-7324-4e26-b921-1d69f6192acf") : secret "canary-serving-cert" not found Jun 02 15:15:16.038521 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.038504 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-config-volume\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:16.038570 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.038548 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-tmp-dir\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:16.038640 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:16.038626 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:15:16.038686 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:16.038676 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls podName:798cd11a-6fbd-4c5e-8642-cb8ac8000c11 nodeName:}" failed. No retries permitted until 2026-06-02 15:15:16.538656934 +0000 UTC m=+36.124307917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls") pod "dns-default-b49x5" (UID: "798cd11a-6fbd-4c5e-8642-cb8ac8000c11") : secret "dns-default-metrics-tls" not found Jun 02 15:15:16.049636 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.049612 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vplxg\" (UniqueName: \"kubernetes.io/projected/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-kube-api-access-vplxg\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:16.049773 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.049688 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkvkv\" (UniqueName: \"kubernetes.io/projected/e75e6c78-7324-4e26-b921-1d69f6192acf-kube-api-access-bkvkv\") pod \"ingress-canary-6j6m8\" (UID: \"e75e6c78-7324-4e26-b921-1d69f6192acf\") " pod="openshift-ingress-canary/ingress-canary-6j6m8" Jun 02 15:15:16.341036 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.340998 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret\") pod \"global-pull-secret-syncer-rjsmb\" (UID: \"734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e\") " pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:15:16.343965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.343936 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e-original-pull-secret\") pod \"global-pull-secret-syncer-rjsmb\" (UID: \"734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e\") " pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:15:16.541656 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.541613 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert\") pod \"ingress-canary-6j6m8\" (UID: \"e75e6c78-7324-4e26-b921-1d69f6192acf\") " pod="openshift-ingress-canary/ingress-canary-6j6m8" Jun 02 15:15:16.541863 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.541687 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:16.541863 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:16.541796 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:15:16.541863 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:16.541818 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:15:16.542019 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:16.541873 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert podName:e75e6c78-7324-4e26-b921-1d69f6192acf nodeName:}" failed. No retries permitted until 2026-06-02 15:15:17.541855669 +0000 UTC m=+37.127506648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert") pod "ingress-canary-6j6m8" (UID: "e75e6c78-7324-4e26-b921-1d69f6192acf") : secret "canary-serving-cert" not found Jun 02 15:15:16.542019 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:16.541890 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls podName:798cd11a-6fbd-4c5e-8642-cb8ac8000c11 nodeName:}" failed. No retries permitted until 2026-06-02 15:15:17.541884213 +0000 UTC m=+37.127535191 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls") pod "dns-default-b49x5" (UID: "798cd11a-6fbd-4c5e-8642-cb8ac8000c11") : secret "dns-default-metrics-tls" not found Jun 02 15:15:16.619007 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:16.618927 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjsmb" Jun 02 15:15:17.550666 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:17.550622 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:17.551274 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:17.550738 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert\") pod \"ingress-canary-6j6m8\" (UID: \"e75e6c78-7324-4e26-b921-1d69f6192acf\") " pod="openshift-ingress-canary/ingress-canary-6j6m8" Jun 02 15:15:17.551274 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:17.550805 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:15:17.551274 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:17.550828 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:15:17.551274 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:17.550870 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert podName:e75e6c78-7324-4e26-b921-1d69f6192acf nodeName:}" failed. No retries permitted until 2026-06-02 15:15:19.550857539 +0000 UTC m=+39.136508531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert") pod "ingress-canary-6j6m8" (UID: "e75e6c78-7324-4e26-b921-1d69f6192acf") : secret "canary-serving-cert" not found Jun 02 15:15:17.551274 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:17.550883 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls podName:798cd11a-6fbd-4c5e-8642-cb8ac8000c11 nodeName:}" failed. No retries permitted until 2026-06-02 15:15:19.550876294 +0000 UTC m=+39.136527273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls") pod "dns-default-b49x5" (UID: "798cd11a-6fbd-4c5e-8642-cb8ac8000c11") : secret "dns-default-metrics-tls" not found Jun 02 15:15:18.133649 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:18.132393 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rjsmb"] Jun 02 15:15:18.138128 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:15:18.138095 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734bc4c6_cf3a_447b_9d8a_ac2273ba8b2e.slice/crio-7386276e6d36c14442e421bb32c58a64ba647028143dc9e1cb6eb6e3cfe20dfa WatchSource:0}: Error finding container 7386276e6d36c14442e421bb32c58a64ba647028143dc9e1cb6eb6e3cfe20dfa: Status 404 returned error can't find the container with id 7386276e6d36c14442e421bb32c58a64ba647028143dc9e1cb6eb6e3cfe20dfa Jun 02 15:15:18.173767 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:18.173737 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rjsmb" event={"ID":"734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e","Type":"ContainerStarted","Data":"7386276e6d36c14442e421bb32c58a64ba647028143dc9e1cb6eb6e3cfe20dfa"} Jun 02 15:15:18.176458 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:18.176437 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws4sb" event={"ID":"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043","Type":"ContainerStarted","Data":"055c1d5f89aeb342aba60c0220142c05729ec6179d8638517fa834e1df29f23f"} Jun 02 15:15:19.181722 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:19.181671 2566 generic.go:358] "Generic (PLEG): container finished" podID="6b4a2cb3-34d0-41a5-9c84-d7cd4e818043" containerID="055c1d5f89aeb342aba60c0220142c05729ec6179d8638517fa834e1df29f23f" exitCode=0 Jun 02 15:15:19.182185 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:19.181740 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws4sb" event={"ID":"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043","Type":"ContainerDied","Data":"055c1d5f89aeb342aba60c0220142c05729ec6179d8638517fa834e1df29f23f"} Jun 02 15:15:19.569019 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:19.568982 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert\") pod \"ingress-canary-6j6m8\" (UID: \"e75e6c78-7324-4e26-b921-1d69f6192acf\") " pod="openshift-ingress-canary/ingress-canary-6j6m8" Jun 02 15:15:19.569189 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:19.569039 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:19.569189 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:19.569135 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:15:19.569189 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:19.569136 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:15:19.569189 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:19.569189 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls podName:798cd11a-6fbd-4c5e-8642-cb8ac8000c11 nodeName:}" failed. No retries permitted until 2026-06-02 15:15:23.569174637 +0000 UTC m=+43.154825616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls") pod "dns-default-b49x5" (UID: "798cd11a-6fbd-4c5e-8642-cb8ac8000c11") : secret "dns-default-metrics-tls" not found Jun 02 15:15:19.569343 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:19.569202 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert podName:e75e6c78-7324-4e26-b921-1d69f6192acf nodeName:}" failed. No retries permitted until 2026-06-02 15:15:23.569196358 +0000 UTC m=+43.154847337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert") pod "ingress-canary-6j6m8" (UID: "e75e6c78-7324-4e26-b921-1d69f6192acf") : secret "canary-serving-cert" not found Jun 02 15:15:20.185780 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:20.185748 2566 generic.go:358] "Generic (PLEG): container finished" podID="6b4a2cb3-34d0-41a5-9c84-d7cd4e818043" containerID="8d6207e2ca804c6400fa2d7d60ec3da955c22e661b7e7a5c2acce8bf945678bd" exitCode=0 Jun 02 15:15:20.186216 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:20.185796 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws4sb" event={"ID":"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043","Type":"ContainerDied","Data":"8d6207e2ca804c6400fa2d7d60ec3da955c22e661b7e7a5c2acce8bf945678bd"} Jun 02 15:15:21.191557 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:21.191525 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ws4sb" event={"ID":"6b4a2cb3-34d0-41a5-9c84-d7cd4e818043","Type":"ContainerStarted","Data":"d5fd27231933727d61562da273f9f0cf2a46f9a29b8ddfb6cf0ddb7a2c2232ef"} Jun 02 15:15:21.220930 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:21.220884 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ws4sb" podStartSLOduration=5.830834267 podStartE2EDuration="40.220867948s" podCreationTimestamp="2026-06-02 15:14:41 +0000 UTC" firstStartedPulling="2026-06-02 15:14:43.643239941 +0000 UTC m=+3.228890929" lastFinishedPulling="2026-06-02 15:15:18.033273621 +0000 UTC m=+37.618924610" observedRunningTime="2026-06-02 15:15:21.220462322 +0000 UTC m=+40.806113324" watchObservedRunningTime="2026-06-02 15:15:21.220867948 +0000 UTC m=+40.806518951" Jun 02 15:15:22.195478 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:22.195444 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rjsmb" event={"ID":"734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e","Type":"ContainerStarted","Data":"10752f6c5195384362d567c765abe5bcd098f614a380f85be4c985b2860731e1"} Jun 02 15:15:23.214932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:23.214884 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rjsmb" podStartSLOduration=35.313625246 podStartE2EDuration="39.214869043s" podCreationTimestamp="2026-06-02 15:14:44 +0000 UTC" firstStartedPulling="2026-06-02 15:15:18.139665856 +0000 UTC m=+37.725316835" lastFinishedPulling="2026-06-02 15:15:22.040909654 +0000 UTC m=+41.626560632" observedRunningTime="2026-06-02 15:15:23.214039419 +0000 UTC m=+42.799690410" watchObservedRunningTime="2026-06-02 15:15:23.214869043 +0000 UTC m=+42.800520059" Jun 02 15:15:23.601871 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:23.601830 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:23.602035 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:23.601919 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert\") pod \"ingress-canary-6j6m8\" (UID: \"e75e6c78-7324-4e26-b921-1d69f6192acf\") " pod="openshift-ingress-canary/ingress-canary-6j6m8" Jun 02 15:15:23.602035 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:23.602004 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:15:23.602035 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:23.602024 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:15:23.602129 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:23.602069 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls podName:798cd11a-6fbd-4c5e-8642-cb8ac8000c11 nodeName:}" failed. No retries permitted until 2026-06-02 15:15:31.602052885 +0000 UTC m=+51.187703863 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls") pod "dns-default-b49x5" (UID: "798cd11a-6fbd-4c5e-8642-cb8ac8000c11") : secret "dns-default-metrics-tls" not found Jun 02 15:15:23.602129 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:23.602083 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert podName:e75e6c78-7324-4e26-b921-1d69f6192acf nodeName:}" failed. No retries permitted until 2026-06-02 15:15:31.602076915 +0000 UTC m=+51.187727894 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert") pod "ingress-canary-6j6m8" (UID: "e75e6c78-7324-4e26-b921-1d69f6192acf") : secret "canary-serving-cert" not found Jun 02 15:15:31.658935 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:31.658890 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert\") pod \"ingress-canary-6j6m8\" (UID: \"e75e6c78-7324-4e26-b921-1d69f6192acf\") " pod="openshift-ingress-canary/ingress-canary-6j6m8" Jun 02 15:15:31.658935 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:31.658939 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:31.659478 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:31.659034 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:15:31.659478 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:31.659054 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:15:31.659478 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:31.659098 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls podName:798cd11a-6fbd-4c5e-8642-cb8ac8000c11 nodeName:}" failed. No retries permitted until 2026-06-02 15:15:47.659083552 +0000 UTC m=+67.244734531 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls") pod "dns-default-b49x5" (UID: "798cd11a-6fbd-4c5e-8642-cb8ac8000c11") : secret "dns-default-metrics-tls" not found Jun 02 15:15:31.659478 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:31.659123 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert podName:e75e6c78-7324-4e26-b921-1d69f6192acf nodeName:}" failed. No retries permitted until 2026-06-02 15:15:47.659107498 +0000 UTC m=+67.244758477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert") pod "ingress-canary-6j6m8" (UID: "e75e6c78-7324-4e26-b921-1d69f6192acf") : secret "canary-serving-cert" not found Jun 02 15:15:42.168002 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:42.167976 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mlbxc" Jun 02 15:15:46.661824 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:46.661782 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs\") pod \"network-metrics-daemon-md8jp\" (UID: \"4814aa17-8f1d-4de5-80a7-f0d823d2c818\") " pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:15:46.667794 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:46.667769 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 15:15:46.672314 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:46.672298 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 15:15:46.672399 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:46.672381 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs podName:4814aa17-8f1d-4de5-80a7-f0d823d2c818 nodeName:}" failed. No retries permitted until 2026-06-02 15:16:50.672358795 +0000 UTC m=+130.258009774 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs") pod "network-metrics-daemon-md8jp" (UID: "4814aa17-8f1d-4de5-80a7-f0d823d2c818") : secret "metrics-daemon-secret" not found Jun 02 15:15:46.763146 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:46.763104 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zm7j\" (UniqueName: \"kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j\") pod \"network-check-target-6xl9v\" (UID: \"9f1fef37-4e7b-4565-a20d-8e4d7994625e\") " pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:15:46.767610 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:46.767590 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 15:15:46.777711 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:46.777673 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 15:15:46.787952 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:46.787927 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zm7j\" (UniqueName: \"kubernetes.io/projected/9f1fef37-4e7b-4565-a20d-8e4d7994625e-kube-api-access-4zm7j\") pod \"network-check-target-6xl9v\" (UID: \"9f1fef37-4e7b-4565-a20d-8e4d7994625e\") " pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:15:46.916854 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:46.916782 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fgjbw\"" Jun 02 15:15:46.923654 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:46.923633 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:15:47.068781 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:47.068730 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6xl9v"] Jun 02 15:15:47.073639 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:15:47.073611 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f1fef37_4e7b_4565_a20d_8e4d7994625e.slice/crio-43b904b0a0d124570ca9b60904aa2dc269fa7803af471adfe0aaa70bafbdb9d1 WatchSource:0}: Error finding container 43b904b0a0d124570ca9b60904aa2dc269fa7803af471adfe0aaa70bafbdb9d1: Status 404 returned error can't find the container with id 43b904b0a0d124570ca9b60904aa2dc269fa7803af471adfe0aaa70bafbdb9d1 Jun 02 15:15:47.245334 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:47.245248 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6xl9v" event={"ID":"9f1fef37-4e7b-4565-a20d-8e4d7994625e","Type":"ContainerStarted","Data":"43b904b0a0d124570ca9b60904aa2dc269fa7803af471adfe0aaa70bafbdb9d1"} Jun 02 15:15:47.670718 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:47.670670 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert\") pod \"ingress-canary-6j6m8\" (UID: \"e75e6c78-7324-4e26-b921-1d69f6192acf\") " pod="openshift-ingress-canary/ingress-canary-6j6m8" Jun 02 15:15:47.670718 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:47.670721 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:15:47.671119 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:47.670819 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:15:47.671119 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:47.670843 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:15:47.671119 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:47.670893 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert podName:e75e6c78-7324-4e26-b921-1d69f6192acf nodeName:}" failed. No retries permitted until 2026-06-02 15:16:19.670874809 +0000 UTC m=+99.256525791 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert") pod "ingress-canary-6j6m8" (UID: "e75e6c78-7324-4e26-b921-1d69f6192acf") : secret "canary-serving-cert" not found Jun 02 15:15:47.671119 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:15:47.670926 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls podName:798cd11a-6fbd-4c5e-8642-cb8ac8000c11 nodeName:}" failed. No retries permitted until 2026-06-02 15:16:19.670901341 +0000 UTC m=+99.256552320 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls") pod "dns-default-b49x5" (UID: "798cd11a-6fbd-4c5e-8642-cb8ac8000c11") : secret "dns-default-metrics-tls" not found Jun 02 15:15:53.259417 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:53.259324 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6xl9v" event={"ID":"9f1fef37-4e7b-4565-a20d-8e4d7994625e","Type":"ContainerStarted","Data":"0fa96b419247d84667d5e987e5991397e9aea0d768d670210d3cdcd9ae0fe257"} Jun 02 15:15:53.259805 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:53.259530 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:15:53.288325 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:15:53.288279 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6xl9v" podStartSLOduration=66.47270287 podStartE2EDuration="1m12.288262472s" podCreationTimestamp="2026-06-02 15:14:41 +0000 UTC" firstStartedPulling="2026-06-02 15:15:47.075852136 +0000 UTC m=+66.661503132" lastFinishedPulling="2026-06-02 15:15:52.891411743 +0000 UTC m=+72.477062734" observedRunningTime="2026-06-02 15:15:53.287796983 +0000 UTC m=+72.873447995" watchObservedRunningTime="2026-06-02 15:15:53.288262472 +0000 UTC m=+72.873913473" Jun 02 15:16:19.690878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:19.690827 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert\") pod \"ingress-canary-6j6m8\" (UID: \"e75e6c78-7324-4e26-b921-1d69f6192acf\") " pod="openshift-ingress-canary/ingress-canary-6j6m8" Jun 02 15:16:19.690878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:19.690882 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:16:19.691424 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:19.690969 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:16:19.691424 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:19.690972 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:16:19.691424 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:19.691031 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls podName:798cd11a-6fbd-4c5e-8642-cb8ac8000c11 nodeName:}" failed. No retries permitted until 2026-06-02 15:17:23.691017653 +0000 UTC m=+163.276668631 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls") pod "dns-default-b49x5" (UID: "798cd11a-6fbd-4c5e-8642-cb8ac8000c11") : secret "dns-default-metrics-tls" not found Jun 02 15:16:19.691424 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:19.691044 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert podName:e75e6c78-7324-4e26-b921-1d69f6192acf nodeName:}" failed. No retries permitted until 2026-06-02 15:17:23.691038058 +0000 UTC m=+163.276689037 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert") pod "ingress-canary-6j6m8" (UID: "e75e6c78-7324-4e26-b921-1d69f6192acf") : secret "canary-serving-cert" not found Jun 02 15:16:24.264278 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:24.264245 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6xl9v" Jun 02 15:16:50.696085 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:50.696046 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs\") pod \"network-metrics-daemon-md8jp\" (UID: \"4814aa17-8f1d-4de5-80a7-f0d823d2c818\") " pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:16:50.696556 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:50.696177 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 15:16:50.696556 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:50.696239 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs podName:4814aa17-8f1d-4de5-80a7-f0d823d2c818 nodeName:}" failed. No retries permitted until 2026-06-02 15:18:52.696224335 +0000 UTC m=+252.281875314 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs") pod "network-metrics-daemon-md8jp" (UID: "4814aa17-8f1d-4de5-80a7-f0d823d2c818") : secret "metrics-daemon-secret" not found Jun 02 15:16:56.058106 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.058059 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v"] Jun 02 15:16:56.059753 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.059738 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" Jun 02 15:16:56.063561 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.063540 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 02 15:16:56.066063 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.066041 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-krc78\"" Jun 02 15:16:56.066227 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.066059 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 15:16:56.066227 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.066061 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 15:16:56.066227 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.066157 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 02 15:16:56.071190 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.071165 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v"] Jun 02 15:16:56.135643 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.135602 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9hx7v\" (UID: \"18a865d5-0df0-4ea0-9a9e-b87986e35213\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" Jun 02 15:16:56.135822 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.135653 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/18a865d5-0df0-4ea0-9a9e-b87986e35213-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-9hx7v\" (UID: \"18a865d5-0df0-4ea0-9a9e-b87986e35213\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" Jun 02 15:16:56.135822 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.135671 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r7dp\" (UniqueName: \"kubernetes.io/projected/18a865d5-0df0-4ea0-9a9e-b87986e35213-kube-api-access-2r7dp\") pod \"cluster-monitoring-operator-69b6cbdb88-9hx7v\" (UID: \"18a865d5-0df0-4ea0-9a9e-b87986e35213\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" Jun 02 15:16:56.162962 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.162921 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw"] Jun 02 15:16:56.164949 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.164929 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf"] Jun 02 15:16:56.165117 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.165095 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw" Jun 02 15:16:56.167033 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.167004 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf" Jun 02 15:16:56.167417 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.167394 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 02 15:16:56.167522 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.167504 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 02 15:16:56.167817 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.167796 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 02 15:16:56.167899 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.167862 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7rqmd\"" Jun 02 15:16:56.167899 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.167868 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:16:56.169871 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.169855 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 02 15:16:56.171480 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.171463 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-g2xhn\"" Jun 02 15:16:56.172604 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.172584 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 02 15:16:56.173144 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.173124 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:16:56.178132 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.178108 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw"] Jun 02 15:16:56.181388 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.181370 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf"] Jun 02 15:16:56.236648 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.236617 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6ae8769-7f7c-4353-886a-51d7a39dee7e-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-sdbsw\" (UID: \"a6ae8769-7f7c-4353-886a-51d7a39dee7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw" Jun 02 15:16:56.236799 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.236655 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5kl6\" (UniqueName: \"kubernetes.io/projected/ff885980-5700-4d87-bc33-31824b96742f-kube-api-access-t5kl6\") pod \"cluster-samples-operator-755bbf9bfb-gbgqf\" (UID: \"ff885980-5700-4d87-bc33-31824b96742f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf" Jun 02 15:16:56.236799 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.236695 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9hx7v\" (UID: \"18a865d5-0df0-4ea0-9a9e-b87986e35213\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" Jun 02 15:16:56.236799 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.236757 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/18a865d5-0df0-4ea0-9a9e-b87986e35213-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-9hx7v\" (UID: \"18a865d5-0df0-4ea0-9a9e-b87986e35213\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" Jun 02 15:16:56.236799 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.236781 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r7dp\" (UniqueName: \"kubernetes.io/projected/18a865d5-0df0-4ea0-9a9e-b87986e35213-kube-api-access-2r7dp\") pod \"cluster-monitoring-operator-69b6cbdb88-9hx7v\" (UID: \"18a865d5-0df0-4ea0-9a9e-b87986e35213\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" Jun 02 15:16:56.236929 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:56.236795 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 15:16:56.236929 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.236823 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh6kf\" (UniqueName: \"kubernetes.io/projected/a6ae8769-7f7c-4353-886a-51d7a39dee7e-kube-api-access-lh6kf\") pod \"kube-storage-version-migrator-operator-96ddc787c-sdbsw\" (UID: \"a6ae8769-7f7c-4353-886a-51d7a39dee7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw" Jun 02 15:16:56.236929 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:56.236864 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls podName:18a865d5-0df0-4ea0-9a9e-b87986e35213 nodeName:}" failed. No retries permitted until 2026-06-02 15:16:56.736842399 +0000 UTC m=+136.322493397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9hx7v" (UID: "18a865d5-0df0-4ea0-9a9e-b87986e35213") : secret "cluster-monitoring-operator-tls" not found Jun 02 15:16:56.236929 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.236884 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gbgqf\" (UID: \"ff885980-5700-4d87-bc33-31824b96742f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf" Jun 02 15:16:56.237096 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.236929 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6ae8769-7f7c-4353-886a-51d7a39dee7e-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-sdbsw\" (UID: \"a6ae8769-7f7c-4353-886a-51d7a39dee7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw" Jun 02 15:16:56.237382 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.237366 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/18a865d5-0df0-4ea0-9a9e-b87986e35213-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-9hx7v\" (UID: \"18a865d5-0df0-4ea0-9a9e-b87986e35213\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" Jun 02 15:16:56.245480 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.245455 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r7dp\" (UniqueName: \"kubernetes.io/projected/18a865d5-0df0-4ea0-9a9e-b87986e35213-kube-api-access-2r7dp\") pod \"cluster-monitoring-operator-69b6cbdb88-9hx7v\" (UID: \"18a865d5-0df0-4ea0-9a9e-b87986e35213\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" Jun 02 15:16:56.257066 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.257043 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z"] Jun 02 15:16:56.258904 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.258881 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z" Jun 02 15:16:56.261003 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.260980 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-956d996c5-d9cjt"] Jun 02 15:16:56.262476 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.262461 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.263103 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.263080 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bgzrs\"" Jun 02 15:16:56.263205 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.263116 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:16:56.263205 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.263082 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 15:16:56.263205 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.263136 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 15:16:56.263336 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.263228 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 15:16:56.265296 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.265276 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 15:16:56.265404 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.265321 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kbv8c\"" Jun 02 15:16:56.265404 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.265285 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 15:16:56.265404 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.265342 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 15:16:56.271392 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.271374 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 15:16:56.275146 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.275125 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z"] Jun 02 15:16:56.277208 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.277190 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-956d996c5-d9cjt"] Jun 02 15:16:56.337345 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.337255 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lh6kf\" (UniqueName: \"kubernetes.io/projected/a6ae8769-7f7c-4353-886a-51d7a39dee7e-kube-api-access-lh6kf\") pod \"kube-storage-version-migrator-operator-96ddc787c-sdbsw\" (UID: \"a6ae8769-7f7c-4353-886a-51d7a39dee7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw" Jun 02 15:16:56.337345 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.337293 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gbgqf\" (UID: \"ff885980-5700-4d87-bc33-31824b96742f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf" Jun 02 15:16:56.337600 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.337357 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06d6abd0-f910-4566-a0c2-b85eecd963b6-image-registry-private-configuration\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.337600 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.337383 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.337600 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.337404 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06d6abd0-f910-4566-a0c2-b85eecd963b6-installation-pull-secrets\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.337600 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:56.337410 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 15:16:56.337600 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.337426 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcwdg\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-kube-api-access-xcwdg\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.337600 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:56.337478 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls podName:ff885980-5700-4d87-bc33-31824b96742f nodeName:}" failed. No retries permitted until 2026-06-02 15:16:56.837463174 +0000 UTC m=+136.423114166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-gbgqf" (UID: "ff885980-5700-4d87-bc33-31824b96742f") : secret "samples-operator-tls" not found Jun 02 15:16:56.337600 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.337573 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-bound-sa-token\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.337936 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.337605 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-certificates\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.337936 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.337631 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6ae8769-7f7c-4353-886a-51d7a39dee7e-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-sdbsw\" (UID: \"a6ae8769-7f7c-4353-886a-51d7a39dee7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw" Jun 02 15:16:56.337936 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.337671 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6ae8769-7f7c-4353-886a-51d7a39dee7e-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-sdbsw\" (UID: \"a6ae8769-7f7c-4353-886a-51d7a39dee7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw" Jun 02 15:16:56.337936 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.337715 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/192d6b62-e099-4c0f-8a5a-2e7424e58e66-config\") pod \"service-ca-operator-69877444c-xnk4z\" (UID: \"192d6b62-e099-4c0f-8a5a-2e7424e58e66\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z" Jun 02 15:16:56.337936 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.337745 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5kl6\" (UniqueName: \"kubernetes.io/projected/ff885980-5700-4d87-bc33-31824b96742f-kube-api-access-t5kl6\") pod \"cluster-samples-operator-755bbf9bfb-gbgqf\" (UID: \"ff885980-5700-4d87-bc33-31824b96742f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf" Jun 02 15:16:56.337936 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.337766 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06d6abd0-f910-4566-a0c2-b85eecd963b6-ca-trust-extracted\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.337936 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.337780 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06d6abd0-f910-4566-a0c2-b85eecd963b6-trusted-ca\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.337936 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.337824 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/192d6b62-e099-4c0f-8a5a-2e7424e58e66-serving-cert\") pod \"service-ca-operator-69877444c-xnk4z\" (UID: \"192d6b62-e099-4c0f-8a5a-2e7424e58e66\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z" Jun 02 15:16:56.337936 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.337868 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6zfv\" (UniqueName: \"kubernetes.io/projected/192d6b62-e099-4c0f-8a5a-2e7424e58e66-kube-api-access-q6zfv\") pod \"service-ca-operator-69877444c-xnk4z\" (UID: \"192d6b62-e099-4c0f-8a5a-2e7424e58e66\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z" Jun 02 15:16:56.338279 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.338154 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6ae8769-7f7c-4353-886a-51d7a39dee7e-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-sdbsw\" (UID: \"a6ae8769-7f7c-4353-886a-51d7a39dee7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw" Jun 02 15:16:56.340083 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.340063 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6ae8769-7f7c-4353-886a-51d7a39dee7e-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-sdbsw\" (UID: \"a6ae8769-7f7c-4353-886a-51d7a39dee7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw" Jun 02 15:16:56.349482 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.349456 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh6kf\" (UniqueName: \"kubernetes.io/projected/a6ae8769-7f7c-4353-886a-51d7a39dee7e-kube-api-access-lh6kf\") pod \"kube-storage-version-migrator-operator-96ddc787c-sdbsw\" (UID: \"a6ae8769-7f7c-4353-886a-51d7a39dee7e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw" Jun 02 15:16:56.351479 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.351463 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5kl6\" (UniqueName: \"kubernetes.io/projected/ff885980-5700-4d87-bc33-31824b96742f-kube-api-access-t5kl6\") pod \"cluster-samples-operator-755bbf9bfb-gbgqf\" (UID: \"ff885980-5700-4d87-bc33-31824b96742f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf" Jun 02 15:16:56.438552 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.438516 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/192d6b62-e099-4c0f-8a5a-2e7424e58e66-config\") pod \"service-ca-operator-69877444c-xnk4z\" (UID: \"192d6b62-e099-4c0f-8a5a-2e7424e58e66\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z" Jun 02 15:16:56.438552 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.438557 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06d6abd0-f910-4566-a0c2-b85eecd963b6-ca-trust-extracted\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.438794 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.438575 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06d6abd0-f910-4566-a0c2-b85eecd963b6-trusted-ca\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.438794 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.438627 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/192d6b62-e099-4c0f-8a5a-2e7424e58e66-serving-cert\") pod \"service-ca-operator-69877444c-xnk4z\" (UID: \"192d6b62-e099-4c0f-8a5a-2e7424e58e66\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z" Jun 02 15:16:56.438794 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.438650 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6zfv\" (UniqueName: \"kubernetes.io/projected/192d6b62-e099-4c0f-8a5a-2e7424e58e66-kube-api-access-q6zfv\") pod \"service-ca-operator-69877444c-xnk4z\" (UID: \"192d6b62-e099-4c0f-8a5a-2e7424e58e66\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z" Jun 02 15:16:56.438794 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.438737 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06d6abd0-f910-4566-a0c2-b85eecd963b6-image-registry-private-configuration\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.438794 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.438764 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.438794 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.438789 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06d6abd0-f910-4566-a0c2-b85eecd963b6-installation-pull-secrets\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.439069 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.438813 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xcwdg\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-kube-api-access-xcwdg\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.439069 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.438843 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-bound-sa-token\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.439069 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.438881 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-certificates\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.439069 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:56.438910 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:16:56.439069 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:56.438930 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-956d996c5-d9cjt: secret "image-registry-tls" not found Jun 02 15:16:56.439069 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:56.439000 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls podName:06d6abd0-f910-4566-a0c2-b85eecd963b6 nodeName:}" failed. No retries permitted until 2026-06-02 15:16:56.93897797 +0000 UTC m=+136.524628953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls") pod "image-registry-956d996c5-d9cjt" (UID: "06d6abd0-f910-4566-a0c2-b85eecd963b6") : secret "image-registry-tls" not found Jun 02 15:16:56.439069 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.439019 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06d6abd0-f910-4566-a0c2-b85eecd963b6-ca-trust-extracted\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.439377 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.439228 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/192d6b62-e099-4c0f-8a5a-2e7424e58e66-config\") pod \"service-ca-operator-69877444c-xnk4z\" (UID: \"192d6b62-e099-4c0f-8a5a-2e7424e58e66\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z" Jun 02 15:16:56.439487 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.439389 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-certificates\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.439813 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.439792 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06d6abd0-f910-4566-a0c2-b85eecd963b6-trusted-ca\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.441406 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.441384 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/192d6b62-e099-4c0f-8a5a-2e7424e58e66-serving-cert\") pod \"service-ca-operator-69877444c-xnk4z\" (UID: \"192d6b62-e099-4c0f-8a5a-2e7424e58e66\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z" Jun 02 15:16:56.441493 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.441482 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06d6abd0-f910-4566-a0c2-b85eecd963b6-image-registry-private-configuration\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.441563 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.441543 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06d6abd0-f910-4566-a0c2-b85eecd963b6-installation-pull-secrets\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.450554 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.450526 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6zfv\" (UniqueName: \"kubernetes.io/projected/192d6b62-e099-4c0f-8a5a-2e7424e58e66-kube-api-access-q6zfv\") pod \"service-ca-operator-69877444c-xnk4z\" (UID: \"192d6b62-e099-4c0f-8a5a-2e7424e58e66\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z" Jun 02 15:16:56.450637 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.450556 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-bound-sa-token\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.451119 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.451103 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcwdg\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-kube-api-access-xcwdg\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.475140 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.475105 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw" Jun 02 15:16:56.568961 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.568924 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z" Jun 02 15:16:56.598647 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.598575 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw"] Jun 02 15:16:56.602775 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:16:56.602747 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6ae8769_7f7c_4353_886a_51d7a39dee7e.slice/crio-c34a562f7251ce18b623d47b135c321a5d716a248514733c73a4833ec3f67c0e WatchSource:0}: Error finding container c34a562f7251ce18b623d47b135c321a5d716a248514733c73a4833ec3f67c0e: Status 404 returned error can't find the container with id c34a562f7251ce18b623d47b135c321a5d716a248514733c73a4833ec3f67c0e Jun 02 15:16:56.689866 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.689810 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z"] Jun 02 15:16:56.694734 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:16:56.694683 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod192d6b62_e099_4c0f_8a5a_2e7424e58e66.slice/crio-80a0b9734bc89f497192e4aed477101252ef32971235fa95f4b820452cce811b WatchSource:0}: Error finding container 80a0b9734bc89f497192e4aed477101252ef32971235fa95f4b820452cce811b: Status 404 returned error can't find the container with id 80a0b9734bc89f497192e4aed477101252ef32971235fa95f4b820452cce811b Jun 02 15:16:56.741015 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.740986 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9hx7v\" (UID: \"18a865d5-0df0-4ea0-9a9e-b87986e35213\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" Jun 02 15:16:56.741142 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:56.741118 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 15:16:56.741192 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:56.741182 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls podName:18a865d5-0df0-4ea0-9a9e-b87986e35213 nodeName:}" failed. No retries permitted until 2026-06-02 15:16:57.741163558 +0000 UTC m=+137.326814539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9hx7v" (UID: "18a865d5-0df0-4ea0-9a9e-b87986e35213") : secret "cluster-monitoring-operator-tls" not found Jun 02 15:16:56.842029 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.841995 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gbgqf\" (UID: \"ff885980-5700-4d87-bc33-31824b96742f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf" Jun 02 15:16:56.842185 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:56.842137 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 15:16:56.842228 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:56.842200 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls podName:ff885980-5700-4d87-bc33-31824b96742f nodeName:}" failed. No retries permitted until 2026-06-02 15:16:57.842182519 +0000 UTC m=+137.427833498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-gbgqf" (UID: "ff885980-5700-4d87-bc33-31824b96742f") : secret "samples-operator-tls" not found Jun 02 15:16:56.943048 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:56.942954 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:56.943193 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:56.943113 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:16:56.943193 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:56.943128 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-956d996c5-d9cjt: secret "image-registry-tls" not found Jun 02 15:16:56.943193 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:56.943181 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls podName:06d6abd0-f910-4566-a0c2-b85eecd963b6 nodeName:}" failed. No retries permitted until 2026-06-02 15:16:57.943166824 +0000 UTC m=+137.528817816 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls") pod "image-registry-956d996c5-d9cjt" (UID: "06d6abd0-f910-4566-a0c2-b85eecd963b6") : secret "image-registry-tls" not found Jun 02 15:16:57.386007 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:57.385961 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw" event={"ID":"a6ae8769-7f7c-4353-886a-51d7a39dee7e","Type":"ContainerStarted","Data":"c34a562f7251ce18b623d47b135c321a5d716a248514733c73a4833ec3f67c0e"} Jun 02 15:16:57.387235 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:57.387180 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z" event={"ID":"192d6b62-e099-4c0f-8a5a-2e7424e58e66","Type":"ContainerStarted","Data":"80a0b9734bc89f497192e4aed477101252ef32971235fa95f4b820452cce811b"} Jun 02 15:16:57.749323 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:57.749239 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9hx7v\" (UID: \"18a865d5-0df0-4ea0-9a9e-b87986e35213\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" Jun 02 15:16:57.749486 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:57.749395 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 15:16:57.749486 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:57.749461 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls podName:18a865d5-0df0-4ea0-9a9e-b87986e35213 nodeName:}" failed. No retries permitted until 2026-06-02 15:16:59.74944236 +0000 UTC m=+139.335093344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9hx7v" (UID: "18a865d5-0df0-4ea0-9a9e-b87986e35213") : secret "cluster-monitoring-operator-tls" not found Jun 02 15:16:57.850296 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:57.850259 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gbgqf\" (UID: \"ff885980-5700-4d87-bc33-31824b96742f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf" Jun 02 15:16:57.850470 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:57.850409 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 15:16:57.850519 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:57.850474 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls podName:ff885980-5700-4d87-bc33-31824b96742f nodeName:}" failed. No retries permitted until 2026-06-02 15:16:59.85045703 +0000 UTC m=+139.436108010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-gbgqf" (UID: "ff885980-5700-4d87-bc33-31824b96742f") : secret "samples-operator-tls" not found Jun 02 15:16:57.951715 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:57.951673 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:57.951875 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:57.951826 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:16:57.951875 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:57.951842 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-956d996c5-d9cjt: secret "image-registry-tls" not found Jun 02 15:16:57.951947 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:57.951897 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls podName:06d6abd0-f910-4566-a0c2-b85eecd963b6 nodeName:}" failed. No retries permitted until 2026-06-02 15:16:59.951880366 +0000 UTC m=+139.537531363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls") pod "image-registry-956d996c5-d9cjt" (UID: "06d6abd0-f910-4566-a0c2-b85eecd963b6") : secret "image-registry-tls" not found Jun 02 15:16:59.393283 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:59.393242 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw" event={"ID":"a6ae8769-7f7c-4353-886a-51d7a39dee7e","Type":"ContainerStarted","Data":"a88b37ded5592581954c025d6e907a9f4bc672e9164b501b75b64024d9be775b"} Jun 02 15:16:59.394554 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:59.394530 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z" event={"ID":"192d6b62-e099-4c0f-8a5a-2e7424e58e66","Type":"ContainerStarted","Data":"4aa6171b425bc4e9b3d4cd51d5ad24d48ea67c0ac97320204888a9dfdd654dac"} Jun 02 15:16:59.409893 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:59.409810 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw" podStartSLOduration=0.867351803 podStartE2EDuration="3.4097944s" podCreationTimestamp="2026-06-02 15:16:56 +0000 UTC" firstStartedPulling="2026-06-02 15:16:56.605172803 +0000 UTC m=+136.190823785" lastFinishedPulling="2026-06-02 15:16:59.147615388 +0000 UTC m=+138.733266382" observedRunningTime="2026-06-02 15:16:59.408307077 +0000 UTC m=+138.993958080" watchObservedRunningTime="2026-06-02 15:16:59.4097944 +0000 UTC m=+138.995445402" Jun 02 15:16:59.423218 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:59.423178 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z" podStartSLOduration=0.970701087 podStartE2EDuration="3.423162347s" podCreationTimestamp="2026-06-02 15:16:56 +0000 UTC" firstStartedPulling="2026-06-02 15:16:56.696521708 +0000 UTC m=+136.282172687" lastFinishedPulling="2026-06-02 15:16:59.148982966 +0000 UTC m=+138.734633947" observedRunningTime="2026-06-02 15:16:59.422395135 +0000 UTC m=+139.008046131" watchObservedRunningTime="2026-06-02 15:16:59.423162347 +0000 UTC m=+139.008813348" Jun 02 15:16:59.767458 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:59.767369 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9hx7v\" (UID: \"18a865d5-0df0-4ea0-9a9e-b87986e35213\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" Jun 02 15:16:59.767594 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:59.767513 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 15:16:59.767594 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:59.767582 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls podName:18a865d5-0df0-4ea0-9a9e-b87986e35213 nodeName:}" failed. No retries permitted until 2026-06-02 15:17:03.767564346 +0000 UTC m=+143.353215346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9hx7v" (UID: "18a865d5-0df0-4ea0-9a9e-b87986e35213") : secret "cluster-monitoring-operator-tls" not found Jun 02 15:16:59.868422 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:59.868380 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gbgqf\" (UID: \"ff885980-5700-4d87-bc33-31824b96742f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf" Jun 02 15:16:59.868592 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:59.868514 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 15:16:59.868592 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:59.868574 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls podName:ff885980-5700-4d87-bc33-31824b96742f nodeName:}" failed. No retries permitted until 2026-06-02 15:17:03.868557156 +0000 UTC m=+143.454208155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-gbgqf" (UID: "ff885980-5700-4d87-bc33-31824b96742f") : secret "samples-operator-tls" not found Jun 02 15:16:59.969600 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:16:59.969558 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:16:59.969801 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:59.969728 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:16:59.969801 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:59.969748 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-956d996c5-d9cjt: secret "image-registry-tls" not found Jun 02 15:16:59.969801 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:16:59.969800 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls podName:06d6abd0-f910-4566-a0c2-b85eecd963b6 nodeName:}" failed. No retries permitted until 2026-06-02 15:17:03.969784367 +0000 UTC m=+143.555435345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls") pod "image-registry-956d996c5-d9cjt" (UID: "06d6abd0-f910-4566-a0c2-b85eecd963b6") : secret "image-registry-tls" not found Jun 02 15:17:01.072390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:01.072356 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-4ld2x"] Jun 02 15:17:01.074392 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:01.074373 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4ld2x" Jun 02 15:17:01.077134 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:01.077112 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 02 15:17:01.077439 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:01.077421 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wrxkx\"" Jun 02 15:17:01.078263 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:01.078244 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 02 15:17:01.084619 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:01.084599 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-4ld2x"] Jun 02 15:17:01.179817 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:01.179780 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmj6d\" (UniqueName: \"kubernetes.io/projected/577d500f-1be8-4414-a410-75d2eaf658f1-kube-api-access-vmj6d\") pod \"migrator-96c6f749-4ld2x\" (UID: \"577d500f-1be8-4414-a410-75d2eaf658f1\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4ld2x" Jun 02 15:17:01.280956 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:01.280914 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vmj6d\" (UniqueName: \"kubernetes.io/projected/577d500f-1be8-4414-a410-75d2eaf658f1-kube-api-access-vmj6d\") pod \"migrator-96c6f749-4ld2x\" (UID: \"577d500f-1be8-4414-a410-75d2eaf658f1\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4ld2x" Jun 02 15:17:01.289720 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:01.289675 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmj6d\" (UniqueName: \"kubernetes.io/projected/577d500f-1be8-4414-a410-75d2eaf658f1-kube-api-access-vmj6d\") pod \"migrator-96c6f749-4ld2x\" (UID: \"577d500f-1be8-4414-a410-75d2eaf658f1\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4ld2x" Jun 02 15:17:01.383421 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:01.383344 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4ld2x" Jun 02 15:17:01.516904 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:01.516873 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-4ld2x"] Jun 02 15:17:01.520119 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:17:01.520086 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577d500f_1be8_4414_a410_75d2eaf658f1.slice/crio-77ab313c46ed55948d90a477e081fee93dd9d560f3fba64d7f10ce85a77615fa WatchSource:0}: Error finding container 77ab313c46ed55948d90a477e081fee93dd9d560f3fba64d7f10ce85a77615fa: Status 404 returned error can't find the container with id 77ab313c46ed55948d90a477e081fee93dd9d560f3fba64d7f10ce85a77615fa Jun 02 15:17:02.401247 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:02.401211 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4ld2x" event={"ID":"577d500f-1be8-4414-a410-75d2eaf658f1","Type":"ContainerStarted","Data":"77ab313c46ed55948d90a477e081fee93dd9d560f3fba64d7f10ce85a77615fa"} Jun 02 15:17:02.417002 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:02.416985 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7zgg4_81690d60-d545-4a62-805e-c966443073b4/dns-node-resolver/0.log" Jun 02 15:17:03.407813 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:03.407788 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4ld2x" event={"ID":"577d500f-1be8-4414-a410-75d2eaf658f1","Type":"ContainerStarted","Data":"fbb7dbda74638da7bfb652736b8a867003debca3eab656679e7e82724012e943"} Jun 02 15:17:03.802318 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:03.802288 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9hx7v\" (UID: \"18a865d5-0df0-4ea0-9a9e-b87986e35213\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" Jun 02 15:17:03.802451 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:17:03.802410 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 15:17:03.802501 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:17:03.802463 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls podName:18a865d5-0df0-4ea0-9a9e-b87986e35213 nodeName:}" failed. No retries permitted until 2026-06-02 15:17:11.802448356 +0000 UTC m=+151.388099335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9hx7v" (UID: "18a865d5-0df0-4ea0-9a9e-b87986e35213") : secret "cluster-monitoring-operator-tls" not found Jun 02 15:17:03.819350 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:03.819328 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vpzdk_ee7fa008-6c9e-4db5-9cb5-11f5b181e582/node-ca/0.log" Jun 02 15:17:03.903030 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:03.902997 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gbgqf\" (UID: \"ff885980-5700-4d87-bc33-31824b96742f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf" Jun 02 15:17:03.903169 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:17:03.903139 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 15:17:03.903210 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:17:03.903197 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls podName:ff885980-5700-4d87-bc33-31824b96742f nodeName:}" failed. No retries permitted until 2026-06-02 15:17:11.903180884 +0000 UTC m=+151.488831863 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-gbgqf" (UID: "ff885980-5700-4d87-bc33-31824b96742f") : secret "samples-operator-tls" not found Jun 02 15:17:04.003577 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:04.003538 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:17:04.003724 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:17:04.003655 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 15:17:04.003724 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:17:04.003667 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-956d996c5-d9cjt: secret "image-registry-tls" not found Jun 02 15:17:04.003795 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:17:04.003734 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls podName:06d6abd0-f910-4566-a0c2-b85eecd963b6 nodeName:}" failed. No retries permitted until 2026-06-02 15:17:12.003721029 +0000 UTC m=+151.589372021 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls") pod "image-registry-956d996c5-d9cjt" (UID: "06d6abd0-f910-4566-a0c2-b85eecd963b6") : secret "image-registry-tls" not found Jun 02 15:17:04.412026 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:04.411992 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4ld2x" event={"ID":"577d500f-1be8-4414-a410-75d2eaf658f1","Type":"ContainerStarted","Data":"513b5bdf794abdfa8665f1ff066e29e271ff22899d72c3c6d4e08ffe2430ca5a"} Jun 02 15:17:04.432226 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:04.432172 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-4ld2x" podStartSLOduration=1.6065808499999998 podStartE2EDuration="3.432156486s" podCreationTimestamp="2026-06-02 15:17:01 +0000 UTC" firstStartedPulling="2026-06-02 15:17:01.521938781 +0000 UTC m=+141.107589761" lastFinishedPulling="2026-06-02 15:17:03.347514415 +0000 UTC m=+142.933165397" observedRunningTime="2026-06-02 15:17:04.431378284 +0000 UTC m=+144.017029285" watchObservedRunningTime="2026-06-02 15:17:04.432156486 +0000 UTC m=+144.017807487" Jun 02 15:17:11.865518 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:11.865474 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9hx7v\" (UID: \"18a865d5-0df0-4ea0-9a9e-b87986e35213\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" Jun 02 15:17:11.865953 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:17:11.865625 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 15:17:11.865953 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:17:11.865723 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls podName:18a865d5-0df0-4ea0-9a9e-b87986e35213 nodeName:}" failed. No retries permitted until 2026-06-02 15:17:27.865688114 +0000 UTC m=+167.451339093 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9hx7v" (UID: "18a865d5-0df0-4ea0-9a9e-b87986e35213") : secret "cluster-monitoring-operator-tls" not found Jun 02 15:17:11.966974 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:11.966929 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gbgqf\" (UID: \"ff885980-5700-4d87-bc33-31824b96742f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf" Jun 02 15:17:11.969494 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:11.969474 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff885980-5700-4d87-bc33-31824b96742f-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gbgqf\" (UID: \"ff885980-5700-4d87-bc33-31824b96742f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf" Jun 02 15:17:12.067657 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:12.067619 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:17:12.070161 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:12.070121 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls\") pod \"image-registry-956d996c5-d9cjt\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:17:12.081043 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:12.081011 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf" Jun 02 15:17:12.174133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:12.174100 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:17:12.205578 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:12.205514 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf"] Jun 02 15:17:12.322121 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:12.322087 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-956d996c5-d9cjt"] Jun 02 15:17:12.324951 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:17:12.324917 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d6abd0_f910_4566_a0c2_b85eecd963b6.slice/crio-00c777f05a38eb1305400c0db610ce34bbe27e46c6fb1a55f1bb0737ee57611b WatchSource:0}: Error finding container 00c777f05a38eb1305400c0db610ce34bbe27e46c6fb1a55f1bb0737ee57611b: Status 404 returned error can't find the container with id 00c777f05a38eb1305400c0db610ce34bbe27e46c6fb1a55f1bb0737ee57611b Jun 02 15:17:12.434323 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:12.434219 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-956d996c5-d9cjt" event={"ID":"06d6abd0-f910-4566-a0c2-b85eecd963b6","Type":"ContainerStarted","Data":"6bba589ee0b860b5e965003aaace0f67865a71132fea5ee36524ee9fe6cb9a31"} Jun 02 15:17:12.434323 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:12.434268 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:17:12.434323 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:12.434282 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-956d996c5-d9cjt" event={"ID":"06d6abd0-f910-4566-a0c2-b85eecd963b6","Type":"ContainerStarted","Data":"00c777f05a38eb1305400c0db610ce34bbe27e46c6fb1a55f1bb0737ee57611b"} Jun 02 15:17:12.435197 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:12.435169 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf" event={"ID":"ff885980-5700-4d87-bc33-31824b96742f","Type":"ContainerStarted","Data":"d906b250452a4ed134fcfa31c564911fb78da1c9b1c80288ed634e3f70c2c2b9"} Jun 02 15:17:12.458481 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:12.458438 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-956d996c5-d9cjt" podStartSLOduration=16.458425697 podStartE2EDuration="16.458425697s" podCreationTimestamp="2026-06-02 15:16:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:17:12.457974235 +0000 UTC m=+152.043625230" watchObservedRunningTime="2026-06-02 15:17:12.458425697 +0000 UTC m=+152.044076689" Jun 02 15:17:14.441683 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:14.441649 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf" event={"ID":"ff885980-5700-4d87-bc33-31824b96742f","Type":"ContainerStarted","Data":"e6128b456c2cd981f6875001d7a9e0be4bba97d69030ba96346d4e34c6a7ed07"} Jun 02 15:17:14.441683 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:14.441685 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf" event={"ID":"ff885980-5700-4d87-bc33-31824b96742f","Type":"ContainerStarted","Data":"67973c81881a1441ec597b05256f7c9aa7039edd750ec17b0d1876f2a407863f"} Jun 02 15:17:14.464923 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:14.464878 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gbgqf" podStartSLOduration=16.777692599 podStartE2EDuration="18.464862778s" podCreationTimestamp="2026-06-02 15:16:56 +0000 UTC" firstStartedPulling="2026-06-02 15:17:12.256793538 +0000 UTC m=+151.842444518" lastFinishedPulling="2026-06-02 15:17:13.943963715 +0000 UTC m=+153.529614697" observedRunningTime="2026-06-02 15:17:14.463285219 +0000 UTC m=+154.048936220" watchObservedRunningTime="2026-06-02 15:17:14.464862778 +0000 UTC m=+154.050513778" Jun 02 15:17:18.788816 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:17:18.788768 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b49x5" podUID="798cd11a-6fbd-4c5e-8642-cb8ac8000c11" Jun 02 15:17:18.806353 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:17:18.806318 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-6j6m8" podUID="e75e6c78-7324-4e26-b921-1d69f6192acf" Jun 02 15:17:19.006214 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:17:19.006175 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-md8jp" podUID="4814aa17-8f1d-4de5-80a7-f0d823d2c818" Jun 02 15:17:19.452910 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:19.452878 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b49x5" Jun 02 15:17:23.752727 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:23.752641 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert\") pod \"ingress-canary-6j6m8\" (UID: \"e75e6c78-7324-4e26-b921-1d69f6192acf\") " pod="openshift-ingress-canary/ingress-canary-6j6m8" Jun 02 15:17:23.753224 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:23.752760 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:17:23.755215 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:23.755181 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/798cd11a-6fbd-4c5e-8642-cb8ac8000c11-metrics-tls\") pod \"dns-default-b49x5\" (UID: \"798cd11a-6fbd-4c5e-8642-cb8ac8000c11\") " pod="openshift-dns/dns-default-b49x5" Jun 02 15:17:23.755430 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:23.755393 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e75e6c78-7324-4e26-b921-1d69f6192acf-cert\") pod \"ingress-canary-6j6m8\" (UID: \"e75e6c78-7324-4e26-b921-1d69f6192acf\") " pod="openshift-ingress-canary/ingress-canary-6j6m8" Jun 02 15:17:23.956875 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:23.956842 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mpbdm\"" Jun 02 15:17:23.965012 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:23.964993 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b49x5" Jun 02 15:17:23.979224 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:23.979192 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-956d996c5-d9cjt"] Jun 02 15:17:24.015228 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.015177 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-b7vmn"] Jun 02 15:17:24.021624 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.021600 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b7vmn" Jun 02 15:17:24.024717 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.024667 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 15:17:24.024845 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.024746 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-drkms\"" Jun 02 15:17:24.025119 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.025011 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 15:17:24.025329 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.025313 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 15:17:24.025547 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.025527 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 15:17:24.038347 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.038295 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b7vmn"] Jun 02 15:17:24.055570 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.055539 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e20284df-0021-488a-8774-b075d317fa5c-crio-socket\") pod \"insights-runtime-extractor-b7vmn\" (UID: \"e20284df-0021-488a-8774-b075d317fa5c\") " pod="openshift-insights/insights-runtime-extractor-b7vmn" Jun 02 15:17:24.055752 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.055587 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e20284df-0021-488a-8774-b075d317fa5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b7vmn\" (UID: \"e20284df-0021-488a-8774-b075d317fa5c\") " pod="openshift-insights/insights-runtime-extractor-b7vmn" Jun 02 15:17:24.055752 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.055618 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j8p8\" (UniqueName: \"kubernetes.io/projected/e20284df-0021-488a-8774-b075d317fa5c-kube-api-access-2j8p8\") pod \"insights-runtime-extractor-b7vmn\" (UID: \"e20284df-0021-488a-8774-b075d317fa5c\") " pod="openshift-insights/insights-runtime-extractor-b7vmn" Jun 02 15:17:24.055866 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.055765 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e20284df-0021-488a-8774-b075d317fa5c-data-volume\") pod \"insights-runtime-extractor-b7vmn\" (UID: \"e20284df-0021-488a-8774-b075d317fa5c\") " pod="openshift-insights/insights-runtime-extractor-b7vmn" Jun 02 15:17:24.055866 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.055850 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e20284df-0021-488a-8774-b075d317fa5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b7vmn\" (UID: \"e20284df-0021-488a-8774-b075d317fa5c\") " pod="openshift-insights/insights-runtime-extractor-b7vmn" Jun 02 15:17:24.085684 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.084812 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-4td4k"] Jun 02 15:17:24.089100 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.089078 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-4td4k" Jun 02 15:17:24.091522 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.091499 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 15:17:24.091637 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.091536 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 15:17:24.091870 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.091852 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-m7k99\"" Jun 02 15:17:24.103541 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.103519 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-4td4k"] Jun 02 15:17:24.120498 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.120470 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b49x5"] Jun 02 15:17:24.123384 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:17:24.123350 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798cd11a_6fbd_4c5e_8642_cb8ac8000c11.slice/crio-21feaa3f723564516d17b0e4f5e1c12a3bacf5c2111b2b79b3afe11da5263a9b WatchSource:0}: Error finding container 21feaa3f723564516d17b0e4f5e1c12a3bacf5c2111b2b79b3afe11da5263a9b: Status 404 returned error can't find the container with id 21feaa3f723564516d17b0e4f5e1c12a3bacf5c2111b2b79b3afe11da5263a9b Jun 02 15:17:24.156563 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.156533 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e20284df-0021-488a-8774-b075d317fa5c-crio-socket\") pod \"insights-runtime-extractor-b7vmn\" (UID: \"e20284df-0021-488a-8774-b075d317fa5c\") " pod="openshift-insights/insights-runtime-extractor-b7vmn" Jun 02 15:17:24.156563 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.156564 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e20284df-0021-488a-8774-b075d317fa5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b7vmn\" (UID: \"e20284df-0021-488a-8774-b075d317fa5c\") " pod="openshift-insights/insights-runtime-extractor-b7vmn" Jun 02 15:17:24.156793 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.156584 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2j8p8\" (UniqueName: \"kubernetes.io/projected/e20284df-0021-488a-8774-b075d317fa5c-kube-api-access-2j8p8\") pod \"insights-runtime-extractor-b7vmn\" (UID: \"e20284df-0021-488a-8774-b075d317fa5c\") " pod="openshift-insights/insights-runtime-extractor-b7vmn" Jun 02 15:17:24.156793 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.156651 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e20284df-0021-488a-8774-b075d317fa5c-data-volume\") pod \"insights-runtime-extractor-b7vmn\" (UID: \"e20284df-0021-488a-8774-b075d317fa5c\") " pod="openshift-insights/insights-runtime-extractor-b7vmn" Jun 02 15:17:24.156793 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.156761 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b645p\" (UniqueName: \"kubernetes.io/projected/89e51119-f144-4cb2-89c7-f1b76551e89a-kube-api-access-b645p\") pod \"downloads-c65b8dc4b-4td4k\" (UID: \"89e51119-f144-4cb2-89c7-f1b76551e89a\") " pod="openshift-console/downloads-c65b8dc4b-4td4k" Jun 02 15:17:24.156793 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.156657 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e20284df-0021-488a-8774-b075d317fa5c-crio-socket\") pod \"insights-runtime-extractor-b7vmn\" (UID: \"e20284df-0021-488a-8774-b075d317fa5c\") " pod="openshift-insights/insights-runtime-extractor-b7vmn" Jun 02 15:17:24.156982 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.156853 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e20284df-0021-488a-8774-b075d317fa5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b7vmn\" (UID: \"e20284df-0021-488a-8774-b075d317fa5c\") " pod="openshift-insights/insights-runtime-extractor-b7vmn" Jun 02 15:17:24.157044 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.157004 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e20284df-0021-488a-8774-b075d317fa5c-data-volume\") pod \"insights-runtime-extractor-b7vmn\" (UID: \"e20284df-0021-488a-8774-b075d317fa5c\") " pod="openshift-insights/insights-runtime-extractor-b7vmn" Jun 02 15:17:24.157254 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.157231 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e20284df-0021-488a-8774-b075d317fa5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b7vmn\" (UID: \"e20284df-0021-488a-8774-b075d317fa5c\") " pod="openshift-insights/insights-runtime-extractor-b7vmn" Jun 02 15:17:24.159167 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.159152 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e20284df-0021-488a-8774-b075d317fa5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b7vmn\" (UID: \"e20284df-0021-488a-8774-b075d317fa5c\") " pod="openshift-insights/insights-runtime-extractor-b7vmn" Jun 02 15:17:24.164422 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.164403 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j8p8\" (UniqueName: \"kubernetes.io/projected/e20284df-0021-488a-8774-b075d317fa5c-kube-api-access-2j8p8\") pod \"insights-runtime-extractor-b7vmn\" (UID: \"e20284df-0021-488a-8774-b075d317fa5c\") " pod="openshift-insights/insights-runtime-extractor-b7vmn" Jun 02 15:17:24.257547 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.257512 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b645p\" (UniqueName: \"kubernetes.io/projected/89e51119-f144-4cb2-89c7-f1b76551e89a-kube-api-access-b645p\") pod \"downloads-c65b8dc4b-4td4k\" (UID: \"89e51119-f144-4cb2-89c7-f1b76551e89a\") " pod="openshift-console/downloads-c65b8dc4b-4td4k" Jun 02 15:17:24.267241 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.267180 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b645p\" (UniqueName: \"kubernetes.io/projected/89e51119-f144-4cb2-89c7-f1b76551e89a-kube-api-access-b645p\") pod \"downloads-c65b8dc4b-4td4k\" (UID: \"89e51119-f144-4cb2-89c7-f1b76551e89a\") " pod="openshift-console/downloads-c65b8dc4b-4td4k" Jun 02 15:17:24.335909 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.335880 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b7vmn" Jun 02 15:17:24.397778 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.397751 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-4td4k" Jun 02 15:17:24.464242 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.464207 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b7vmn"] Jun 02 15:17:24.467030 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.466999 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b49x5" event={"ID":"798cd11a-6fbd-4c5e-8642-cb8ac8000c11","Type":"ContainerStarted","Data":"21feaa3f723564516d17b0e4f5e1c12a3bacf5c2111b2b79b3afe11da5263a9b"} Jun 02 15:17:24.468326 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:17:24.468303 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20284df_0021_488a_8774_b075d317fa5c.slice/crio-fb6fad463a0ea9c04dacf17dbe264c6f13db8f9244b2c8d3c64542f37207adc3 WatchSource:0}: Error finding container fb6fad463a0ea9c04dacf17dbe264c6f13db8f9244b2c8d3c64542f37207adc3: Status 404 returned error can't find the container with id fb6fad463a0ea9c04dacf17dbe264c6f13db8f9244b2c8d3c64542f37207adc3 Jun 02 15:17:24.530683 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:24.530661 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-4td4k"] Jun 02 15:17:24.533656 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:17:24.533627 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e51119_f144_4cb2_89c7_f1b76551e89a.slice/crio-511ac21317d8bc4ee75d79b042d69b5f9f8350167b6c1fb01b00fc259da6c8c7 WatchSource:0}: Error finding container 511ac21317d8bc4ee75d79b042d69b5f9f8350167b6c1fb01b00fc259da6c8c7: Status 404 returned error can't find the container with id 511ac21317d8bc4ee75d79b042d69b5f9f8350167b6c1fb01b00fc259da6c8c7 Jun 02 15:17:25.471774 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:25.471642 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-4td4k" event={"ID":"89e51119-f144-4cb2-89c7-f1b76551e89a","Type":"ContainerStarted","Data":"511ac21317d8bc4ee75d79b042d69b5f9f8350167b6c1fb01b00fc259da6c8c7"} Jun 02 15:17:25.473679 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:25.473649 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b7vmn" event={"ID":"e20284df-0021-488a-8774-b075d317fa5c","Type":"ContainerStarted","Data":"de198f060e510790e2249a21eaa5325d331816368ec0b50a865e478ac70fc865"} Jun 02 15:17:25.473679 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:25.473680 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b7vmn" event={"ID":"e20284df-0021-488a-8774-b075d317fa5c","Type":"ContainerStarted","Data":"ae3534d9ef4d4fcf1144ef42c3293d300bb35af7b0d55ff10f148d375da8089c"} Jun 02 15:17:25.473882 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:25.473690 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b7vmn" event={"ID":"e20284df-0021-488a-8774-b075d317fa5c","Type":"ContainerStarted","Data":"fb6fad463a0ea9c04dacf17dbe264c6f13db8f9244b2c8d3c64542f37207adc3"} Jun 02 15:17:26.481944 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:26.481902 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b49x5" event={"ID":"798cd11a-6fbd-4c5e-8642-cb8ac8000c11","Type":"ContainerStarted","Data":"17b142f033f99f67d6258e4c55c1f1590965592d872cb4be9b47d865ccf2bd74"} Jun 02 15:17:26.482361 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:26.481951 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b49x5" event={"ID":"798cd11a-6fbd-4c5e-8642-cb8ac8000c11","Type":"ContainerStarted","Data":"d7a2baf9028f1eab7a43ee7fcf410d2b9e1507030807d8a82e365cc67db2c48e"} Jun 02 15:17:26.482361 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:26.482103 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b49x5" Jun 02 15:17:26.500962 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:26.500918 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-b49x5" podStartSLOduration=129.854077323 podStartE2EDuration="2m11.500904012s" podCreationTimestamp="2026-06-02 15:15:15 +0000 UTC" firstStartedPulling="2026-06-02 15:17:24.125394953 +0000 UTC m=+163.711045946" lastFinishedPulling="2026-06-02 15:17:25.772221649 +0000 UTC m=+165.357872635" observedRunningTime="2026-06-02 15:17:26.4990041 +0000 UTC m=+166.084655101" watchObservedRunningTime="2026-06-02 15:17:26.500904012 +0000 UTC m=+166.086555014" Jun 02 15:17:27.486313 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:27.486269 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b7vmn" event={"ID":"e20284df-0021-488a-8774-b075d317fa5c","Type":"ContainerStarted","Data":"9e2e6bb2c8400b3952c8504038205c63d7ac4804ed24ea523b70697eeac6b877"} Jun 02 15:17:27.506208 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:27.506143 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-b7vmn" podStartSLOduration=2.02145533 podStartE2EDuration="4.506127595s" podCreationTimestamp="2026-06-02 15:17:23 +0000 UTC" firstStartedPulling="2026-06-02 15:17:24.525728446 +0000 UTC m=+164.111379424" lastFinishedPulling="2026-06-02 15:17:27.010400705 +0000 UTC m=+166.596051689" observedRunningTime="2026-06-02 15:17:27.504640792 +0000 UTC m=+167.090291794" watchObservedRunningTime="2026-06-02 15:17:27.506127595 +0000 UTC m=+167.091778594" Jun 02 15:17:27.885474 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:27.885422 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9hx7v\" (UID: \"18a865d5-0df0-4ea0-9a9e-b87986e35213\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" Jun 02 15:17:27.887927 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:27.887904 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/18a865d5-0df0-4ea0-9a9e-b87986e35213-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9hx7v\" (UID: \"18a865d5-0df0-4ea0-9a9e-b87986e35213\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" Jun 02 15:17:28.168849 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:28.168768 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" Jun 02 15:17:28.307167 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:28.307124 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v"] Jun 02 15:17:28.310729 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:17:28.310678 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a865d5_0df0_4ea0_9a9e_b87986e35213.slice/crio-6a83e2085126c3cfaf2ca7fe29a018408b855fa4f1824d14c3d9461b1a92693d WatchSource:0}: Error finding container 6a83e2085126c3cfaf2ca7fe29a018408b855fa4f1824d14c3d9461b1a92693d: Status 404 returned error can't find the container with id 6a83e2085126c3cfaf2ca7fe29a018408b855fa4f1824d14c3d9461b1a92693d Jun 02 15:17:28.491476 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:28.491388 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" event={"ID":"18a865d5-0df0-4ea0-9a9e-b87986e35213","Type":"ContainerStarted","Data":"6a83e2085126c3cfaf2ca7fe29a018408b855fa4f1824d14c3d9461b1a92693d"} Jun 02 15:17:29.994621 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:29.994532 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6j6m8" Jun 02 15:17:29.997760 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:29.997522 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bnxnd\"" Jun 02 15:17:30.005167 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:30.005142 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6j6m8" Jun 02 15:17:30.457468 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:30.457442 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6j6m8"] Jun 02 15:17:30.461046 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:17:30.461010 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode75e6c78_7324_4e26_b921_1d69f6192acf.slice/crio-438f1f15af4426fea37cf54154fbdc80ac2b57396d3399499104b6846e954732 WatchSource:0}: Error finding container 438f1f15af4426fea37cf54154fbdc80ac2b57396d3399499104b6846e954732: Status 404 returned error can't find the container with id 438f1f15af4426fea37cf54154fbdc80ac2b57396d3399499104b6846e954732 Jun 02 15:17:30.497634 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:30.497584 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6j6m8" event={"ID":"e75e6c78-7324-4e26-b921-1d69f6192acf","Type":"ContainerStarted","Data":"438f1f15af4426fea37cf54154fbdc80ac2b57396d3399499104b6846e954732"} Jun 02 15:17:30.499059 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:30.499030 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" event={"ID":"18a865d5-0df0-4ea0-9a9e-b87986e35213","Type":"ContainerStarted","Data":"5d03e6c9eb897d59c28575a318d0f23d357d2314bd6454cfc40052a3f9f3861c"} Jun 02 15:17:30.516231 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:30.516179 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9hx7v" podStartSLOduration=32.464635143 podStartE2EDuration="34.516160947s" podCreationTimestamp="2026-06-02 15:16:56 +0000 UTC" firstStartedPulling="2026-06-02 15:17:28.313049278 +0000 UTC m=+167.898700257" lastFinishedPulling="2026-06-02 15:17:30.364575078 +0000 UTC m=+169.950226061" observedRunningTime="2026-06-02 15:17:30.51594117 +0000 UTC m=+170.101592166" watchObservedRunningTime="2026-06-02 15:17:30.516160947 +0000 UTC m=+170.101811948" Jun 02 15:17:30.898924 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:30.898887 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zkwkl"] Jun 02 15:17:30.901932 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:30.901863 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zkwkl" Jun 02 15:17:30.905018 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:30.904991 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 15:17:30.905018 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:30.905012 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-24dvg\"" Jun 02 15:17:30.911271 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:30.910834 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zkwkl"] Jun 02 15:17:30.996997 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:30.996962 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:17:31.013351 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:31.013293 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3b55bfe5-d162-4a6b-8eb6-c836d1914eb8-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-zkwkl\" (UID: \"3b55bfe5-d162-4a6b-8eb6-c836d1914eb8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zkwkl" Jun 02 15:17:31.114865 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:31.114825 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3b55bfe5-d162-4a6b-8eb6-c836d1914eb8-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-zkwkl\" (UID: \"3b55bfe5-d162-4a6b-8eb6-c836d1914eb8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zkwkl" Jun 02 15:17:31.118563 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:31.118534 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3b55bfe5-d162-4a6b-8eb6-c836d1914eb8-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-zkwkl\" (UID: \"3b55bfe5-d162-4a6b-8eb6-c836d1914eb8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zkwkl" Jun 02 15:17:31.223938 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:31.223623 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zkwkl" Jun 02 15:17:31.381012 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:31.380962 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zkwkl"] Jun 02 15:17:31.388001 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:17:31.387968 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b55bfe5_d162_4a6b_8eb6_c836d1914eb8.slice/crio-f3e02b4009a6bee30bbefc0743719805a8bd0c1113789e7baefc5c68f8babcb6 WatchSource:0}: Error finding container f3e02b4009a6bee30bbefc0743719805a8bd0c1113789e7baefc5c68f8babcb6: Status 404 returned error can't find the container with id f3e02b4009a6bee30bbefc0743719805a8bd0c1113789e7baefc5c68f8babcb6 Jun 02 15:17:31.503566 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:31.503473 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zkwkl" event={"ID":"3b55bfe5-d162-4a6b-8eb6-c836d1914eb8","Type":"ContainerStarted","Data":"f3e02b4009a6bee30bbefc0743719805a8bd0c1113789e7baefc5c68f8babcb6"} Jun 02 15:17:32.507946 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:32.507865 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6j6m8" event={"ID":"e75e6c78-7324-4e26-b921-1d69f6192acf","Type":"ContainerStarted","Data":"6c6f2c03e4644cea084eac36c49338f6bb00cd133acb4fe617d8e8f5a093c1c5"} Jun 02 15:17:32.524173 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:32.524123 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6j6m8" podStartSLOduration=135.771732157 podStartE2EDuration="2m17.524108605s" podCreationTimestamp="2026-06-02 15:15:15 +0000 UTC" firstStartedPulling="2026-06-02 15:17:30.463186504 +0000 UTC m=+170.048837497" lastFinishedPulling="2026-06-02 15:17:32.215562965 +0000 UTC m=+171.801213945" observedRunningTime="2026-06-02 15:17:32.523445583 +0000 UTC m=+172.109096585" watchObservedRunningTime="2026-06-02 15:17:32.524108605 +0000 UTC m=+172.109759606" Jun 02 15:17:33.512219 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:33.512179 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zkwkl" event={"ID":"3b55bfe5-d162-4a6b-8eb6-c836d1914eb8","Type":"ContainerStarted","Data":"5d12a1f1c1af372c7e6dcb15bcbca600e110443167d603400503e500af72f4f7"} Jun 02 15:17:33.526622 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:33.526507 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zkwkl" podStartSLOduration=1.915328006 podStartE2EDuration="3.526489573s" podCreationTimestamp="2026-06-02 15:17:30 +0000 UTC" firstStartedPulling="2026-06-02 15:17:31.390526704 +0000 UTC m=+170.976177690" lastFinishedPulling="2026-06-02 15:17:33.001688249 +0000 UTC m=+172.587339257" observedRunningTime="2026-06-02 15:17:33.526332204 +0000 UTC m=+173.111983204" watchObservedRunningTime="2026-06-02 15:17:33.526489573 +0000 UTC m=+173.112140575" Jun 02 15:17:33.985756 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:33.985726 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:17:34.514636 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:34.514602 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zkwkl" Jun 02 15:17:34.520585 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:34.520399 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zkwkl" Jun 02 15:17:34.965538 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:34.965501 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b"] Jun 02 15:17:34.971028 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:34.971004 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" Jun 02 15:17:34.974912 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:34.974887 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 15:17:34.975064 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:34.974893 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 15:17:34.976086 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:34.976066 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 15:17:34.976351 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:34.976335 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hlhj9\"" Jun 02 15:17:34.977831 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:34.977810 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b"] Jun 02 15:17:35.049881 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:35.049844 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq9q7\" (UniqueName: \"kubernetes.io/projected/7d066952-56c9-4a58-a667-4f3c84833ba9-kube-api-access-wq9q7\") pod \"prometheus-operator-658bcd8bdf-dvm4b\" (UID: \"7d066952-56c9-4a58-a667-4f3c84833ba9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" Jun 02 15:17:35.050070 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:35.049903 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d066952-56c9-4a58-a667-4f3c84833ba9-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-dvm4b\" (UID: \"7d066952-56c9-4a58-a667-4f3c84833ba9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" Jun 02 15:17:35.050070 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:35.050006 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d066952-56c9-4a58-a667-4f3c84833ba9-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-dvm4b\" (UID: \"7d066952-56c9-4a58-a667-4f3c84833ba9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" Jun 02 15:17:35.050070 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:35.050051 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d066952-56c9-4a58-a667-4f3c84833ba9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-dvm4b\" (UID: \"7d066952-56c9-4a58-a667-4f3c84833ba9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" Jun 02 15:17:35.150576 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:35.150536 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d066952-56c9-4a58-a667-4f3c84833ba9-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-dvm4b\" (UID: \"7d066952-56c9-4a58-a667-4f3c84833ba9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" Jun 02 15:17:35.150576 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:35.150581 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d066952-56c9-4a58-a667-4f3c84833ba9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-dvm4b\" (UID: \"7d066952-56c9-4a58-a667-4f3c84833ba9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" Jun 02 15:17:35.150832 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:35.150640 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wq9q7\" (UniqueName: \"kubernetes.io/projected/7d066952-56c9-4a58-a667-4f3c84833ba9-kube-api-access-wq9q7\") pod \"prometheus-operator-658bcd8bdf-dvm4b\" (UID: \"7d066952-56c9-4a58-a667-4f3c84833ba9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" Jun 02 15:17:35.150832 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:35.150662 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d066952-56c9-4a58-a667-4f3c84833ba9-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-dvm4b\" (UID: \"7d066952-56c9-4a58-a667-4f3c84833ba9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" Jun 02 15:17:35.150832 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:17:35.150736 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 02 15:17:35.150832 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:17:35.150829 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d066952-56c9-4a58-a667-4f3c84833ba9-prometheus-operator-tls podName:7d066952-56c9-4a58-a667-4f3c84833ba9 nodeName:}" failed. No retries permitted until 2026-06-02 15:17:35.650806956 +0000 UTC m=+175.236457952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/7d066952-56c9-4a58-a667-4f3c84833ba9-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-dvm4b" (UID: "7d066952-56c9-4a58-a667-4f3c84833ba9") : secret "prometheus-operator-tls" not found Jun 02 15:17:35.151395 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:35.151366 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d066952-56c9-4a58-a667-4f3c84833ba9-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-dvm4b\" (UID: \"7d066952-56c9-4a58-a667-4f3c84833ba9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" Jun 02 15:17:35.153407 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:35.153382 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d066952-56c9-4a58-a667-4f3c84833ba9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-dvm4b\" (UID: \"7d066952-56c9-4a58-a667-4f3c84833ba9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" Jun 02 15:17:35.161997 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:35.161974 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq9q7\" (UniqueName: \"kubernetes.io/projected/7d066952-56c9-4a58-a667-4f3c84833ba9-kube-api-access-wq9q7\") pod \"prometheus-operator-658bcd8bdf-dvm4b\" (UID: \"7d066952-56c9-4a58-a667-4f3c84833ba9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" Jun 02 15:17:35.654691 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:35.654655 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d066952-56c9-4a58-a667-4f3c84833ba9-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-dvm4b\" (UID: \"7d066952-56c9-4a58-a667-4f3c84833ba9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" Jun 02 15:17:35.657457 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:35.657430 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d066952-56c9-4a58-a667-4f3c84833ba9-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-dvm4b\" (UID: \"7d066952-56c9-4a58-a667-4f3c84833ba9\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" Jun 02 15:17:35.883421 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:35.883381 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" Jun 02 15:17:36.014041 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:36.014009 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b"] Jun 02 15:17:36.488367 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:36.488338 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b49x5" Jun 02 15:17:42.794815 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:17:42.794779 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d066952_56c9_4a58_a667_4f3c84833ba9.slice/crio-9c20452b3c937511900cf4dbd2ac9abc9e7dc84b19dae3c3dfc25a21f487dc68 WatchSource:0}: Error finding container 9c20452b3c937511900cf4dbd2ac9abc9e7dc84b19dae3c3dfc25a21f487dc68: Status 404 returned error can't find the container with id 9c20452b3c937511900cf4dbd2ac9abc9e7dc84b19dae3c3dfc25a21f487dc68 Jun 02 15:17:43.546620 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.546575 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" event={"ID":"7d066952-56c9-4a58-a667-4f3c84833ba9","Type":"ContainerStarted","Data":"9c20452b3c937511900cf4dbd2ac9abc9e7dc84b19dae3c3dfc25a21f487dc68"} Jun 02 15:17:43.548853 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.548807 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-4td4k" event={"ID":"89e51119-f144-4cb2-89c7-f1b76551e89a","Type":"ContainerStarted","Data":"298940ea054851192eb4806e71891beccc3013f3392c38643af88f2d47d0e141"} Jun 02 15:17:43.549781 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.549756 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-4td4k" Jun 02 15:17:43.562677 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.562649 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-4td4k" Jun 02 15:17:43.588563 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.588513 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-4td4k" podStartSLOduration=1.262661964 podStartE2EDuration="19.588496738s" podCreationTimestamp="2026-06-02 15:17:24 +0000 UTC" firstStartedPulling="2026-06-02 15:17:24.535772497 +0000 UTC m=+164.121423475" lastFinishedPulling="2026-06-02 15:17:42.861607266 +0000 UTC m=+182.447258249" observedRunningTime="2026-06-02 15:17:43.569278118 +0000 UTC m=+183.154929122" watchObservedRunningTime="2026-06-02 15:17:43.588496738 +0000 UTC m=+183.174147740" Jun 02 15:17:43.767944 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.767904 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c9cb96948-j5tsk"] Jun 02 15:17:43.770179 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.770155 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:43.773320 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.772793 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 15:17:43.773320 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.772819 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 15:17:43.773320 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.772828 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 15:17:43.773320 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.772819 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-m54lq\"" Jun 02 15:17:43.773320 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.772935 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 15:17:43.773320 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.773154 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 15:17:43.777717 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.777678 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 15:17:43.782518 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.782496 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c9cb96948-j5tsk"] Jun 02 15:17:43.926641 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.926559 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knw9p\" (UniqueName: \"kubernetes.io/projected/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-kube-api-access-knw9p\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:43.926641 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.926611 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-serving-cert\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:43.926641 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.926638 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-config\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:43.927171 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.926758 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-trusted-ca-bundle\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:43.927171 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.926800 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-oauth-config\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:43.927171 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.926852 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-oauth-serving-cert\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:43.927171 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:43.926884 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-service-ca\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:44.027721 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.027670 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-trusted-ca-bundle\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:44.029658 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.027912 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-oauth-config\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:44.029658 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.028002 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-oauth-serving-cert\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:44.029658 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.028045 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-service-ca\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:44.029658 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.028119 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knw9p\" (UniqueName: \"kubernetes.io/projected/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-kube-api-access-knw9p\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:44.029658 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.028184 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-serving-cert\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:44.029658 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.028217 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-config\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:44.029658 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.028804 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-trusted-ca-bundle\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:44.029658 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.028827 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-config\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:44.029658 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.029320 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-service-ca\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:44.030630 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.030589 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-oauth-serving-cert\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:44.033695 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.033654 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-oauth-config\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:44.034240 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.034196 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-serving-cert\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:44.040263 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.040174 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knw9p\" (UniqueName: \"kubernetes.io/projected/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-kube-api-access-knw9p\") pod \"console-6c9cb96948-j5tsk\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:44.081639 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.081564 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:44.440194 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.440161 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c9cb96948-j5tsk"] Jun 02 15:17:44.446600 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:17:44.446567 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc83ecbed_7aa0_4ba3_bdf2_bd5df31d7766.slice/crio-fcca895db965d9dccb340cfe281dd128c1d55a8cce10087a1462abc035cea872 WatchSource:0}: Error finding container fcca895db965d9dccb340cfe281dd128c1d55a8cce10087a1462abc035cea872: Status 404 returned error can't find the container with id fcca895db965d9dccb340cfe281dd128c1d55a8cce10087a1462abc035cea872 Jun 02 15:17:44.553817 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.553734 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c9cb96948-j5tsk" event={"ID":"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766","Type":"ContainerStarted","Data":"fcca895db965d9dccb340cfe281dd128c1d55a8cce10087a1462abc035cea872"} Jun 02 15:17:44.555691 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.555657 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" event={"ID":"7d066952-56c9-4a58-a667-4f3c84833ba9","Type":"ContainerStarted","Data":"52c204645b09aab976592538dce1a06d4336012031254d69b61c59b787b79f51"} Jun 02 15:17:44.555841 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:44.555693 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" event={"ID":"7d066952-56c9-4a58-a667-4f3c84833ba9","Type":"ContainerStarted","Data":"98407a602c4ad9e09636ed070af3514d7aab3a245e62e279d2edcd056227d36c"} Jun 02 15:17:46.337344 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.336864 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-dvm4b" podStartSLOduration=10.834196791 podStartE2EDuration="12.336830822s" podCreationTimestamp="2026-06-02 15:17:34 +0000 UTC" firstStartedPulling="2026-06-02 15:17:42.797101705 +0000 UTC m=+182.382752684" lastFinishedPulling="2026-06-02 15:17:44.299735733 +0000 UTC m=+183.885386715" observedRunningTime="2026-06-02 15:17:44.574881984 +0000 UTC m=+184.160532986" watchObservedRunningTime="2026-06-02 15:17:46.336830822 +0000 UTC m=+185.922481827" Jun 02 15:17:46.338511 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.338486 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-ntjg6"] Jun 02 15:17:46.361545 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.360550 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-ntjg6"] Jun 02 15:17:46.361545 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.360726 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" Jun 02 15:17:46.363406 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.363348 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4wbmz\"" Jun 02 15:17:46.363846 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.363801 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 15:17:46.364105 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.364010 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 15:17:46.367214 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.366863 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zdvwh"] Jun 02 15:17:46.397256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.393179 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.397256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.396675 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 15:17:46.397256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.396920 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nzfvd\"" Jun 02 15:17:46.397256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.397124 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 15:17:46.397571 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.397304 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 15:17:46.452474 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.452181 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6508956e-e61d-4c15-9619-519383f0f09d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-ntjg6\" (UID: \"6508956e-e61d-4c15-9619-519383f0f09d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" Jun 02 15:17:46.452474 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.452231 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhcv7\" (UniqueName: \"kubernetes.io/projected/6508956e-e61d-4c15-9619-519383f0f09d-kube-api-access-dhcv7\") pod \"openshift-state-metrics-85658796db-ntjg6\" (UID: \"6508956e-e61d-4c15-9619-519383f0f09d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" Jun 02 15:17:46.452474 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.452297 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6508956e-e61d-4c15-9619-519383f0f09d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-ntjg6\" (UID: \"6508956e-e61d-4c15-9619-519383f0f09d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" Jun 02 15:17:46.452474 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.452349 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6508956e-e61d-4c15-9619-519383f0f09d-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-ntjg6\" (UID: \"6508956e-e61d-4c15-9619-519383f0f09d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" Jun 02 15:17:46.553428 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.553392 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81591a9a-f2bd-4b2f-95de-7f766426e2ce-node-exporter-wtmp\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.553619 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.553446 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81591a9a-f2bd-4b2f-95de-7f766426e2ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.553619 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.553486 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6508956e-e61d-4c15-9619-519383f0f09d-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-ntjg6\" (UID: \"6508956e-e61d-4c15-9619-519383f0f09d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" Jun 02 15:17:46.553619 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.553531 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81591a9a-f2bd-4b2f-95de-7f766426e2ce-metrics-client-ca\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.553619 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.553561 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh5z6\" (UniqueName: \"kubernetes.io/projected/81591a9a-f2bd-4b2f-95de-7f766426e2ce-kube-api-access-gh5z6\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.554635 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.553881 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81591a9a-f2bd-4b2f-95de-7f766426e2ce-node-exporter-textfile\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.554635 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.553992 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81591a9a-f2bd-4b2f-95de-7f766426e2ce-node-exporter-tls\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.554635 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.554052 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6508956e-e61d-4c15-9619-519383f0f09d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-ntjg6\" (UID: \"6508956e-e61d-4c15-9619-519383f0f09d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" Jun 02 15:17:46.554635 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.554090 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhcv7\" (UniqueName: \"kubernetes.io/projected/6508956e-e61d-4c15-9619-519383f0f09d-kube-api-access-dhcv7\") pod \"openshift-state-metrics-85658796db-ntjg6\" (UID: \"6508956e-e61d-4c15-9619-519383f0f09d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" Jun 02 15:17:46.554635 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.554136 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81591a9a-f2bd-4b2f-95de-7f766426e2ce-root\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.554635 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.554165 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81591a9a-f2bd-4b2f-95de-7f766426e2ce-sys\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.554635 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.554188 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81591a9a-f2bd-4b2f-95de-7f766426e2ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.554635 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.554228 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6508956e-e61d-4c15-9619-519383f0f09d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-ntjg6\" (UID: \"6508956e-e61d-4c15-9619-519383f0f09d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" Jun 02 15:17:46.554635 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.554551 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6508956e-e61d-4c15-9619-519383f0f09d-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-ntjg6\" (UID: \"6508956e-e61d-4c15-9619-519383f0f09d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" Jun 02 15:17:46.557306 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.557283 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6508956e-e61d-4c15-9619-519383f0f09d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-ntjg6\" (UID: \"6508956e-e61d-4c15-9619-519383f0f09d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" Jun 02 15:17:46.557786 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.557746 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6508956e-e61d-4c15-9619-519383f0f09d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-ntjg6\" (UID: \"6508956e-e61d-4c15-9619-519383f0f09d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" Jun 02 15:17:46.563135 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.563103 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhcv7\" (UniqueName: \"kubernetes.io/projected/6508956e-e61d-4c15-9619-519383f0f09d-kube-api-access-dhcv7\") pod \"openshift-state-metrics-85658796db-ntjg6\" (UID: \"6508956e-e61d-4c15-9619-519383f0f09d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" Jun 02 15:17:46.655203 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.655116 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gh5z6\" (UniqueName: \"kubernetes.io/projected/81591a9a-f2bd-4b2f-95de-7f766426e2ce-kube-api-access-gh5z6\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.655203 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.655172 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81591a9a-f2bd-4b2f-95de-7f766426e2ce-node-exporter-textfile\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.655426 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.655207 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81591a9a-f2bd-4b2f-95de-7f766426e2ce-node-exporter-tls\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.655426 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.655266 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81591a9a-f2bd-4b2f-95de-7f766426e2ce-root\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.655426 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.655299 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81591a9a-f2bd-4b2f-95de-7f766426e2ce-sys\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.655426 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.655327 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81591a9a-f2bd-4b2f-95de-7f766426e2ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.655426 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.655386 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81591a9a-f2bd-4b2f-95de-7f766426e2ce-node-exporter-wtmp\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.655639 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.655425 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81591a9a-f2bd-4b2f-95de-7f766426e2ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.655639 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.655476 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81591a9a-f2bd-4b2f-95de-7f766426e2ce-metrics-client-ca\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.655639 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.655571 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81591a9a-f2bd-4b2f-95de-7f766426e2ce-sys\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.655823 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.655785 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81591a9a-f2bd-4b2f-95de-7f766426e2ce-root\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.655936 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.655909 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81591a9a-f2bd-4b2f-95de-7f766426e2ce-node-exporter-wtmp\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.656056 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.655935 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81591a9a-f2bd-4b2f-95de-7f766426e2ce-node-exporter-textfile\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.656164 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.656115 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81591a9a-f2bd-4b2f-95de-7f766426e2ce-metrics-client-ca\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.656356 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.656336 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81591a9a-f2bd-4b2f-95de-7f766426e2ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.658821 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.658758 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81591a9a-f2bd-4b2f-95de-7f766426e2ce-node-exporter-tls\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.658821 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.658773 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81591a9a-f2bd-4b2f-95de-7f766426e2ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.666358 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.666315 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh5z6\" (UniqueName: \"kubernetes.io/projected/81591a9a-f2bd-4b2f-95de-7f766426e2ce-kube-api-access-gh5z6\") pod \"node-exporter-zdvwh\" (UID: \"81591a9a-f2bd-4b2f-95de-7f766426e2ce\") " pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:46.675493 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.675095 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" Jun 02 15:17:46.714626 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:46.714588 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zdvwh" Jun 02 15:17:47.830404 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:17:47.830367 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81591a9a_f2bd_4b2f_95de_7f766426e2ce.slice/crio-1e9402af792d82253114e2a795c08bc4fd68e30fd077d29f31c599d36e669a78 WatchSource:0}: Error finding container 1e9402af792d82253114e2a795c08bc4fd68e30fd077d29f31c599d36e669a78: Status 404 returned error can't find the container with id 1e9402af792d82253114e2a795c08bc4fd68e30fd077d29f31c599d36e669a78 Jun 02 15:17:47.990239 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:47.990195 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-ntjg6"] Jun 02 15:17:48.575433 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:48.575388 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zdvwh" event={"ID":"81591a9a-f2bd-4b2f-95de-7f766426e2ce","Type":"ContainerStarted","Data":"1e9402af792d82253114e2a795c08bc4fd68e30fd077d29f31c599d36e669a78"} Jun 02 15:17:48.578075 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:48.578017 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c9cb96948-j5tsk" event={"ID":"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766","Type":"ContainerStarted","Data":"f4851abc3b06b853661ca3b7829876131d27e372c4a23f6059be62ce2ce33fdc"} Jun 02 15:17:48.580281 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:48.580249 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" event={"ID":"6508956e-e61d-4c15-9619-519383f0f09d","Type":"ContainerStarted","Data":"cdc3f9c382a94198e582fc1eab174266ba7ecf9606764d9deaa3697557e66c72"} Jun 02 15:17:48.580281 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:48.580286 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" event={"ID":"6508956e-e61d-4c15-9619-519383f0f09d","Type":"ContainerStarted","Data":"bb8345b1f62d751813b2dc6835c130a8b2969547e6e86501b613d4d6e7ba3b6f"} Jun 02 15:17:48.580457 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:48.580301 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" event={"ID":"6508956e-e61d-4c15-9619-519383f0f09d","Type":"ContainerStarted","Data":"dbe254e4369d32c2eab38324eade4ab760b21d46fa5c40b5d50ab2b711fc4223"} Jun 02 15:17:48.600243 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:48.600182 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6c9cb96948-j5tsk" podStartSLOduration=1.752880977 podStartE2EDuration="5.600164596s" podCreationTimestamp="2026-06-02 15:17:43 +0000 UTC" firstStartedPulling="2026-06-02 15:17:44.449411789 +0000 UTC m=+184.035062768" lastFinishedPulling="2026-06-02 15:17:48.296695393 +0000 UTC m=+187.882346387" observedRunningTime="2026-06-02 15:17:48.599055351 +0000 UTC m=+188.184706354" watchObservedRunningTime="2026-06-02 15:17:48.600164596 +0000 UTC m=+188.185815599" Jun 02 15:17:49.000243 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.000199 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-956d996c5-d9cjt" podUID="06d6abd0-f910-4566-a0c2-b85eecd963b6" containerName="registry" containerID="cri-o://6bba589ee0b860b5e965003aaace0f67865a71132fea5ee36524ee9fe6cb9a31" gracePeriod=30 Jun 02 15:17:49.450997 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.450960 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-55fdf698dd-jsbjf"] Jun 02 15:17:49.480920 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.480891 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55fdf698dd-jsbjf"] Jun 02 15:17:49.481066 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.481052 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.484200 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.484173 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 15:17:49.484531 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.484341 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 15:17:49.484531 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.484389 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2f74orgr79iaa\"" Jun 02 15:17:49.484531 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.484394 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 15:17:49.484531 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.484449 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-c7n4d\"" Jun 02 15:17:49.484902 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.484866 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 15:17:49.484902 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.484869 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 15:17:49.490348 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.490329 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:17:49.584610 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.584577 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06d6abd0-f910-4566-a0c2-b85eecd963b6-installation-pull-secrets\") pod \"06d6abd0-f910-4566-a0c2-b85eecd963b6\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " Jun 02 15:17:49.584764 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.584648 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-bound-sa-token\") pod \"06d6abd0-f910-4566-a0c2-b85eecd963b6\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " Jun 02 15:17:49.584764 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.584683 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls\") pod \"06d6abd0-f910-4566-a0c2-b85eecd963b6\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " Jun 02 15:17:49.584764 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.584737 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06d6abd0-f910-4566-a0c2-b85eecd963b6-trusted-ca\") pod \"06d6abd0-f910-4566-a0c2-b85eecd963b6\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " Jun 02 15:17:49.584922 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.584774 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcwdg\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-kube-api-access-xcwdg\") pod \"06d6abd0-f910-4566-a0c2-b85eecd963b6\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " Jun 02 15:17:49.584922 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.584805 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06d6abd0-f910-4566-a0c2-b85eecd963b6-image-registry-private-configuration\") pod \"06d6abd0-f910-4566-a0c2-b85eecd963b6\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " Jun 02 15:17:49.584922 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.584836 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-certificates\") pod \"06d6abd0-f910-4566-a0c2-b85eecd963b6\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " Jun 02 15:17:49.585385 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.585234 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "06d6abd0-f910-4566-a0c2-b85eecd963b6" (UID: "06d6abd0-f910-4566-a0c2-b85eecd963b6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:17:49.585501 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.585485 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06d6abd0-f910-4566-a0c2-b85eecd963b6-ca-trust-extracted\") pod \"06d6abd0-f910-4566-a0c2-b85eecd963b6\" (UID: \"06d6abd0-f910-4566-a0c2-b85eecd963b6\") " Jun 02 15:17:49.585650 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.585628 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.585733 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.585678 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5f40710-f594-4735-b6be-b7ba2df0b3c8-metrics-client-ca\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.585795 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.585755 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-grpc-tls\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.585851 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.585794 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.585900 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.585861 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcfrx\" (UniqueName: \"kubernetes.io/projected/e5f40710-f594-4735-b6be-b7ba2df0b3c8-kube-api-access-lcfrx\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.585952 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.585933 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.586003 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.585960 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.586048 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.586003 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-thanos-querier-tls\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.586101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.586056 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-certificates\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:17:49.587959 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.587823 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06d6abd0-f910-4566-a0c2-b85eecd963b6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "06d6abd0-f910-4566-a0c2-b85eecd963b6" (UID: "06d6abd0-f910-4566-a0c2-b85eecd963b6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:17:49.593268 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.591133 2566 generic.go:358] "Generic (PLEG): container finished" podID="06d6abd0-f910-4566-a0c2-b85eecd963b6" containerID="6bba589ee0b860b5e965003aaace0f67865a71132fea5ee36524ee9fe6cb9a31" exitCode=0 Jun 02 15:17:49.593268 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.592507 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-956d996c5-d9cjt" Jun 02 15:17:49.593268 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.592673 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-956d996c5-d9cjt" event={"ID":"06d6abd0-f910-4566-a0c2-b85eecd963b6","Type":"ContainerDied","Data":"6bba589ee0b860b5e965003aaace0f67865a71132fea5ee36524ee9fe6cb9a31"} Jun 02 15:17:49.593268 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.592809 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "06d6abd0-f910-4566-a0c2-b85eecd963b6" (UID: "06d6abd0-f910-4566-a0c2-b85eecd963b6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:17:49.593268 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.592891 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "06d6abd0-f910-4566-a0c2-b85eecd963b6" (UID: "06d6abd0-f910-4566-a0c2-b85eecd963b6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:17:49.593268 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.592916 2566 scope.go:117] "RemoveContainer" containerID="6bba589ee0b860b5e965003aaace0f67865a71132fea5ee36524ee9fe6cb9a31" Jun 02 15:17:49.593268 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.592952 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-kube-api-access-xcwdg" (OuterVolumeSpecName: "kube-api-access-xcwdg") pod "06d6abd0-f910-4566-a0c2-b85eecd963b6" (UID: "06d6abd0-f910-4566-a0c2-b85eecd963b6"). InnerVolumeSpecName "kube-api-access-xcwdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:17:49.593268 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.593015 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06d6abd0-f910-4566-a0c2-b85eecd963b6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "06d6abd0-f910-4566-a0c2-b85eecd963b6" (UID: "06d6abd0-f910-4566-a0c2-b85eecd963b6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:17:49.594416 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.593829 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-956d996c5-d9cjt" event={"ID":"06d6abd0-f910-4566-a0c2-b85eecd963b6","Type":"ContainerDied","Data":"00c777f05a38eb1305400c0db610ce34bbe27e46c6fb1a55f1bb0737ee57611b"} Jun 02 15:17:49.595380 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.595358 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06d6abd0-f910-4566-a0c2-b85eecd963b6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "06d6abd0-f910-4566-a0c2-b85eecd963b6" (UID: "06d6abd0-f910-4566-a0c2-b85eecd963b6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:17:49.601604 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.601570 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06d6abd0-f910-4566-a0c2-b85eecd963b6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "06d6abd0-f910-4566-a0c2-b85eecd963b6" (UID: "06d6abd0-f910-4566-a0c2-b85eecd963b6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:17:49.605255 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.605235 2566 scope.go:117] "RemoveContainer" containerID="6bba589ee0b860b5e965003aaace0f67865a71132fea5ee36524ee9fe6cb9a31" Jun 02 15:17:49.605825 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:17:49.605794 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bba589ee0b860b5e965003aaace0f67865a71132fea5ee36524ee9fe6cb9a31\": container with ID starting with 6bba589ee0b860b5e965003aaace0f67865a71132fea5ee36524ee9fe6cb9a31 not found: ID does not exist" containerID="6bba589ee0b860b5e965003aaace0f67865a71132fea5ee36524ee9fe6cb9a31" Jun 02 15:17:49.605919 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.605837 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bba589ee0b860b5e965003aaace0f67865a71132fea5ee36524ee9fe6cb9a31"} err="failed to get container status \"6bba589ee0b860b5e965003aaace0f67865a71132fea5ee36524ee9fe6cb9a31\": rpc error: code = NotFound desc = could not find container \"6bba589ee0b860b5e965003aaace0f67865a71132fea5ee36524ee9fe6cb9a31\": container with ID starting with 6bba589ee0b860b5e965003aaace0f67865a71132fea5ee36524ee9fe6cb9a31 not found: ID does not exist" Jun 02 15:17:49.686787 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.686752 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-grpc-tls\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.687039 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.686826 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.687039 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.687009 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lcfrx\" (UniqueName: \"kubernetes.io/projected/e5f40710-f594-4735-b6be-b7ba2df0b3c8-kube-api-access-lcfrx\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.687163 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.687076 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.687163 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.687109 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.687266 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.687164 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-thanos-querier-tls\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.687316 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.687268 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.687316 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.687303 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5f40710-f594-4735-b6be-b7ba2df0b3c8-metrics-client-ca\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.687439 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.687356 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-bound-sa-token\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:17:49.687439 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.687374 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-registry-tls\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:17:49.687439 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.687387 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06d6abd0-f910-4566-a0c2-b85eecd963b6-trusted-ca\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:17:49.687439 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.687400 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcwdg\" (UniqueName: \"kubernetes.io/projected/06d6abd0-f910-4566-a0c2-b85eecd963b6-kube-api-access-xcwdg\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:17:49.687439 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.687416 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06d6abd0-f910-4566-a0c2-b85eecd963b6-image-registry-private-configuration\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:17:49.687439 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.687435 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06d6abd0-f910-4566-a0c2-b85eecd963b6-ca-trust-extracted\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:17:49.687757 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.687450 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06d6abd0-f910-4566-a0c2-b85eecd963b6-installation-pull-secrets\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:17:49.688209 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.688145 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5f40710-f594-4735-b6be-b7ba2df0b3c8-metrics-client-ca\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.690186 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.690134 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.690736 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.690681 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.691419 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.691400 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.692094 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.692070 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-grpc-tls\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.692476 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.692260 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.693673 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.693649 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e5f40710-f594-4735-b6be-b7ba2df0b3c8-secret-thanos-querier-tls\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.696070 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.696048 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcfrx\" (UniqueName: \"kubernetes.io/projected/e5f40710-f594-4735-b6be-b7ba2df0b3c8-kube-api-access-lcfrx\") pod \"thanos-querier-55fdf698dd-jsbjf\" (UID: \"e5f40710-f594-4735-b6be-b7ba2df0b3c8\") " pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.800652 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.800620 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:49.932289 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.932244 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-956d996c5-d9cjt"] Jun 02 15:17:49.939401 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.939373 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-956d996c5-d9cjt"] Jun 02 15:17:49.988374 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:49.987090 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55fdf698dd-jsbjf"] Jun 02 15:17:50.596595 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:50.596545 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" event={"ID":"e5f40710-f594-4735-b6be-b7ba2df0b3c8","Type":"ContainerStarted","Data":"07f46a0de357d9a3c159f2d6ebfd04cde61c4c04f976fc011479e35835bf5f55"} Jun 02 15:17:50.598211 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:50.598178 2566 generic.go:358] "Generic (PLEG): container finished" podID="81591a9a-f2bd-4b2f-95de-7f766426e2ce" containerID="df550d1441e6d98274bcbec29d239afa63d376b458b8a0cd28adea582fe64378" exitCode=0 Jun 02 15:17:50.598344 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:50.598263 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zdvwh" event={"ID":"81591a9a-f2bd-4b2f-95de-7f766426e2ce","Type":"ContainerDied","Data":"df550d1441e6d98274bcbec29d239afa63d376b458b8a0cd28adea582fe64378"} Jun 02 15:17:50.904877 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:50.904855 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-747cbfc887-rlmr8"] Jun 02 15:17:50.905401 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:50.905380 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d6abd0-f910-4566-a0c2-b85eecd963b6" containerName="registry" Jun 02 15:17:50.905570 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:50.905557 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d6abd0-f910-4566-a0c2-b85eecd963b6" containerName="registry" Jun 02 15:17:50.905768 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:50.905752 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="06d6abd0-f910-4566-a0c2-b85eecd963b6" containerName="registry" Jun 02 15:17:50.939188 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:50.939161 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-747cbfc887-rlmr8"] Jun 02 15:17:50.939307 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:50.939295 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:50.942245 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:50.942223 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4of28bfvsdum7\"" Jun 02 15:17:50.942403 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:50.942367 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-4c4q8\"" Jun 02 15:17:50.942485 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:50.942373 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 15:17:50.942545 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:50.942505 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 15:17:50.942990 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:50.942826 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 15:17:50.942990 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:50.942907 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 15:17:51.009177 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.009146 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06d6abd0-f910-4566-a0c2-b85eecd963b6" path="/var/lib/kubelet/pods/06d6abd0-f910-4566-a0c2-b85eecd963b6/volumes" Jun 02 15:17:51.102935 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.102821 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/695511ba-4bbe-49a7-b111-6f7a757058f2-secret-metrics-server-client-certs\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.102935 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.102908 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/695511ba-4bbe-49a7-b111-6f7a757058f2-client-ca-bundle\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.103154 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.102963 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/695511ba-4bbe-49a7-b111-6f7a757058f2-secret-metrics-server-tls\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.103154 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.102998 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695511ba-4bbe-49a7-b111-6f7a757058f2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.103154 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.103042 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/695511ba-4bbe-49a7-b111-6f7a757058f2-audit-log\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.103154 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.103094 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/695511ba-4bbe-49a7-b111-6f7a757058f2-metrics-server-audit-profiles\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.103154 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.103126 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8q9k\" (UniqueName: \"kubernetes.io/projected/695511ba-4bbe-49a7-b111-6f7a757058f2-kube-api-access-p8q9k\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.162897 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.162847 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-v5v7s"] Jun 02 15:17:51.188060 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.188033 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-v5v7s"] Jun 02 15:17:51.188230 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.188157 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-v5v7s" Jun 02 15:17:51.190914 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.190891 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 15:17:51.191027 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.190940 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-nfwkp\"" Jun 02 15:17:51.204327 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.204300 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/695511ba-4bbe-49a7-b111-6f7a757058f2-audit-log\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.204446 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.204354 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/695511ba-4bbe-49a7-b111-6f7a757058f2-metrics-server-audit-profiles\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.204446 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.204397 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8q9k\" (UniqueName: \"kubernetes.io/projected/695511ba-4bbe-49a7-b111-6f7a757058f2-kube-api-access-p8q9k\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.204567 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.204476 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/695511ba-4bbe-49a7-b111-6f7a757058f2-secret-metrics-server-client-certs\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.204567 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.204520 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/695511ba-4bbe-49a7-b111-6f7a757058f2-client-ca-bundle\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.204567 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.204556 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/695511ba-4bbe-49a7-b111-6f7a757058f2-secret-metrics-server-tls\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.204756 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.204596 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695511ba-4bbe-49a7-b111-6f7a757058f2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.204756 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.204742 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/695511ba-4bbe-49a7-b111-6f7a757058f2-audit-log\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.205369 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.205348 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695511ba-4bbe-49a7-b111-6f7a757058f2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.205516 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.205453 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/695511ba-4bbe-49a7-b111-6f7a757058f2-metrics-server-audit-profiles\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.207856 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.207837 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/695511ba-4bbe-49a7-b111-6f7a757058f2-secret-metrics-server-tls\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.207954 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.207901 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/695511ba-4bbe-49a7-b111-6f7a757058f2-secret-metrics-server-client-certs\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.208948 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.208925 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/695511ba-4bbe-49a7-b111-6f7a757058f2-client-ca-bundle\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.212747 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.212719 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8q9k\" (UniqueName: \"kubernetes.io/projected/695511ba-4bbe-49a7-b111-6f7a757058f2-kube-api-access-p8q9k\") pod \"metrics-server-747cbfc887-rlmr8\" (UID: \"695511ba-4bbe-49a7-b111-6f7a757058f2\") " pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.250931 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.250818 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:17:51.306037 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.305966 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a81736d8-ca36-4a99-a0e2-9b43ecb1446c-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-v5v7s\" (UID: \"a81736d8-ca36-4a99-a0e2-9b43ecb1446c\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-v5v7s" Jun 02 15:17:51.374996 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.374929 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c9cb96948-j5tsk"] Jun 02 15:17:51.406797 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.406764 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a81736d8-ca36-4a99-a0e2-9b43ecb1446c-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-v5v7s\" (UID: \"a81736d8-ca36-4a99-a0e2-9b43ecb1446c\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-v5v7s" Jun 02 15:17:51.409909 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.409880 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a81736d8-ca36-4a99-a0e2-9b43ecb1446c-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-v5v7s\" (UID: \"a81736d8-ca36-4a99-a0e2-9b43ecb1446c\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-v5v7s" Jun 02 15:17:51.499528 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.499493 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-v5v7s" Jun 02 15:17:51.606561 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.605558 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zdvwh" event={"ID":"81591a9a-f2bd-4b2f-95de-7f766426e2ce","Type":"ContainerStarted","Data":"7a1ad2aff7f23fd5ddebc3fc872cb0c4ae0bbc31924b4e01ecafcc349d85d236"} Jun 02 15:17:51.606561 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.605602 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zdvwh" event={"ID":"81591a9a-f2bd-4b2f-95de-7f766426e2ce","Type":"ContainerStarted","Data":"227c69941f7a38460d124f0bb8f7926a16383725dd5d1561220434f0ce2acab7"} Jun 02 15:17:51.610531 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.610140 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" event={"ID":"6508956e-e61d-4c15-9619-519383f0f09d","Type":"ContainerStarted","Data":"85d98622c5d0b1b5630b5aacb72d5897373419a0cb291af92facb25a494a908f"} Jun 02 15:17:51.646347 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.646249 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zdvwh" podStartSLOduration=3.9814527760000002 podStartE2EDuration="5.646228124s" podCreationTimestamp="2026-06-02 15:17:46 +0000 UTC" firstStartedPulling="2026-06-02 15:17:47.832565192 +0000 UTC m=+187.418216174" lastFinishedPulling="2026-06-02 15:17:49.497340526 +0000 UTC m=+189.082991522" observedRunningTime="2026-06-02 15:17:51.627327793 +0000 UTC m=+191.212978796" watchObservedRunningTime="2026-06-02 15:17:51.646228124 +0000 UTC m=+191.231879126" Jun 02 15:17:51.648461 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.647589 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-747cbfc887-rlmr8"] Jun 02 15:17:51.650572 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.649604 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-ntjg6" podStartSLOduration=3.371704497 podStartE2EDuration="5.649591258s" podCreationTimestamp="2026-06-02 15:17:46 +0000 UTC" firstStartedPulling="2026-06-02 15:17:48.428449901 +0000 UTC m=+188.014100894" lastFinishedPulling="2026-06-02 15:17:50.706336667 +0000 UTC m=+190.291987655" observedRunningTime="2026-06-02 15:17:51.649284577 +0000 UTC m=+191.234935580" watchObservedRunningTime="2026-06-02 15:17:51.649591258 +0000 UTC m=+191.235242260" Jun 02 15:17:51.672815 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:51.672783 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-v5v7s"] Jun 02 15:17:51.678327 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:17:51.678297 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda81736d8_ca36_4a99_a0e2_9b43ecb1446c.slice/crio-3c2fa7c318d0ca00c6bdd75816f1df76fe0d20994fd64dc58bf9f4c832f803c5 WatchSource:0}: Error finding container 3c2fa7c318d0ca00c6bdd75816f1df76fe0d20994fd64dc58bf9f4c832f803c5: Status 404 returned error can't find the container with id 3c2fa7c318d0ca00c6bdd75816f1df76fe0d20994fd64dc58bf9f4c832f803c5 Jun 02 15:17:52.616113 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.616074 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" event={"ID":"695511ba-4bbe-49a7-b111-6f7a757058f2","Type":"ContainerStarted","Data":"81fb2ef7efe2b50d0dda983aeef75b73ad842fd47126dc56af688e5d1c618384"} Jun 02 15:17:52.617423 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.617396 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-v5v7s" event={"ID":"a81736d8-ca36-4a99-a0e2-9b43ecb1446c","Type":"ContainerStarted","Data":"3c2fa7c318d0ca00c6bdd75816f1df76fe0d20994fd64dc58bf9f4c832f803c5"} Jun 02 15:17:52.679400 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.679364 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:17:52.694252 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.694220 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.700083 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.700053 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:17:52.700452 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.700432 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8nf6g\"" Jun 02 15:17:52.701341 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.701144 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 15:17:52.701454 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.701414 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 15:17:52.701623 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.701605 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 15:17:52.701838 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.701820 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 15:17:52.702787 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.702767 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 15:17:52.703028 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.703009 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 15:17:52.703223 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.703206 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 15:17:52.703832 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.703635 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 15:17:52.705882 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.705852 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 15:17:52.708751 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.707269 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 15:17:52.708751 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.708200 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-evgr788799618\"" Jun 02 15:17:52.709477 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.708989 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 15:17:52.712989 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.709775 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 15:17:52.822960 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.822919 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.823162 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.822979 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-web-config\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.823162 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.823017 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.823162 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.823046 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.823162 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.823078 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da86b467-4cab-436c-b8b0-0e02e7528b48-config-out\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.823162 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.823101 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.823162 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.823159 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da86b467-4cab-436c-b8b0-0e02e7528b48-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.823445 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.823243 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.823445 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.823268 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.823445 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.823295 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.823445 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.823371 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.823445 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.823397 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.823445 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.823443 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.823694 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.823471 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.823694 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.823499 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz7ll\" (UniqueName: \"kubernetes.io/projected/da86b467-4cab-436c-b8b0-0e02e7528b48-kube-api-access-nz7ll\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.823694 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.823525 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.823694 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.823558 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-config\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.823694 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.823580 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.924984 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.924894 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.924984 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.924940 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.925213 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.925181 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.925270 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.925220 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.925270 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.925252 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nz7ll\" (UniqueName: \"kubernetes.io/projected/da86b467-4cab-436c-b8b0-0e02e7528b48-kube-api-access-nz7ll\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.925369 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.925283 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.925429 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.925364 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-config\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.925429 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.925393 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.925552 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.925429 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.925552 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.925466 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-web-config\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.925653 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.925551 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.925653 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.925582 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.925653 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.925615 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da86b467-4cab-436c-b8b0-0e02e7528b48-config-out\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.925653 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.925643 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.925886 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.925726 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da86b467-4cab-436c-b8b0-0e02e7528b48-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.925886 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.925755 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.925886 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.925778 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.925886 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.925817 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.926254 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.926227 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.927067 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.927036 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.927310 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.927282 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.929064 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.928784 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.929064 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.928937 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.929566 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.929539 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.930809 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.930743 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-web-config\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.931086 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.931062 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.931165 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.931119 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.931891 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.931866 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da86b467-4cab-436c-b8b0-0e02e7528b48-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.932007 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.931981 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.932067 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.932019 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da86b467-4cab-436c-b8b0-0e02e7528b48-config-out\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.932426 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.932404 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-config\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.934607 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.934298 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.934957 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.934910 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.936454 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.935124 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.936454 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.935482 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:52.938422 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:52.938400 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz7ll\" (UniqueName: \"kubernetes.io/projected/da86b467-4cab-436c-b8b0-0e02e7528b48-kube-api-access-nz7ll\") pod \"prometheus-k8s-0\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:53.027611 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:53.027290 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:17:54.082150 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:54.082115 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:17:54.870460 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:54.870263 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:17:54.873049 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:17:54.873009 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda86b467_4cab_436c_b8b0_0e02e7528b48.slice/crio-5cff13376fe301ced9db458fa5111041af1f16ea573f8a5bc8b72521bc7a3273 WatchSource:0}: Error finding container 5cff13376fe301ced9db458fa5111041af1f16ea573f8a5bc8b72521bc7a3273: Status 404 returned error can't find the container with id 5cff13376fe301ced9db458fa5111041af1f16ea573f8a5bc8b72521bc7a3273 Jun 02 15:17:55.627717 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:55.627669 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da86b467-4cab-436c-b8b0-0e02e7528b48","Type":"ContainerStarted","Data":"5cff13376fe301ced9db458fa5111041af1f16ea573f8a5bc8b72521bc7a3273"} Jun 02 15:17:55.629412 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:55.629359 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-v5v7s" event={"ID":"a81736d8-ca36-4a99-a0e2-9b43ecb1446c","Type":"ContainerStarted","Data":"3fc9fd3097fdc92eb49de0b6e1e1f801b4eeb2e4efd6b04813f31ea08e2a41c1"} Jun 02 15:17:55.629623 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:55.629598 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-v5v7s" Jun 02 15:17:55.631617 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:55.631580 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" event={"ID":"e5f40710-f594-4735-b6be-b7ba2df0b3c8","Type":"ContainerStarted","Data":"5eedca03e0667b0e8ad0c6742f31a79a884e1e7586e76d354c50bd21205f841b"} Jun 02 15:17:55.631617 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:55.631612 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" event={"ID":"e5f40710-f594-4735-b6be-b7ba2df0b3c8","Type":"ContainerStarted","Data":"9e11877040d30ec724b984fae011a358fbac96510ad9d868d08894905185bfc8"} Jun 02 15:17:55.631812 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:55.631629 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" event={"ID":"e5f40710-f594-4735-b6be-b7ba2df0b3c8","Type":"ContainerStarted","Data":"7693fa99b17551efed1ba1aa83d2f01743796a837037ccc0e416301bb3e4c65e"} Jun 02 15:17:55.633351 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:55.633322 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" event={"ID":"695511ba-4bbe-49a7-b111-6f7a757058f2","Type":"ContainerStarted","Data":"ea03b41ff24832a38564139759bc71e16510f6cf69496c2ad57b8cde65bcb1f6"} Jun 02 15:17:55.636349 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:55.636317 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-v5v7s" Jun 02 15:17:55.648685 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:55.648628 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-v5v7s" podStartSLOduration=1.5971999989999999 podStartE2EDuration="4.648607553s" podCreationTimestamp="2026-06-02 15:17:51 +0000 UTC" firstStartedPulling="2026-06-02 15:17:51.68047619 +0000 UTC m=+191.266127170" lastFinishedPulling="2026-06-02 15:17:54.73188373 +0000 UTC m=+194.317534724" observedRunningTime="2026-06-02 15:17:55.647257626 +0000 UTC m=+195.232908630" watchObservedRunningTime="2026-06-02 15:17:55.648607553 +0000 UTC m=+195.234258534" Jun 02 15:17:55.664043 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:55.663995 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" podStartSLOduration=2.587354723 podStartE2EDuration="5.663980835s" podCreationTimestamp="2026-06-02 15:17:50 +0000 UTC" firstStartedPulling="2026-06-02 15:17:51.657412734 +0000 UTC m=+191.243063716" lastFinishedPulling="2026-06-02 15:17:54.73403885 +0000 UTC m=+194.319689828" observedRunningTime="2026-06-02 15:17:55.663204169 +0000 UTC m=+195.248855171" watchObservedRunningTime="2026-06-02 15:17:55.663980835 +0000 UTC m=+195.249631835" Jun 02 15:17:56.638192 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:56.638166 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" event={"ID":"e5f40710-f594-4735-b6be-b7ba2df0b3c8","Type":"ContainerStarted","Data":"5657e64d3cbb28b949dd2fa9f2cd57ff31741142089216aaa5729a269e14bf5a"} Jun 02 15:17:56.639770 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:56.639740 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da86b467-4cab-436c-b8b0-0e02e7528b48","Type":"ContainerStarted","Data":"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1"} Jun 02 15:17:57.647529 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:57.647483 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" event={"ID":"e5f40710-f594-4735-b6be-b7ba2df0b3c8","Type":"ContainerStarted","Data":"36ed50cd1f864abeb3c302847ae486b5d21fd0260e71880fff304b8675d47034"} Jun 02 15:17:57.647529 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:57.647531 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" event={"ID":"e5f40710-f594-4735-b6be-b7ba2df0b3c8","Type":"ContainerStarted","Data":"ff00adf098d8456ba62a061af87224a4dd2d3bc967bb4c1362e5733bb7ae473c"} Jun 02 15:17:57.648125 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:57.647629 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:17:57.649032 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:57.649007 2566 generic.go:358] "Generic (PLEG): container finished" podID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerID="bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1" exitCode=0 Jun 02 15:17:57.649163 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:57.649082 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da86b467-4cab-436c-b8b0-0e02e7528b48","Type":"ContainerDied","Data":"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1"} Jun 02 15:17:57.697042 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:17:57.696994 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" podStartSLOduration=2.480185319 podStartE2EDuration="8.696980874s" podCreationTimestamp="2026-06-02 15:17:49 +0000 UTC" firstStartedPulling="2026-06-02 15:17:50.27016195 +0000 UTC m=+189.855812929" lastFinishedPulling="2026-06-02 15:17:56.486957503 +0000 UTC m=+196.072608484" observedRunningTime="2026-06-02 15:17:57.671323279 +0000 UTC m=+197.256974281" watchObservedRunningTime="2026-06-02 15:17:57.696980874 +0000 UTC m=+197.282631876" Jun 02 15:18:01.663299 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:01.663269 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da86b467-4cab-436c-b8b0-0e02e7528b48","Type":"ContainerStarted","Data":"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598"} Jun 02 15:18:01.663656 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:01.663306 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da86b467-4cab-436c-b8b0-0e02e7528b48","Type":"ContainerStarted","Data":"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23"} Jun 02 15:18:01.663656 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:01.663317 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da86b467-4cab-436c-b8b0-0e02e7528b48","Type":"ContainerStarted","Data":"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050"} Jun 02 15:18:01.663656 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:01.663325 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da86b467-4cab-436c-b8b0-0e02e7528b48","Type":"ContainerStarted","Data":"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f"} Jun 02 15:18:02.669046 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:02.669011 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da86b467-4cab-436c-b8b0-0e02e7528b48","Type":"ContainerStarted","Data":"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7"} Jun 02 15:18:02.669046 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:02.669047 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da86b467-4cab-436c-b8b0-0e02e7528b48","Type":"ContainerStarted","Data":"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022"} Jun 02 15:18:02.696845 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:02.696797 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.571759812 podStartE2EDuration="10.696784194s" podCreationTimestamp="2026-06-02 15:17:52 +0000 UTC" firstStartedPulling="2026-06-02 15:17:54.875161914 +0000 UTC m=+194.460812892" lastFinishedPulling="2026-06-02 15:18:01.000186284 +0000 UTC m=+200.585837274" observedRunningTime="2026-06-02 15:18:02.694728727 +0000 UTC m=+202.280379731" watchObservedRunningTime="2026-06-02 15:18:02.696784194 +0000 UTC m=+202.282435194" Jun 02 15:18:03.027528 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:03.027485 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:18:03.659337 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:03.659309 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-55fdf698dd-jsbjf" Jun 02 15:18:11.251376 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:11.251331 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:18:11.251376 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:11.251383 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:18:15.709671 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:15.709634 2566 generic.go:358] "Generic (PLEG): container finished" podID="192d6b62-e099-4c0f-8a5a-2e7424e58e66" containerID="4aa6171b425bc4e9b3d4cd51d5ad24d48ea67c0ac97320204888a9dfdd654dac" exitCode=0 Jun 02 15:18:15.710073 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:15.709722 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z" event={"ID":"192d6b62-e099-4c0f-8a5a-2e7424e58e66","Type":"ContainerDied","Data":"4aa6171b425bc4e9b3d4cd51d5ad24d48ea67c0ac97320204888a9dfdd654dac"} Jun 02 15:18:15.710073 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:15.710051 2566 scope.go:117] "RemoveContainer" containerID="4aa6171b425bc4e9b3d4cd51d5ad24d48ea67c0ac97320204888a9dfdd654dac" Jun 02 15:18:16.403645 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.403571 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6c9cb96948-j5tsk" podUID="c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766" containerName="console" containerID="cri-o://f4851abc3b06b853661ca3b7829876131d27e372c4a23f6059be62ce2ce33fdc" gracePeriod=15 Jun 02 15:18:16.662064 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.662014 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c9cb96948-j5tsk_c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766/console/0.log" Jun 02 15:18:16.662164 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.662072 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:18:16.714321 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.714283 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-xnk4z" event={"ID":"192d6b62-e099-4c0f-8a5a-2e7424e58e66","Type":"ContainerStarted","Data":"fbe1fa8c7fbb68e6e721fb823deeb6dc954f3902473737aa68ded36c4c1a0744"} Jun 02 15:18:16.715472 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.715450 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c9cb96948-j5tsk_c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766/console/0.log" Jun 02 15:18:16.715590 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.715494 2566 generic.go:358] "Generic (PLEG): container finished" podID="c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766" containerID="f4851abc3b06b853661ca3b7829876131d27e372c4a23f6059be62ce2ce33fdc" exitCode=2 Jun 02 15:18:16.715590 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.715540 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c9cb96948-j5tsk" Jun 02 15:18:16.715590 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.715576 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c9cb96948-j5tsk" event={"ID":"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766","Type":"ContainerDied","Data":"f4851abc3b06b853661ca3b7829876131d27e372c4a23f6059be62ce2ce33fdc"} Jun 02 15:18:16.715737 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.715609 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c9cb96948-j5tsk" event={"ID":"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766","Type":"ContainerDied","Data":"fcca895db965d9dccb340cfe281dd128c1d55a8cce10087a1462abc035cea872"} Jun 02 15:18:16.715737 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.715626 2566 scope.go:117] "RemoveContainer" containerID="f4851abc3b06b853661ca3b7829876131d27e372c4a23f6059be62ce2ce33fdc" Jun 02 15:18:16.733307 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.733289 2566 scope.go:117] "RemoveContainer" containerID="f4851abc3b06b853661ca3b7829876131d27e372c4a23f6059be62ce2ce33fdc" Jun 02 15:18:16.733567 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:18:16.733548 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4851abc3b06b853661ca3b7829876131d27e372c4a23f6059be62ce2ce33fdc\": container with ID starting with f4851abc3b06b853661ca3b7829876131d27e372c4a23f6059be62ce2ce33fdc not found: ID does not exist" containerID="f4851abc3b06b853661ca3b7829876131d27e372c4a23f6059be62ce2ce33fdc" Jun 02 15:18:16.733616 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.733577 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4851abc3b06b853661ca3b7829876131d27e372c4a23f6059be62ce2ce33fdc"} err="failed to get container status \"f4851abc3b06b853661ca3b7829876131d27e372c4a23f6059be62ce2ce33fdc\": rpc error: code = NotFound desc = could not find container \"f4851abc3b06b853661ca3b7829876131d27e372c4a23f6059be62ce2ce33fdc\": container with ID starting with f4851abc3b06b853661ca3b7829876131d27e372c4a23f6059be62ce2ce33fdc not found: ID does not exist" Jun 02 15:18:16.752469 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.752440 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-config\") pod \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " Jun 02 15:18:16.752609 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.752484 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-trusted-ca-bundle\") pod \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " Jun 02 15:18:16.752609 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.752511 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-oauth-serving-cert\") pod \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " Jun 02 15:18:16.752609 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.752534 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-serving-cert\") pod \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " Jun 02 15:18:16.752609 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.752594 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-service-ca\") pod \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " Jun 02 15:18:16.752812 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.752614 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-oauth-config\") pod \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " Jun 02 15:18:16.753052 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.753004 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-config" (OuterVolumeSpecName: "console-config") pod "c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766" (UID: "c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:18:16.753052 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.753037 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knw9p\" (UniqueName: \"kubernetes.io/projected/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-kube-api-access-knw9p\") pod \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\" (UID: \"c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766\") " Jun 02 15:18:16.753238 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.753052 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-service-ca" (OuterVolumeSpecName: "service-ca") pod "c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766" (UID: "c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:18:16.753238 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.753169 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766" (UID: "c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:18:16.753439 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.753359 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-service-ca\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:18:16.753439 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.753389 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-config\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:18:16.753439 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.753411 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-oauth-serving-cert\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:18:16.753679 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.753587 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766" (UID: "c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:18:16.755157 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.755133 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766" (UID: "c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:18:16.755260 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.755207 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-kube-api-access-knw9p" (OuterVolumeSpecName: "kube-api-access-knw9p") pod "c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766" (UID: "c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766"). InnerVolumeSpecName "kube-api-access-knw9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:18:16.755260 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.755240 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766" (UID: "c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:18:16.854343 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.854307 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knw9p\" (UniqueName: \"kubernetes.io/projected/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-kube-api-access-knw9p\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:18:16.854343 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.854339 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-trusted-ca-bundle\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:18:16.854575 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.854355 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-serving-cert\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:18:16.854575 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:16.854367 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766-console-oauth-config\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:18:17.039916 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:17.039875 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c9cb96948-j5tsk"] Jun 02 15:18:17.051862 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:17.051834 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c9cb96948-j5tsk"] Jun 02 15:18:18.998634 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:18.998600 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766" path="/var/lib/kubelet/pods/c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766/volumes" Jun 02 15:18:31.257055 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:31.257024 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:18:31.260809 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:31.260789 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-747cbfc887-rlmr8" Jun 02 15:18:34.772487 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:34.772455 2566 generic.go:358] "Generic (PLEG): container finished" podID="a6ae8769-7f7c-4353-886a-51d7a39dee7e" containerID="a88b37ded5592581954c025d6e907a9f4bc672e9164b501b75b64024d9be775b" exitCode=0 Jun 02 15:18:34.772862 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:34.772533 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw" event={"ID":"a6ae8769-7f7c-4353-886a-51d7a39dee7e","Type":"ContainerDied","Data":"a88b37ded5592581954c025d6e907a9f4bc672e9164b501b75b64024d9be775b"} Jun 02 15:18:34.772903 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:34.772882 2566 scope.go:117] "RemoveContainer" containerID="a88b37ded5592581954c025d6e907a9f4bc672e9164b501b75b64024d9be775b" Jun 02 15:18:35.779663 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:35.779629 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sdbsw" event={"ID":"a6ae8769-7f7c-4353-886a-51d7a39dee7e","Type":"ContainerStarted","Data":"8735bfae6f24481567afa59cd09eefdc827581f7f3e371daa92cc6e758ebd12e"} Jun 02 15:18:52.769147 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:52.769098 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs\") pod \"network-metrics-daemon-md8jp\" (UID: \"4814aa17-8f1d-4de5-80a7-f0d823d2c818\") " pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:18:52.771598 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:52.771564 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4814aa17-8f1d-4de5-80a7-f0d823d2c818-metrics-certs\") pod \"network-metrics-daemon-md8jp\" (UID: \"4814aa17-8f1d-4de5-80a7-f0d823d2c818\") " pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:18:52.900041 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:52.900009 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tzzwr\"" Jun 02 15:18:52.908344 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:52.908316 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md8jp" Jun 02 15:18:53.027842 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:53.027814 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:18:53.036101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:53.035982 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-md8jp"] Jun 02 15:18:53.038658 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:18:53.038632 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4814aa17_8f1d_4de5_80a7_f0d823d2c818.slice/crio-9d99909d2c663e6917926ac452da0fc9b9ad29f27637e780fb229e5fcfc9c6d0 WatchSource:0}: Error finding container 9d99909d2c663e6917926ac452da0fc9b9ad29f27637e780fb229e5fcfc9c6d0: Status 404 returned error can't find the container with id 9d99909d2c663e6917926ac452da0fc9b9ad29f27637e780fb229e5fcfc9c6d0 Jun 02 15:18:53.048949 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:53.048928 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:18:53.831238 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:53.831189 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-md8jp" event={"ID":"4814aa17-8f1d-4de5-80a7-f0d823d2c818","Type":"ContainerStarted","Data":"9d99909d2c663e6917926ac452da0fc9b9ad29f27637e780fb229e5fcfc9c6d0"} Jun 02 15:18:53.848961 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:53.848931 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:18:54.835572 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:54.835538 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-md8jp" event={"ID":"4814aa17-8f1d-4de5-80a7-f0d823d2c818","Type":"ContainerStarted","Data":"ad20a0225a4cec73cdb3024f4940c43e9f6e483f8598a39c38790a369a493156"} Jun 02 15:18:54.835572 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:54.835575 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-md8jp" event={"ID":"4814aa17-8f1d-4de5-80a7-f0d823d2c818","Type":"ContainerStarted","Data":"a883a2a1619137c9b0794201658ffe12b8d8dccfbb658e10352daba6659f6c54"} Jun 02 15:18:54.880555 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:18:54.880496 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-md8jp" podStartSLOduration=252.999800987 podStartE2EDuration="4m13.880482061s" podCreationTimestamp="2026-06-02 15:14:41 +0000 UTC" firstStartedPulling="2026-06-02 15:18:53.043290147 +0000 UTC m=+252.628941126" lastFinishedPulling="2026-06-02 15:18:53.923971215 +0000 UTC m=+253.509622200" observedRunningTime="2026-06-02 15:18:54.878351056 +0000 UTC m=+254.464002056" watchObservedRunningTime="2026-06-02 15:18:54.880482061 +0000 UTC m=+254.466133062" Jun 02 15:19:11.234277 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.234239 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:19:11.234795 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.234739 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="prometheus" containerID="cri-o://b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f" gracePeriod=600 Jun 02 15:19:11.234795 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.234748 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="kube-rbac-proxy" containerID="cri-o://156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022" gracePeriod=600 Jun 02 15:19:11.234891 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.234806 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="kube-rbac-proxy-thanos" containerID="cri-o://afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7" gracePeriod=600 Jun 02 15:19:11.234934 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.234922 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="kube-rbac-proxy-web" containerID="cri-o://f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598" gracePeriod=600 Jun 02 15:19:11.234981 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.234904 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="thanos-sidecar" containerID="cri-o://aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23" gracePeriod=600 Jun 02 15:19:11.234981 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.234938 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="config-reloader" containerID="cri-o://e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050" gracePeriod=600 Jun 02 15:19:11.481846 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.481822 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:11.629758 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.629727 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.629949 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.629773 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-tls\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.629949 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.629791 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.629949 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.629821 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-k8s-rulefiles-0\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.629949 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.629837 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-metrics-client-certs\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.629949 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.629874 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-trusted-ca-bundle\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.629949 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.629902 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da86b467-4cab-436c-b8b0-0e02e7528b48-config-out\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.629949 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.629928 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-web-config\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.630292 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.629967 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-metrics-client-ca\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.630292 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.630002 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-serving-certs-ca-bundle\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.630292 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.630033 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-grpc-tls\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.630292 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.630058 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nz7ll\" (UniqueName: \"kubernetes.io/projected/da86b467-4cab-436c-b8b0-0e02e7528b48-kube-api-access-nz7ll\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.630292 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.630088 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-kubelet-serving-ca-bundle\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.630292 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.630125 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-k8s-db\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.630292 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.630155 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-thanos-prometheus-http-client-file\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.630292 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.630213 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da86b467-4cab-436c-b8b0-0e02e7528b48-tls-assets\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.630292 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.630238 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-config\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.630292 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.630283 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-kube-rbac-proxy\") pod \"da86b467-4cab-436c-b8b0-0e02e7528b48\" (UID: \"da86b467-4cab-436c-b8b0-0e02e7528b48\") " Jun 02 15:19:11.630820 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.630609 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:19:11.631239 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.631203 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:19:11.632008 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.631975 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:19:11.633227 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.633194 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:19:11.633311 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.633260 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:19:11.633831 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.633805 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:19:11.634137 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.634021 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:19:11.634451 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.634410 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:19:11.634654 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.634587 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da86b467-4cab-436c-b8b0-0e02e7528b48-config-out" (OuterVolumeSpecName: "config-out") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:19:11.634654 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.634610 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:19:11.634885 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.634650 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-config" (OuterVolumeSpecName: "config") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:19:11.634885 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.634667 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:19:11.634885 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.634681 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da86b467-4cab-436c-b8b0-0e02e7528b48-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:19:11.634885 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.634681 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:19:11.635145 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.635028 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:19:11.635202 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.635157 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da86b467-4cab-436c-b8b0-0e02e7528b48-kube-api-access-nz7ll" (OuterVolumeSpecName: "kube-api-access-nz7ll") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "kube-api-access-nz7ll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:19:11.636127 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.636105 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:19:11.646602 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.646580 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-web-config" (OuterVolumeSpecName: "web-config") pod "da86b467-4cab-436c-b8b0-0e02e7528b48" (UID: "da86b467-4cab-436c-b8b0-0e02e7528b48"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:19:11.731086 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731058 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-metrics-client-ca\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.731086 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731084 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.731256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731095 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-grpc-tls\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.731256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731105 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz7ll\" (UniqueName: \"kubernetes.io/projected/da86b467-4cab-436c-b8b0-0e02e7528b48-kube-api-access-nz7ll\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.731256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731117 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.731256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731127 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-k8s-db\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.731256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731135 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.731256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731144 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da86b467-4cab-436c-b8b0-0e02e7528b48-tls-assets\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.731256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731153 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-config\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.731256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731161 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-kube-rbac-proxy\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.731256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731170 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.731256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731178 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.731256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731190 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.731256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731199 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.731256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731207 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-secret-metrics-client-certs\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.731256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731217 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da86b467-4cab-436c-b8b0-0e02e7528b48-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.731256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731225 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da86b467-4cab-436c-b8b0-0e02e7528b48-config-out\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.731256 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.731233 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da86b467-4cab-436c-b8b0-0e02e7528b48-web-config\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:19:11.888405 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.888314 2566 generic.go:358] "Generic (PLEG): container finished" podID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerID="afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7" exitCode=0 Jun 02 15:19:11.888405 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.888345 2566 generic.go:358] "Generic (PLEG): container finished" podID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerID="156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022" exitCode=0 Jun 02 15:19:11.888405 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.888354 2566 generic.go:358] "Generic (PLEG): container finished" podID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerID="f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598" exitCode=0 Jun 02 15:19:11.888405 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.888361 2566 generic.go:358] "Generic (PLEG): container finished" podID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerID="aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23" exitCode=0 Jun 02 15:19:11.888405 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.888368 2566 generic.go:358] "Generic (PLEG): container finished" podID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerID="e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050" exitCode=0 Jun 02 15:19:11.888405 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.888375 2566 generic.go:358] "Generic (PLEG): container finished" podID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerID="b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f" exitCode=0 Jun 02 15:19:11.888727 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.888402 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da86b467-4cab-436c-b8b0-0e02e7528b48","Type":"ContainerDied","Data":"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7"} Jun 02 15:19:11.888727 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.888438 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:11.888727 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.888452 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da86b467-4cab-436c-b8b0-0e02e7528b48","Type":"ContainerDied","Data":"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022"} Jun 02 15:19:11.888727 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.888465 2566 scope.go:117] "RemoveContainer" containerID="afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7" Jun 02 15:19:11.888727 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.888465 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da86b467-4cab-436c-b8b0-0e02e7528b48","Type":"ContainerDied","Data":"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598"} Jun 02 15:19:11.888727 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.888556 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da86b467-4cab-436c-b8b0-0e02e7528b48","Type":"ContainerDied","Data":"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23"} Jun 02 15:19:11.888727 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.888574 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da86b467-4cab-436c-b8b0-0e02e7528b48","Type":"ContainerDied","Data":"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050"} Jun 02 15:19:11.888727 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.888590 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da86b467-4cab-436c-b8b0-0e02e7528b48","Type":"ContainerDied","Data":"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f"} Jun 02 15:19:11.888727 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.888605 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da86b467-4cab-436c-b8b0-0e02e7528b48","Type":"ContainerDied","Data":"5cff13376fe301ced9db458fa5111041af1f16ea573f8a5bc8b72521bc7a3273"} Jun 02 15:19:11.898823 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.898800 2566 scope.go:117] "RemoveContainer" containerID="156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022" Jun 02 15:19:11.906340 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.906316 2566 scope.go:117] "RemoveContainer" containerID="f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598" Jun 02 15:19:11.915968 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.915949 2566 scope.go:117] "RemoveContainer" containerID="aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23" Jun 02 15:19:11.921339 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.921314 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:19:11.923602 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.923581 2566 scope.go:117] "RemoveContainer" containerID="e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050" Jun 02 15:19:11.924780 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.924758 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:19:11.930364 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.930342 2566 scope.go:117] "RemoveContainer" containerID="b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f" Jun 02 15:19:11.937471 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.937440 2566 scope.go:117] "RemoveContainer" containerID="bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1" Jun 02 15:19:11.944093 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.944076 2566 scope.go:117] "RemoveContainer" containerID="afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7" Jun 02 15:19:11.944334 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:19:11.944316 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7\": container with ID starting with afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7 not found: ID does not exist" containerID="afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7" Jun 02 15:19:11.944393 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.944343 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7"} err="failed to get container status \"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7\": rpc error: code = NotFound desc = could not find container \"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7\": container with ID starting with afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7 not found: ID does not exist" Jun 02 15:19:11.944393 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.944362 2566 scope.go:117] "RemoveContainer" containerID="156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022" Jun 02 15:19:11.944608 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:19:11.944590 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022\": container with ID starting with 156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022 not found: ID does not exist" containerID="156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022" Jun 02 15:19:11.944678 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.944617 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022"} err="failed to get container status \"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022\": rpc error: code = NotFound desc = could not find container \"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022\": container with ID starting with 156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022 not found: ID does not exist" Jun 02 15:19:11.944678 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.944641 2566 scope.go:117] "RemoveContainer" containerID="f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598" Jun 02 15:19:11.944927 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:19:11.944908 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598\": container with ID starting with f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598 not found: ID does not exist" containerID="f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598" Jun 02 15:19:11.944983 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.944933 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598"} err="failed to get container status \"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598\": rpc error: code = NotFound desc = could not find container \"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598\": container with ID starting with f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598 not found: ID does not exist" Jun 02 15:19:11.944983 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.944949 2566 scope.go:117] "RemoveContainer" containerID="aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23" Jun 02 15:19:11.945180 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:19:11.945164 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23\": container with ID starting with aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23 not found: ID does not exist" containerID="aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23" Jun 02 15:19:11.945239 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.945187 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23"} err="failed to get container status \"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23\": rpc error: code = NotFound desc = could not find container \"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23\": container with ID starting with aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23 not found: ID does not exist" Jun 02 15:19:11.945239 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.945207 2566 scope.go:117] "RemoveContainer" containerID="e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050" Jun 02 15:19:11.945426 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:19:11.945410 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050\": container with ID starting with e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050 not found: ID does not exist" containerID="e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050" Jun 02 15:19:11.945463 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.945430 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050"} err="failed to get container status \"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050\": rpc error: code = NotFound desc = could not find container \"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050\": container with ID starting with e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050 not found: ID does not exist" Jun 02 15:19:11.945463 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.945447 2566 scope.go:117] "RemoveContainer" containerID="b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f" Jun 02 15:19:11.945654 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:19:11.945637 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f\": container with ID starting with b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f not found: ID does not exist" containerID="b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f" Jun 02 15:19:11.945771 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.945659 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f"} err="failed to get container status \"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f\": rpc error: code = NotFound desc = could not find container \"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f\": container with ID starting with b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f not found: ID does not exist" Jun 02 15:19:11.945771 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.945674 2566 scope.go:117] "RemoveContainer" containerID="bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1" Jun 02 15:19:11.945912 ip-10-0-128-172 kubenswrapper[2566]: E0602 15:19:11.945896 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1\": container with ID starting with bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1 not found: ID does not exist" containerID="bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1" Jun 02 15:19:11.945968 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.945919 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1"} err="failed to get container status \"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1\": rpc error: code = NotFound desc = could not find container \"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1\": container with ID starting with bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1 not found: ID does not exist" Jun 02 15:19:11.945968 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.945939 2566 scope.go:117] "RemoveContainer" containerID="afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7" Jun 02 15:19:11.946162 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.946145 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7"} err="failed to get container status \"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7\": rpc error: code = NotFound desc = could not find container \"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7\": container with ID starting with afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7 not found: ID does not exist" Jun 02 15:19:11.946207 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.946162 2566 scope.go:117] "RemoveContainer" containerID="156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022" Jun 02 15:19:11.946388 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.946371 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022"} err="failed to get container status \"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022\": rpc error: code = NotFound desc = could not find container \"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022\": container with ID starting with 156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022 not found: ID does not exist" Jun 02 15:19:11.946442 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.946389 2566 scope.go:117] "RemoveContainer" containerID="f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598" Jun 02 15:19:11.946610 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.946594 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598"} err="failed to get container status \"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598\": rpc error: code = NotFound desc = could not find container \"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598\": container with ID starting with f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598 not found: ID does not exist" Jun 02 15:19:11.946654 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.946611 2566 scope.go:117] "RemoveContainer" containerID="aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23" Jun 02 15:19:11.946845 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.946824 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23"} err="failed to get container status \"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23\": rpc error: code = NotFound desc = could not find container \"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23\": container with ID starting with aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23 not found: ID does not exist" Jun 02 15:19:11.946900 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.946846 2566 scope.go:117] "RemoveContainer" containerID="e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050" Jun 02 15:19:11.947032 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.947013 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050"} err="failed to get container status \"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050\": rpc error: code = NotFound desc = could not find container \"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050\": container with ID starting with e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050 not found: ID does not exist" Jun 02 15:19:11.947073 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.947034 2566 scope.go:117] "RemoveContainer" containerID="b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f" Jun 02 15:19:11.947228 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.947209 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f"} err="failed to get container status \"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f\": rpc error: code = NotFound desc = could not find container \"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f\": container with ID starting with b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f not found: ID does not exist" Jun 02 15:19:11.947271 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.947229 2566 scope.go:117] "RemoveContainer" containerID="bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1" Jun 02 15:19:11.947439 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.947423 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1"} err="failed to get container status \"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1\": rpc error: code = NotFound desc = could not find container \"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1\": container with ID starting with bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1 not found: ID does not exist" Jun 02 15:19:11.947476 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.947440 2566 scope.go:117] "RemoveContainer" containerID="afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7" Jun 02 15:19:11.947626 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.947609 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7"} err="failed to get container status \"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7\": rpc error: code = NotFound desc = could not find container \"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7\": container with ID starting with afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7 not found: ID does not exist" Jun 02 15:19:11.947691 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.947628 2566 scope.go:117] "RemoveContainer" containerID="156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022" Jun 02 15:19:11.947837 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.947819 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022"} err="failed to get container status \"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022\": rpc error: code = NotFound desc = could not find container \"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022\": container with ID starting with 156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022 not found: ID does not exist" Jun 02 15:19:11.947887 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.947838 2566 scope.go:117] "RemoveContainer" containerID="f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598" Jun 02 15:19:11.948023 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.948007 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598"} err="failed to get container status \"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598\": rpc error: code = NotFound desc = could not find container \"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598\": container with ID starting with f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598 not found: ID does not exist" Jun 02 15:19:11.948141 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.948023 2566 scope.go:117] "RemoveContainer" containerID="aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23" Jun 02 15:19:11.948200 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.948185 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23"} err="failed to get container status \"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23\": rpc error: code = NotFound desc = could not find container \"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23\": container with ID starting with aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23 not found: ID does not exist" Jun 02 15:19:11.948235 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.948201 2566 scope.go:117] "RemoveContainer" containerID="e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050" Jun 02 15:19:11.948405 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.948388 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050"} err="failed to get container status \"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050\": rpc error: code = NotFound desc = could not find container \"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050\": container with ID starting with e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050 not found: ID does not exist" Jun 02 15:19:11.948453 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.948405 2566 scope.go:117] "RemoveContainer" containerID="b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f" Jun 02 15:19:11.948608 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.948591 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f"} err="failed to get container status \"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f\": rpc error: code = NotFound desc = could not find container \"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f\": container with ID starting with b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f not found: ID does not exist" Jun 02 15:19:11.948648 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.948609 2566 scope.go:117] "RemoveContainer" containerID="bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1" Jun 02 15:19:11.948878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.948856 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1"} err="failed to get container status \"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1\": rpc error: code = NotFound desc = could not find container \"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1\": container with ID starting with bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1 not found: ID does not exist" Jun 02 15:19:11.948878 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.948875 2566 scope.go:117] "RemoveContainer" containerID="afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7" Jun 02 15:19:11.949073 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.949055 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7"} err="failed to get container status \"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7\": rpc error: code = NotFound desc = could not find container \"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7\": container with ID starting with afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7 not found: ID does not exist" Jun 02 15:19:11.949119 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.949074 2566 scope.go:117] "RemoveContainer" containerID="156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022" Jun 02 15:19:11.949432 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.949417 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022"} err="failed to get container status \"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022\": rpc error: code = NotFound desc = could not find container \"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022\": container with ID starting with 156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022 not found: ID does not exist" Jun 02 15:19:11.949469 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.949432 2566 scope.go:117] "RemoveContainer" containerID="f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598" Jun 02 15:19:11.949655 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.949635 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598"} err="failed to get container status \"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598\": rpc error: code = NotFound desc = could not find container \"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598\": container with ID starting with f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598 not found: ID does not exist" Jun 02 15:19:11.949738 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.949656 2566 scope.go:117] "RemoveContainer" containerID="aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23" Jun 02 15:19:11.949897 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.949880 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23"} err="failed to get container status \"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23\": rpc error: code = NotFound desc = could not find container \"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23\": container with ID starting with aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23 not found: ID does not exist" Jun 02 15:19:11.949955 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.949898 2566 scope.go:117] "RemoveContainer" containerID="e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050" Jun 02 15:19:11.950109 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.950079 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050"} err="failed to get container status \"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050\": rpc error: code = NotFound desc = could not find container \"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050\": container with ID starting with e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050 not found: ID does not exist" Jun 02 15:19:11.950176 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.950112 2566 scope.go:117] "RemoveContainer" containerID="b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f" Jun 02 15:19:11.950335 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.950317 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f"} err="failed to get container status \"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f\": rpc error: code = NotFound desc = could not find container \"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f\": container with ID starting with b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f not found: ID does not exist" Jun 02 15:19:11.950421 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.950338 2566 scope.go:117] "RemoveContainer" containerID="bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1" Jun 02 15:19:11.950547 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.950531 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1"} err="failed to get container status \"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1\": rpc error: code = NotFound desc = could not find container \"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1\": container with ID starting with bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1 not found: ID does not exist" Jun 02 15:19:11.950594 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.950547 2566 scope.go:117] "RemoveContainer" containerID="afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7" Jun 02 15:19:11.950769 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.950753 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7"} err="failed to get container status \"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7\": rpc error: code = NotFound desc = could not find container \"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7\": container with ID starting with afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7 not found: ID does not exist" Jun 02 15:19:11.950826 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.950770 2566 scope.go:117] "RemoveContainer" containerID="156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022" Jun 02 15:19:11.950984 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.950969 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022"} err="failed to get container status \"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022\": rpc error: code = NotFound desc = could not find container \"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022\": container with ID starting with 156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022 not found: ID does not exist" Jun 02 15:19:11.950984 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.950983 2566 scope.go:117] "RemoveContainer" containerID="f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598" Jun 02 15:19:11.951164 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.951144 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598"} err="failed to get container status \"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598\": rpc error: code = NotFound desc = could not find container \"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598\": container with ID starting with f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598 not found: ID does not exist" Jun 02 15:19:11.951224 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.951166 2566 scope.go:117] "RemoveContainer" containerID="aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23" Jun 02 15:19:11.951366 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.951351 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23"} err="failed to get container status \"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23\": rpc error: code = NotFound desc = could not find container \"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23\": container with ID starting with aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23 not found: ID does not exist" Jun 02 15:19:11.951405 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.951366 2566 scope.go:117] "RemoveContainer" containerID="e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050" Jun 02 15:19:11.951552 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.951537 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050"} err="failed to get container status \"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050\": rpc error: code = NotFound desc = could not find container \"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050\": container with ID starting with e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050 not found: ID does not exist" Jun 02 15:19:11.951592 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.951552 2566 scope.go:117] "RemoveContainer" containerID="b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f" Jun 02 15:19:11.951741 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.951725 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f"} err="failed to get container status \"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f\": rpc error: code = NotFound desc = could not find container \"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f\": container with ID starting with b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f not found: ID does not exist" Jun 02 15:19:11.951741 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.951740 2566 scope.go:117] "RemoveContainer" containerID="bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1" Jun 02 15:19:11.951899 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.951885 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1"} err="failed to get container status \"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1\": rpc error: code = NotFound desc = could not find container \"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1\": container with ID starting with bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1 not found: ID does not exist" Jun 02 15:19:11.951941 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.951899 2566 scope.go:117] "RemoveContainer" containerID="afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7" Jun 02 15:19:11.952053 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.952031 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7"} err="failed to get container status \"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7\": rpc error: code = NotFound desc = could not find container \"afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7\": container with ID starting with afa5f510a827ab62d5ddd05926e939a5fa28133876b49b9f2de73b3e588a93d7 not found: ID does not exist" Jun 02 15:19:11.952156 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.952054 2566 scope.go:117] "RemoveContainer" containerID="156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022" Jun 02 15:19:11.952316 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.952283 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022"} err="failed to get container status \"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022\": rpc error: code = NotFound desc = could not find container \"156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022\": container with ID starting with 156b8411e5ff34cd43bfbaa0e7e2ec0ff4618d77682606e9e0506e9ec910b022 not found: ID does not exist" Jun 02 15:19:11.952492 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.952318 2566 scope.go:117] "RemoveContainer" containerID="f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598" Jun 02 15:19:11.952676 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.952604 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598"} err="failed to get container status \"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598\": rpc error: code = NotFound desc = could not find container \"f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598\": container with ID starting with f2c97c20a718f7c97c1d45994d4d5d74e41bab9b8744b9d64cb01956d19e6598 not found: ID does not exist" Jun 02 15:19:11.952676 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.952642 2566 scope.go:117] "RemoveContainer" containerID="aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23" Jun 02 15:19:11.952927 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.952884 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23"} err="failed to get container status \"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23\": rpc error: code = NotFound desc = could not find container \"aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23\": container with ID starting with aee37e2d4ed374980775ebf5c0dda5e101cf26fd591872db639893190ae6fb23 not found: ID does not exist" Jun 02 15:19:11.952927 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.952910 2566 scope.go:117] "RemoveContainer" containerID="e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050" Jun 02 15:19:11.953139 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.953120 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050"} err="failed to get container status \"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050\": rpc error: code = NotFound desc = could not find container \"e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050\": container with ID starting with e87c7eb5b0998caa981e0b6100146f5e6b71327a9bc87728ac9559ff92370050 not found: ID does not exist" Jun 02 15:19:11.953139 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.953139 2566 scope.go:117] "RemoveContainer" containerID="b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f" Jun 02 15:19:11.953505 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.953474 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f"} err="failed to get container status \"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f\": rpc error: code = NotFound desc = could not find container \"b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f\": container with ID starting with b7768c85ae63d817fafd751e476f70d701defe3ad37bb9f88cd766dcfd58f62f not found: ID does not exist" Jun 02 15:19:11.953505 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.953504 2566 scope.go:117] "RemoveContainer" containerID="bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1" Jun 02 15:19:11.953765 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.953747 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1"} err="failed to get container status \"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1\": rpc error: code = NotFound desc = could not find container \"bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1\": container with ID starting with bb159d2157fe69e0232ece55af2dd2839f2331fe2153d764cac4e403055010f1 not found: ID does not exist" Jun 02 15:19:11.954639 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.954619 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:19:11.954997 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.954981 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="prometheus" Jun 02 15:19:11.955066 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955000 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="prometheus" Jun 02 15:19:11.955066 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955009 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="kube-rbac-proxy-thanos" Jun 02 15:19:11.955066 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955017 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="kube-rbac-proxy-thanos" Jun 02 15:19:11.955066 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955044 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="init-config-reloader" Jun 02 15:19:11.955066 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955053 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="init-config-reloader" Jun 02 15:19:11.955066 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955062 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766" containerName="console" Jun 02 15:19:11.955390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955070 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766" containerName="console" Jun 02 15:19:11.955390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955083 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="kube-rbac-proxy-web" Jun 02 15:19:11.955390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955092 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="kube-rbac-proxy-web" Jun 02 15:19:11.955390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955102 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="config-reloader" Jun 02 15:19:11.955390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955110 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="config-reloader" Jun 02 15:19:11.955390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955120 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="kube-rbac-proxy" Jun 02 15:19:11.955390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955128 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="kube-rbac-proxy" Jun 02 15:19:11.955390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955139 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="thanos-sidecar" Jun 02 15:19:11.955390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955148 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="thanos-sidecar" Jun 02 15:19:11.955390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955222 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="kube-rbac-proxy" Jun 02 15:19:11.955390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955236 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="prometheus" Jun 02 15:19:11.955390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955247 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="kube-rbac-proxy-thanos" Jun 02 15:19:11.955390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955259 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="c83ecbed-7aa0-4ba3-bdf2-bd5df31d7766" containerName="console" Jun 02 15:19:11.955390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955269 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="config-reloader" Jun 02 15:19:11.955390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955276 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="kube-rbac-proxy-web" Jun 02 15:19:11.955390 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.955287 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" containerName="thanos-sidecar" Jun 02 15:19:11.959200 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.959181 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:11.962659 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.962479 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 15:19:11.962780 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.962672 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 15:19:11.962926 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.962890 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 15:19:11.963184 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.963161 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 15:19:11.963687 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.963514 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 15:19:11.963687 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.963561 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 15:19:11.963687 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.963569 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 15:19:11.963687 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.963582 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 15:19:11.963687 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.963585 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 15:19:11.963687 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.963571 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 15:19:11.964101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.963753 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-evgr788799618\"" Jun 02 15:19:11.964101 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.964058 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8nf6g\"" Jun 02 15:19:11.967886 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.967862 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 15:19:11.970780 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.970762 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 15:19:11.974468 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:11.974450 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:19:12.134641 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.134604 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/17876af6-d1e2-4f88-866c-4ddec1e40787-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.134641 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.134642 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxpmn\" (UniqueName: \"kubernetes.io/projected/17876af6-d1e2-4f88-866c-4ddec1e40787-kube-api-access-rxpmn\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.134916 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.134682 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.134916 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.134753 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17876af6-d1e2-4f88-866c-4ddec1e40787-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.134916 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.134789 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.134916 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.134839 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17876af6-d1e2-4f88-866c-4ddec1e40787-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.134916 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.134889 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/17876af6-d1e2-4f88-866c-4ddec1e40787-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.134916 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.134917 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.135189 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.134943 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.135189 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.134973 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17876af6-d1e2-4f88-866c-4ddec1e40787-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.135189 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.134995 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/17876af6-d1e2-4f88-866c-4ddec1e40787-config-out\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.135189 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.135017 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-config\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.135189 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.135055 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-web-config\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.135189 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.135072 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.135189 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.135098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.135189 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.135119 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17876af6-d1e2-4f88-866c-4ddec1e40787-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.135189 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.135154 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.135189 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.135184 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/17876af6-d1e2-4f88-866c-4ddec1e40787-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236395 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236317 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-web-config\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236395 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236350 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236395 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236373 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236406 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17876af6-d1e2-4f88-866c-4ddec1e40787-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236433 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236464 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/17876af6-d1e2-4f88-866c-4ddec1e40787-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236497 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/17876af6-d1e2-4f88-866c-4ddec1e40787-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236523 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxpmn\" (UniqueName: \"kubernetes.io/projected/17876af6-d1e2-4f88-866c-4ddec1e40787-kube-api-access-rxpmn\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236556 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236582 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17876af6-d1e2-4f88-866c-4ddec1e40787-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236605 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236642 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17876af6-d1e2-4f88-866c-4ddec1e40787-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236672 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/17876af6-d1e2-4f88-866c-4ddec1e40787-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236695 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236743 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236787 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17876af6-d1e2-4f88-866c-4ddec1e40787-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236818 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/17876af6-d1e2-4f88-866c-4ddec1e40787-config-out\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236845 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-config\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.236965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.236913 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/17876af6-d1e2-4f88-866c-4ddec1e40787-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.237965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.237508 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17876af6-d1e2-4f88-866c-4ddec1e40787-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.237965 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.237822 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17876af6-d1e2-4f88-866c-4ddec1e40787-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.239036 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.238885 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17876af6-d1e2-4f88-866c-4ddec1e40787-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.239970 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.239365 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.239970 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.239393 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.239970 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.239455 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.239970 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.239660 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-web-config\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.240454 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.240339 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.240551 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.240390 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17876af6-d1e2-4f88-866c-4ddec1e40787-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.240843 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.240824 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-config\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.241641 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.241620 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/17876af6-d1e2-4f88-866c-4ddec1e40787-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.242070 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.242050 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.242202 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.242183 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.242406 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.242385 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/17876af6-d1e2-4f88-866c-4ddec1e40787-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.242488 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.242455 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/17876af6-d1e2-4f88-866c-4ddec1e40787-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.243339 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.243324 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/17876af6-d1e2-4f88-866c-4ddec1e40787-config-out\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.248253 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.248234 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxpmn\" (UniqueName: \"kubernetes.io/projected/17876af6-d1e2-4f88-866c-4ddec1e40787-kube-api-access-rxpmn\") pod \"prometheus-k8s-0\" (UID: \"17876af6-d1e2-4f88-866c-4ddec1e40787\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.270330 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.270311 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:12.408732 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.408690 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:19:12.410611 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:19:12.410582 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17876af6_d1e2_4f88_866c_4ddec1e40787.slice/crio-224a130efc484cd23c2a3a94352887a79cdfa88960ebf72f8dd48b20db652469 WatchSource:0}: Error finding container 224a130efc484cd23c2a3a94352887a79cdfa88960ebf72f8dd48b20db652469: Status 404 returned error can't find the container with id 224a130efc484cd23c2a3a94352887a79cdfa88960ebf72f8dd48b20db652469 Jun 02 15:19:12.892546 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.892516 2566 generic.go:358] "Generic (PLEG): container finished" podID="17876af6-d1e2-4f88-866c-4ddec1e40787" containerID="37fc4c671e71ccb5bd19c98fefc817d87f98466cbb9f712d4929b3c70f209c38" exitCode=0 Jun 02 15:19:12.892742 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.892610 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"17876af6-d1e2-4f88-866c-4ddec1e40787","Type":"ContainerDied","Data":"37fc4c671e71ccb5bd19c98fefc817d87f98466cbb9f712d4929b3c70f209c38"} Jun 02 15:19:12.892742 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.892646 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"17876af6-d1e2-4f88-866c-4ddec1e40787","Type":"ContainerStarted","Data":"224a130efc484cd23c2a3a94352887a79cdfa88960ebf72f8dd48b20db652469"} Jun 02 15:19:12.999517 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:12.999481 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da86b467-4cab-436c-b8b0-0e02e7528b48" path="/var/lib/kubelet/pods/da86b467-4cab-436c-b8b0-0e02e7528b48/volumes" Jun 02 15:19:13.898934 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:13.898900 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"17876af6-d1e2-4f88-866c-4ddec1e40787","Type":"ContainerStarted","Data":"10f99692e50540088959cd9b209c654c656fedcdc72523295452be7d39ffef05"} Jun 02 15:19:13.898934 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:13.898938 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"17876af6-d1e2-4f88-866c-4ddec1e40787","Type":"ContainerStarted","Data":"b5843fe923a7e68ca9cb47bbec9db383191daf93700dfbb420eed19cddda66b4"} Jun 02 15:19:13.899344 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:13.898948 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"17876af6-d1e2-4f88-866c-4ddec1e40787","Type":"ContainerStarted","Data":"04f8b50d9d5269113caad7b1e75ce0703a6b360a03aa39c3455e7efde626f9fc"} Jun 02 15:19:13.899344 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:13.898957 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"17876af6-d1e2-4f88-866c-4ddec1e40787","Type":"ContainerStarted","Data":"733a1c41c86218d6f4bd2e54af39f41d294830c21fdf07dfc53e5e4612f9ac88"} Jun 02 15:19:13.899344 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:13.898965 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"17876af6-d1e2-4f88-866c-4ddec1e40787","Type":"ContainerStarted","Data":"08fae98043ee03a8df03d28d490a4ed3f78a70450ac83b479e33df68f5ac19d1"} Jun 02 15:19:13.899344 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:13.898973 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"17876af6-d1e2-4f88-866c-4ddec1e40787","Type":"ContainerStarted","Data":"00bd675fc802f4edb018a475d5259206a50a0ea8ba9262e44473415f49d4f21c"} Jun 02 15:19:13.934953 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:13.934901 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.9348814770000002 podStartE2EDuration="2.934881477s" podCreationTimestamp="2026-06-02 15:19:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:19:13.932862468 +0000 UTC m=+273.518513469" watchObservedRunningTime="2026-06-02 15:19:13.934881477 +0000 UTC m=+273.520532479" Jun 02 15:19:17.271280 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:17.271245 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:19:40.886182 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:40.886156 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/ovn-acl-logging/0.log" Jun 02 15:19:40.887768 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:40.887742 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/ovn-acl-logging/0.log" Jun 02 15:19:40.893257 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:19:40.893238 2566 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 15:20:12.271181 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:20:12.271142 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:20:12.287294 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:20:12.287265 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:20:13.087933 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:20:13.087904 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:22:14.220566 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:14.220532 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kb7hs"] Jun 02 15:22:14.223076 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:14.223059 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-kb7hs" Jun 02 15:22:14.231959 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:14.231939 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 15:22:14.236076 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:14.236057 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-xhvk9\"" Jun 02 15:22:14.237243 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:14.237227 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 15:22:14.243487 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:14.243465 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kb7hs"] Jun 02 15:22:14.348615 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:14.348587 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1adc4d0b-1acf-4867-9794-d826eac5e231-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kb7hs\" (UID: \"1adc4d0b-1acf-4867-9794-d826eac5e231\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kb7hs" Jun 02 15:22:14.348814 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:14.348647 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh2xh\" (UniqueName: \"kubernetes.io/projected/1adc4d0b-1acf-4867-9794-d826eac5e231-kube-api-access-gh2xh\") pod \"cert-manager-cainjector-68b757865b-kb7hs\" (UID: \"1adc4d0b-1acf-4867-9794-d826eac5e231\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kb7hs" Jun 02 15:22:14.449161 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:14.449123 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gh2xh\" (UniqueName: \"kubernetes.io/projected/1adc4d0b-1acf-4867-9794-d826eac5e231-kube-api-access-gh2xh\") pod \"cert-manager-cainjector-68b757865b-kb7hs\" (UID: \"1adc4d0b-1acf-4867-9794-d826eac5e231\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kb7hs" Jun 02 15:22:14.449331 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:14.449226 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1adc4d0b-1acf-4867-9794-d826eac5e231-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kb7hs\" (UID: \"1adc4d0b-1acf-4867-9794-d826eac5e231\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kb7hs" Jun 02 15:22:14.513744 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:14.513655 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1adc4d0b-1acf-4867-9794-d826eac5e231-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-kb7hs\" (UID: \"1adc4d0b-1acf-4867-9794-d826eac5e231\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kb7hs" Jun 02 15:22:14.513875 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:14.513800 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh2xh\" (UniqueName: \"kubernetes.io/projected/1adc4d0b-1acf-4867-9794-d826eac5e231-kube-api-access-gh2xh\") pod \"cert-manager-cainjector-68b757865b-kb7hs\" (UID: \"1adc4d0b-1acf-4867-9794-d826eac5e231\") " pod="cert-manager/cert-manager-cainjector-68b757865b-kb7hs" Jun 02 15:22:14.543649 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:14.543620 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-kb7hs" Jun 02 15:22:14.694459 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:14.694422 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-kb7hs"] Jun 02 15:22:14.697247 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:22:14.697217 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1adc4d0b_1acf_4867_9794_d826eac5e231.slice/crio-c4c24d22b24476e35dadf45c6aa70b3039362fdfeaa685df39f285de69afb4da WatchSource:0}: Error finding container c4c24d22b24476e35dadf45c6aa70b3039362fdfeaa685df39f285de69afb4da: Status 404 returned error can't find the container with id c4c24d22b24476e35dadf45c6aa70b3039362fdfeaa685df39f285de69afb4da Jun 02 15:22:14.699418 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:14.699402 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:22:15.438136 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:15.438083 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-kb7hs" event={"ID":"1adc4d0b-1acf-4867-9794-d826eac5e231","Type":"ContainerStarted","Data":"c4c24d22b24476e35dadf45c6aa70b3039362fdfeaa685df39f285de69afb4da"} Jun 02 15:22:18.449210 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:18.449123 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-kb7hs" event={"ID":"1adc4d0b-1acf-4867-9794-d826eac5e231","Type":"ContainerStarted","Data":"92fa45ddfd31ce3c8db194dab7b7767a8bc4f29e6b2a1ea3dd3808324708c3ec"} Jun 02 15:22:18.470906 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:22:18.470862 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-kb7hs" podStartSLOduration=1.027658291 podStartE2EDuration="4.47084754s" podCreationTimestamp="2026-06-02 15:22:14 +0000 UTC" firstStartedPulling="2026-06-02 15:22:14.699532445 +0000 UTC m=+454.285183423" lastFinishedPulling="2026-06-02 15:22:18.142721693 +0000 UTC m=+457.728372672" observedRunningTime="2026-06-02 15:22:18.468862669 +0000 UTC m=+458.054513667" watchObservedRunningTime="2026-06-02 15:22:18.47084754 +0000 UTC m=+458.056498540" Jun 02 15:23:10.664886 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.664844 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq"] Jun 02 15:23:10.667226 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.667205 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq" Jun 02 15:23:10.670151 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.670133 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 15:23:10.670835 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.670813 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jun 02 15:23:10.670928 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.670875 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jun 02 15:23:10.671370 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.671343 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 15:23:10.672074 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.672059 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-kvfsq\"" Jun 02 15:23:10.678363 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.678342 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq"] Jun 02 15:23:10.710962 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.710920 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/f21e416d-0b97-48cf-87dd-e0bb81540b84-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-cf9549bc5-6k9xq\" (UID: \"f21e416d-0b97-48cf-87dd-e0bb81540b84\") " pod="opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq" Jun 02 15:23:10.711154 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.710974 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f21e416d-0b97-48cf-87dd-e0bb81540b84-cert\") pod \"kubeflow-trainer-controller-manager-cf9549bc5-6k9xq\" (UID: \"f21e416d-0b97-48cf-87dd-e0bb81540b84\") " pod="opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq" Jun 02 15:23:10.711154 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.710997 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k5hr\" (UniqueName: \"kubernetes.io/projected/f21e416d-0b97-48cf-87dd-e0bb81540b84-kube-api-access-9k5hr\") pod \"kubeflow-trainer-controller-manager-cf9549bc5-6k9xq\" (UID: \"f21e416d-0b97-48cf-87dd-e0bb81540b84\") " pod="opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq" Jun 02 15:23:10.811886 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.811853 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/f21e416d-0b97-48cf-87dd-e0bb81540b84-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-cf9549bc5-6k9xq\" (UID: \"f21e416d-0b97-48cf-87dd-e0bb81540b84\") " pod="opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq" Jun 02 15:23:10.812069 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.811907 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f21e416d-0b97-48cf-87dd-e0bb81540b84-cert\") pod \"kubeflow-trainer-controller-manager-cf9549bc5-6k9xq\" (UID: \"f21e416d-0b97-48cf-87dd-e0bb81540b84\") " pod="opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq" Jun 02 15:23:10.812069 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.811928 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9k5hr\" (UniqueName: \"kubernetes.io/projected/f21e416d-0b97-48cf-87dd-e0bb81540b84-kube-api-access-9k5hr\") pod \"kubeflow-trainer-controller-manager-cf9549bc5-6k9xq\" (UID: \"f21e416d-0b97-48cf-87dd-e0bb81540b84\") " pod="opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq" Jun 02 15:23:10.812613 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.812594 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/f21e416d-0b97-48cf-87dd-e0bb81540b84-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-cf9549bc5-6k9xq\" (UID: \"f21e416d-0b97-48cf-87dd-e0bb81540b84\") " pod="opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq" Jun 02 15:23:10.814454 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.814433 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f21e416d-0b97-48cf-87dd-e0bb81540b84-cert\") pod \"kubeflow-trainer-controller-manager-cf9549bc5-6k9xq\" (UID: \"f21e416d-0b97-48cf-87dd-e0bb81540b84\") " pod="opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq" Jun 02 15:23:10.827005 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.826979 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k5hr\" (UniqueName: \"kubernetes.io/projected/f21e416d-0b97-48cf-87dd-e0bb81540b84-kube-api-access-9k5hr\") pod \"kubeflow-trainer-controller-manager-cf9549bc5-6k9xq\" (UID: \"f21e416d-0b97-48cf-87dd-e0bb81540b84\") " pod="opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq" Jun 02 15:23:10.976931 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:10.976853 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq" Jun 02 15:23:11.112590 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:11.112566 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq"] Jun 02 15:23:11.114971 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:23:11.114944 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf21e416d_0b97_48cf_87dd_e0bb81540b84.slice/crio-9f0583138e92dc7fbe1df238b43230d57b6e3633e72f6f76251221e4ec95cb3e WatchSource:0}: Error finding container 9f0583138e92dc7fbe1df238b43230d57b6e3633e72f6f76251221e4ec95cb3e: Status 404 returned error can't find the container with id 9f0583138e92dc7fbe1df238b43230d57b6e3633e72f6f76251221e4ec95cb3e Jun 02 15:23:11.614323 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:11.614242 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq" event={"ID":"f21e416d-0b97-48cf-87dd-e0bb81540b84","Type":"ContainerStarted","Data":"9f0583138e92dc7fbe1df238b43230d57b6e3633e72f6f76251221e4ec95cb3e"} Jun 02 15:23:14.624694 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:14.624652 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq" event={"ID":"f21e416d-0b97-48cf-87dd-e0bb81540b84","Type":"ContainerStarted","Data":"180985f0d5aaae48e5e4f20f7af2fdd94c455563679e34cb48c1e8aebc1c5893"} Jun 02 15:23:14.625265 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:14.624755 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq" Jun 02 15:23:14.664353 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:14.664308 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq" podStartSLOduration=2.081357256 podStartE2EDuration="4.664290399s" podCreationTimestamp="2026-06-02 15:23:10 +0000 UTC" firstStartedPulling="2026-06-02 15:23:11.116835245 +0000 UTC m=+510.702486224" lastFinishedPulling="2026-06-02 15:23:13.699768384 +0000 UTC m=+513.285419367" observedRunningTime="2026-06-02 15:23:14.664215214 +0000 UTC m=+514.249866218" watchObservedRunningTime="2026-06-02 15:23:14.664290399 +0000 UTC m=+514.249941403" Jun 02 15:23:30.632835 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:23:30.632762 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-cf9549bc5-6k9xq" Jun 02 15:24:40.910594 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:24:40.910561 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/ovn-acl-logging/0.log" Jun 02 15:24:40.911094 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:24:40.910974 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/ovn-acl-logging/0.log" Jun 02 15:27:25.140013 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:27:25.139981 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49"] Jun 02 15:27:25.142519 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:27:25.142497 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" Jun 02 15:27:25.145263 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:27:25.145237 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-blnzl\"/\"openshift-service-ca.crt\"" Jun 02 15:27:25.145378 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:27:25.145277 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-blnzl\"/\"kube-root-ca.crt\"" Jun 02 15:27:25.145378 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:27:25.145282 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-blnzl\"/\"default-dockercfg-7tvn9\"" Jun 02 15:27:25.153102 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:27:25.153078 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49"] Jun 02 15:27:25.258057 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:27:25.258012 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqv6v\" (UniqueName: \"kubernetes.io/projected/53581862-baf9-4b21-a4d0-d70ab7348662-kube-api-access-nqv6v\") pod \"progression-disabled-node-0-0-k7m49\" (UID: \"53581862-baf9-4b21-a4d0-d70ab7348662\") " pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" Jun 02 15:27:25.358943 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:27:25.358912 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nqv6v\" (UniqueName: \"kubernetes.io/projected/53581862-baf9-4b21-a4d0-d70ab7348662-kube-api-access-nqv6v\") pod \"progression-disabled-node-0-0-k7m49\" (UID: \"53581862-baf9-4b21-a4d0-d70ab7348662\") " pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" Jun 02 15:27:25.367887 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:27:25.367861 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqv6v\" (UniqueName: \"kubernetes.io/projected/53581862-baf9-4b21-a4d0-d70ab7348662-kube-api-access-nqv6v\") pod \"progression-disabled-node-0-0-k7m49\" (UID: \"53581862-baf9-4b21-a4d0-d70ab7348662\") " pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" Jun 02 15:27:25.452801 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:27:25.452718 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" Jun 02 15:27:25.582247 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:27:25.582211 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49"] Jun 02 15:27:25.585881 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:27:25.585851 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53581862_baf9_4b21_a4d0_d70ab7348662.slice/crio-a9eb741e239d2bc07bea3f0067934d979d22ad5a269e89108b73e64c734d2f5f WatchSource:0}: Error finding container a9eb741e239d2bc07bea3f0067934d979d22ad5a269e89108b73e64c734d2f5f: Status 404 returned error can't find the container with id a9eb741e239d2bc07bea3f0067934d979d22ad5a269e89108b73e64c734d2f5f Jun 02 15:27:25.588479 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:27:25.588459 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:27:26.377219 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:27:26.377177 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" event={"ID":"53581862-baf9-4b21-a4d0-d70ab7348662","Type":"ContainerStarted","Data":"a9eb741e239d2bc07bea3f0067934d979d22ad5a269e89108b73e64c734d2f5f"} Jun 02 15:28:15.721217 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:28:15.721181 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf"] Jun 02 15:28:15.734631 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:28:15.734592 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf"] Jun 02 15:28:15.734801 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:28:15.734742 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf" Jun 02 15:28:15.814480 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:28:15.814445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knd4p\" (UniqueName: \"kubernetes.io/projected/8bcf461d-f52f-43ac-a58a-93ed411c5711-kube-api-access-knd4p\") pod \"progression-job-failure-node-0-0-9rddf\" (UID: \"8bcf461d-f52f-43ac-a58a-93ed411c5711\") " pod="rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf" Jun 02 15:28:15.915844 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:28:15.915815 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knd4p\" (UniqueName: \"kubernetes.io/projected/8bcf461d-f52f-43ac-a58a-93ed411c5711-kube-api-access-knd4p\") pod \"progression-job-failure-node-0-0-9rddf\" (UID: \"8bcf461d-f52f-43ac-a58a-93ed411c5711\") " pod="rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf" Jun 02 15:28:15.927039 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:28:15.927009 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knd4p\" (UniqueName: \"kubernetes.io/projected/8bcf461d-f52f-43ac-a58a-93ed411c5711-kube-api-access-knd4p\") pod \"progression-job-failure-node-0-0-9rddf\" (UID: \"8bcf461d-f52f-43ac-a58a-93ed411c5711\") " pod="rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf" Jun 02 15:28:16.045605 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:28:16.045577 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf" Jun 02 15:28:16.202687 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:28:16.202642 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf"] Jun 02 15:28:16.206260 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:28:16.206228 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bcf461d_f52f_43ac_a58a_93ed411c5711.slice/crio-d04f491bcf0b4907c1811ce8ea1d3b240dc87478e350bef1eaf3a1447371f44d WatchSource:0}: Error finding container d04f491bcf0b4907c1811ce8ea1d3b240dc87478e350bef1eaf3a1447371f44d: Status 404 returned error can't find the container with id d04f491bcf0b4907c1811ce8ea1d3b240dc87478e350bef1eaf3a1447371f44d Jun 02 15:28:16.560827 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:28:16.560778 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf" event={"ID":"8bcf461d-f52f-43ac-a58a-93ed411c5711","Type":"ContainerStarted","Data":"d04f491bcf0b4907c1811ce8ea1d3b240dc87478e350bef1eaf3a1447371f44d"} Jun 02 15:29:27.847647 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:27.847554 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf" event={"ID":"8bcf461d-f52f-43ac-a58a-93ed411c5711","Type":"ContainerStarted","Data":"e884c22c55d75d3cc161b1bdd2239cd3d7ee7eaa2f9ae2889492cb4243487381"} Jun 02 15:29:27.847647 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:27.847624 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf" Jun 02 15:29:27.849079 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:27.849043 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" event={"ID":"53581862-baf9-4b21-a4d0-d70ab7348662","Type":"ContainerStarted","Data":"7524c6026aac0bb043e60d58925a42043aa36b5edb28a5e78a16731fe31e3cb3"} Jun 02 15:29:27.849213 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:27.849197 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" Jun 02 15:29:27.874761 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:27.874713 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf" podStartSLOduration=2.026601771 podStartE2EDuration="1m12.874686559s" podCreationTimestamp="2026-06-02 15:28:15 +0000 UTC" firstStartedPulling="2026-06-02 15:28:16.208978905 +0000 UTC m=+815.794629889" lastFinishedPulling="2026-06-02 15:29:27.057063687 +0000 UTC m=+886.642714677" observedRunningTime="2026-06-02 15:29:27.872482883 +0000 UTC m=+887.458133883" watchObservedRunningTime="2026-06-02 15:29:27.874686559 +0000 UTC m=+887.460337559" Jun 02 15:29:27.895415 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:27.895365 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" podStartSLOduration=1.5512644249999998 podStartE2EDuration="2m2.895348955s" podCreationTimestamp="2026-06-02 15:27:25 +0000 UTC" firstStartedPulling="2026-06-02 15:27:25.588612535 +0000 UTC m=+765.174263514" lastFinishedPulling="2026-06-02 15:29:26.932697059 +0000 UTC m=+886.518348044" observedRunningTime="2026-06-02 15:29:27.893138981 +0000 UTC m=+887.478789974" watchObservedRunningTime="2026-06-02 15:29:27.895348955 +0000 UTC m=+887.480999957" Jun 02 15:29:29.855487 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:29.855462 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf" Jun 02 15:29:29.855888 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:29.855514 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" Jun 02 15:29:36.853335 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:36.853286 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf" podUID="8bcf461d-f52f-43ac-a58a-93ed411c5711" containerName="node" probeResult="failure" output="Get \"http://10.133.0.28:28080/metrics\": dial tcp 10.133.0.28:28080: connect: connection refused" Jun 02 15:29:36.880282 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:36.880249 2566 generic.go:358] "Generic (PLEG): container finished" podID="8bcf461d-f52f-43ac-a58a-93ed411c5711" containerID="e884c22c55d75d3cc161b1bdd2239cd3d7ee7eaa2f9ae2889492cb4243487381" exitCode=1 Jun 02 15:29:36.880424 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:36.880321 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf" event={"ID":"8bcf461d-f52f-43ac-a58a-93ed411c5711","Type":"ContainerDied","Data":"e884c22c55d75d3cc161b1bdd2239cd3d7ee7eaa2f9ae2889492cb4243487381"} Jun 02 15:29:38.006645 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:38.006622 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf" Jun 02 15:29:38.062647 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:38.062613 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knd4p\" (UniqueName: \"kubernetes.io/projected/8bcf461d-f52f-43ac-a58a-93ed411c5711-kube-api-access-knd4p\") pod \"8bcf461d-f52f-43ac-a58a-93ed411c5711\" (UID: \"8bcf461d-f52f-43ac-a58a-93ed411c5711\") " Jun 02 15:29:38.064917 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:38.064889 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bcf461d-f52f-43ac-a58a-93ed411c5711-kube-api-access-knd4p" (OuterVolumeSpecName: "kube-api-access-knd4p") pod "8bcf461d-f52f-43ac-a58a-93ed411c5711" (UID: "8bcf461d-f52f-43ac-a58a-93ed411c5711"). InnerVolumeSpecName "kube-api-access-knd4p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:29:38.164021 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:38.163934 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knd4p\" (UniqueName: \"kubernetes.io/projected/8bcf461d-f52f-43ac-a58a-93ed411c5711-kube-api-access-knd4p\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:29:38.888418 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:38.888381 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf" event={"ID":"8bcf461d-f52f-43ac-a58a-93ed411c5711","Type":"ContainerDied","Data":"d04f491bcf0b4907c1811ce8ea1d3b240dc87478e350bef1eaf3a1447371f44d"} Jun 02 15:29:38.888418 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:38.888417 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d04f491bcf0b4907c1811ce8ea1d3b240dc87478e350bef1eaf3a1447371f44d" Jun 02 15:29:38.888622 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:38.888415 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf" Jun 02 15:29:40.935720 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:40.935681 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/ovn-acl-logging/0.log" Jun 02 15:29:40.936443 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:40.936422 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/ovn-acl-logging/0.log" Jun 02 15:29:50.105146 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:50.105100 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" podUID="53581862-baf9-4b21-a4d0-d70ab7348662" containerName="node" probeResult="failure" output="Get \"http://10.133.0.27:28080/metrics\": read tcp 10.133.0.2:49884->10.133.0.27:28080: read: connection reset by peer" Jun 02 15:29:50.853382 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:50.853342 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" podUID="53581862-baf9-4b21-a4d0-d70ab7348662" containerName="node" probeResult="failure" output="Get \"http://10.133.0.27:28080/metrics\": dial tcp 10.133.0.27:28080: connect: connection refused" Jun 02 15:29:50.853557 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:50.853460 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" Jun 02 15:29:50.853952 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:50.853922 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" podUID="53581862-baf9-4b21-a4d0-d70ab7348662" containerName="node" probeResult="failure" output="Get \"http://10.133.0.27:28080/metrics\": dial tcp 10.133.0.27:28080: connect: connection refused" Jun 02 15:29:50.930454 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:50.930425 2566 generic.go:358] "Generic (PLEG): container finished" podID="53581862-baf9-4b21-a4d0-d70ab7348662" containerID="7524c6026aac0bb043e60d58925a42043aa36b5edb28a5e78a16731fe31e3cb3" exitCode=0 Jun 02 15:29:50.930595 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:50.930469 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" event={"ID":"53581862-baf9-4b21-a4d0-d70ab7348662","Type":"ContainerDied","Data":"7524c6026aac0bb043e60d58925a42043aa36b5edb28a5e78a16731fe31e3cb3"} Jun 02 15:29:52.069054 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:52.069024 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" Jun 02 15:29:52.183930 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:52.183890 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqv6v\" (UniqueName: \"kubernetes.io/projected/53581862-baf9-4b21-a4d0-d70ab7348662-kube-api-access-nqv6v\") pod \"53581862-baf9-4b21-a4d0-d70ab7348662\" (UID: \"53581862-baf9-4b21-a4d0-d70ab7348662\") " Jun 02 15:29:52.186163 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:52.186106 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53581862-baf9-4b21-a4d0-d70ab7348662-kube-api-access-nqv6v" (OuterVolumeSpecName: "kube-api-access-nqv6v") pod "53581862-baf9-4b21-a4d0-d70ab7348662" (UID: "53581862-baf9-4b21-a4d0-d70ab7348662"). InnerVolumeSpecName "kube-api-access-nqv6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:29:52.285552 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:52.285518 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqv6v\" (UniqueName: \"kubernetes.io/projected/53581862-baf9-4b21-a4d0-d70ab7348662-kube-api-access-nqv6v\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jun 02 15:29:52.938133 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:52.938095 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" Jun 02 15:29:52.938328 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:52.938099 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49" event={"ID":"53581862-baf9-4b21-a4d0-d70ab7348662","Type":"ContainerDied","Data":"a9eb741e239d2bc07bea3f0067934d979d22ad5a269e89108b73e64c734d2f5f"} Jun 02 15:29:52.938328 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:52.938202 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9eb741e239d2bc07bea3f0067934d979d22ad5a269e89108b73e64c734d2f5f" Jun 02 15:29:56.865018 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:56.864986 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49"] Jun 02 15:29:56.870914 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:56.870890 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-blnzl/progression-disabled-node-0-0-k7m49"] Jun 02 15:29:56.897064 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:56.897035 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf"] Jun 02 15:29:56.901423 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:56.901399 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-blnzl/progression-job-failure-node-0-0-9rddf"] Jun 02 15:29:56.998980 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:56.998947 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53581862-baf9-4b21-a4d0-d70ab7348662" path="/var/lib/kubelet/pods/53581862-baf9-4b21-a4d0-d70ab7348662/volumes" Jun 02 15:29:56.999263 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:29:56.999250 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bcf461d-f52f-43ac-a58a-93ed411c5711" path="/var/lib/kubelet/pods/8bcf461d-f52f-43ac-a58a-93ed411c5711/volumes" Jun 02 15:30:08.677020 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:08.676987 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-cf9549bc5-6k9xq_f21e416d-0b97-48cf-87dd-e0bb81540b84/manager/0.log" Jun 02 15:30:09.152693 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:09.152654 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-cf9549bc5-6k9xq_f21e416d-0b97-48cf-87dd-e0bb81540b84/manager/0.log" Jun 02 15:30:09.601539 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:09.601512 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-cf9549bc5-6k9xq_f21e416d-0b97-48cf-87dd-e0bb81540b84/manager/0.log" Jun 02 15:30:49.415440 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.415403 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hq4ql/must-gather-mz7q9"] Jun 02 15:30:49.415875 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.415734 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bcf461d-f52f-43ac-a58a-93ed411c5711" containerName="node" Jun 02 15:30:49.415875 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.415745 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bcf461d-f52f-43ac-a58a-93ed411c5711" containerName="node" Jun 02 15:30:49.415875 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.415773 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53581862-baf9-4b21-a4d0-d70ab7348662" containerName="node" Jun 02 15:30:49.415875 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.415778 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="53581862-baf9-4b21-a4d0-d70ab7348662" containerName="node" Jun 02 15:30:49.415875 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.415840 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="8bcf461d-f52f-43ac-a58a-93ed411c5711" containerName="node" Jun 02 15:30:49.415875 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.415848 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="53581862-baf9-4b21-a4d0-d70ab7348662" containerName="node" Jun 02 15:30:49.417943 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.417924 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hq4ql/must-gather-mz7q9" Jun 02 15:30:49.423772 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.423747 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hq4ql\"/\"kube-root-ca.crt\"" Jun 02 15:30:49.423880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.423773 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hq4ql\"/\"openshift-service-ca.crt\"" Jun 02 15:30:49.423880 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.423747 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hq4ql\"/\"default-dockercfg-84tm5\"" Jun 02 15:30:49.436803 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.436779 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hq4ql/must-gather-mz7q9"] Jun 02 15:30:49.464682 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.464658 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/440b0a5c-80bb-4fd6-bc59-abf083f4733b-must-gather-output\") pod \"must-gather-mz7q9\" (UID: \"440b0a5c-80bb-4fd6-bc59-abf083f4733b\") " pod="openshift-must-gather-hq4ql/must-gather-mz7q9" Jun 02 15:30:49.464799 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.464685 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbz52\" (UniqueName: \"kubernetes.io/projected/440b0a5c-80bb-4fd6-bc59-abf083f4733b-kube-api-access-jbz52\") pod \"must-gather-mz7q9\" (UID: \"440b0a5c-80bb-4fd6-bc59-abf083f4733b\") " pod="openshift-must-gather-hq4ql/must-gather-mz7q9" Jun 02 15:30:49.565562 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.565525 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/440b0a5c-80bb-4fd6-bc59-abf083f4733b-must-gather-output\") pod \"must-gather-mz7q9\" (UID: \"440b0a5c-80bb-4fd6-bc59-abf083f4733b\") " pod="openshift-must-gather-hq4ql/must-gather-mz7q9" Jun 02 15:30:49.565562 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.565561 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jbz52\" (UniqueName: \"kubernetes.io/projected/440b0a5c-80bb-4fd6-bc59-abf083f4733b-kube-api-access-jbz52\") pod \"must-gather-mz7q9\" (UID: \"440b0a5c-80bb-4fd6-bc59-abf083f4733b\") " pod="openshift-must-gather-hq4ql/must-gather-mz7q9" Jun 02 15:30:49.565942 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.565919 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/440b0a5c-80bb-4fd6-bc59-abf083f4733b-must-gather-output\") pod \"must-gather-mz7q9\" (UID: \"440b0a5c-80bb-4fd6-bc59-abf083f4733b\") " pod="openshift-must-gather-hq4ql/must-gather-mz7q9" Jun 02 15:30:49.581851 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.581827 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbz52\" (UniqueName: \"kubernetes.io/projected/440b0a5c-80bb-4fd6-bc59-abf083f4733b-kube-api-access-jbz52\") pod \"must-gather-mz7q9\" (UID: \"440b0a5c-80bb-4fd6-bc59-abf083f4733b\") " pod="openshift-must-gather-hq4ql/must-gather-mz7q9" Jun 02 15:30:49.727541 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.727441 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hq4ql/must-gather-mz7q9" Jun 02 15:30:49.882636 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:49.882609 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hq4ql/must-gather-mz7q9"] Jun 02 15:30:49.885628 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:30:49.885598 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod440b0a5c_80bb_4fd6_bc59_abf083f4733b.slice/crio-5217e51ace7c4a4e8398c817f849bb1f460fbecb25a75994b9857471fb0d766a WatchSource:0}: Error finding container 5217e51ace7c4a4e8398c817f849bb1f460fbecb25a75994b9857471fb0d766a: Status 404 returned error can't find the container with id 5217e51ace7c4a4e8398c817f849bb1f460fbecb25a75994b9857471fb0d766a Jun 02 15:30:50.133853 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:50.133811 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hq4ql/must-gather-mz7q9" event={"ID":"440b0a5c-80bb-4fd6-bc59-abf083f4733b","Type":"ContainerStarted","Data":"5217e51ace7c4a4e8398c817f849bb1f460fbecb25a75994b9857471fb0d766a"} Jun 02 15:30:51.141887 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:51.141849 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hq4ql/must-gather-mz7q9" event={"ID":"440b0a5c-80bb-4fd6-bc59-abf083f4733b","Type":"ContainerStarted","Data":"7d75672fcf5114ccadbfb2d86c5bfc57ed9e9fcedc74b142fea55db52624d2b7"} Jun 02 15:30:51.142384 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:51.141894 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hq4ql/must-gather-mz7q9" event={"ID":"440b0a5c-80bb-4fd6-bc59-abf083f4733b","Type":"ContainerStarted","Data":"e006568705164f642899587496e6d9b2b3645086731cc7bc572466f6e1c51edd"} Jun 02 15:30:51.159060 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:51.159002 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-hq4ql/must-gather-mz7q9" podStartSLOduration=1.553279796 podStartE2EDuration="2.158983404s" podCreationTimestamp="2026-06-02 15:30:49 +0000 UTC" firstStartedPulling="2026-06-02 15:30:49.887431922 +0000 UTC m=+969.473082901" lastFinishedPulling="2026-06-02 15:30:50.493135522 +0000 UTC m=+970.078786509" observedRunningTime="2026-06-02 15:30:51.157009897 +0000 UTC m=+970.742660898" watchObservedRunningTime="2026-06-02 15:30:51.158983404 +0000 UTC m=+970.744634406" Jun 02 15:30:51.978082 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:51.978051 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rjsmb_734bc4c6-cf3a-447b-9d8a-ac2273ba8b2e/global-pull-secret-syncer/0.log" Jun 02 15:30:52.114947 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:52.114919 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-84jcn_fa0e7977-049c-4213-8732-790894fcc011/konnectivity-agent/0.log" Jun 02 15:30:52.218721 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:52.218674 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-172.ec2.internal_c965875c7d97cdd2b7f7dc64a963ce12/haproxy/0.log" Jun 02 15:30:55.864516 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:55.864462 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-9hx7v_18a865d5-0df0-4ea0-9a9e-b87986e35213/cluster-monitoring-operator/0.log" Jun 02 15:30:55.970667 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:55.970560 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-747cbfc887-rlmr8_695511ba-4bbe-49a7-b111-6f7a757058f2/metrics-server/0.log" Jun 02 15:30:55.994825 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:55.994795 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-v5v7s_a81736d8-ca36-4a99-a0e2-9b43ecb1446c/monitoring-plugin/0.log" Jun 02 15:30:56.195595 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.195570 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zdvwh_81591a9a-f2bd-4b2f-95de-7f766426e2ce/node-exporter/0.log" Jun 02 15:30:56.277525 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.277454 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zdvwh_81591a9a-f2bd-4b2f-95de-7f766426e2ce/kube-rbac-proxy/0.log" Jun 02 15:30:56.324537 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.324512 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zdvwh_81591a9a-f2bd-4b2f-95de-7f766426e2ce/init-textfile/0.log" Jun 02 15:30:56.382432 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.382319 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-ntjg6_6508956e-e61d-4c15-9619-519383f0f09d/kube-rbac-proxy-main/0.log" Jun 02 15:30:56.414993 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.414950 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-ntjg6_6508956e-e61d-4c15-9619-519383f0f09d/kube-rbac-proxy-self/0.log" Jun 02 15:30:56.477036 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.476951 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-ntjg6_6508956e-e61d-4c15-9619-519383f0f09d/openshift-state-metrics/0.log" Jun 02 15:30:56.527333 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.527303 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_17876af6-d1e2-4f88-866c-4ddec1e40787/prometheus/0.log" Jun 02 15:30:56.576271 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.576245 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_17876af6-d1e2-4f88-866c-4ddec1e40787/config-reloader/0.log" Jun 02 15:30:56.622821 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.621433 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_17876af6-d1e2-4f88-866c-4ddec1e40787/thanos-sidecar/0.log" Jun 02 15:30:56.656106 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.656074 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_17876af6-d1e2-4f88-866c-4ddec1e40787/kube-rbac-proxy-web/0.log" Jun 02 15:30:56.683642 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.683605 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_17876af6-d1e2-4f88-866c-4ddec1e40787/kube-rbac-proxy/0.log" Jun 02 15:30:56.706538 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.706498 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_17876af6-d1e2-4f88-866c-4ddec1e40787/kube-rbac-proxy-thanos/0.log" Jun 02 15:30:56.732041 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.732009 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_17876af6-d1e2-4f88-866c-4ddec1e40787/init-config-reloader/0.log" Jun 02 15:30:56.764605 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.764499 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-dvm4b_7d066952-56c9-4a58-a667-4f3c84833ba9/prometheus-operator/0.log" Jun 02 15:30:56.787142 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.787075 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-dvm4b_7d066952-56c9-4a58-a667-4f3c84833ba9/kube-rbac-proxy/0.log" Jun 02 15:30:56.817543 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.817488 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-zkwkl_3b55bfe5-d162-4a6b-8eb6-c836d1914eb8/prometheus-operator-admission-webhook/0.log" Jun 02 15:30:56.928315 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.928282 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55fdf698dd-jsbjf_e5f40710-f594-4735-b6be-b7ba2df0b3c8/thanos-query/0.log" Jun 02 15:30:56.952260 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.952188 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55fdf698dd-jsbjf_e5f40710-f594-4735-b6be-b7ba2df0b3c8/kube-rbac-proxy-web/0.log" Jun 02 15:30:56.976728 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:56.976678 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55fdf698dd-jsbjf_e5f40710-f594-4735-b6be-b7ba2df0b3c8/kube-rbac-proxy/0.log" Jun 02 15:30:57.000889 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:57.000864 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55fdf698dd-jsbjf_e5f40710-f594-4735-b6be-b7ba2df0b3c8/prom-label-proxy/0.log" Jun 02 15:30:57.024017 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:57.023989 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55fdf698dd-jsbjf_e5f40710-f594-4735-b6be-b7ba2df0b3c8/kube-rbac-proxy-rules/0.log" Jun 02 15:30:57.050445 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:57.050357 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55fdf698dd-jsbjf_e5f40710-f594-4735-b6be-b7ba2df0b3c8/kube-rbac-proxy-metrics/0.log" Jun 02 15:30:58.625734 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.625684 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq"] Jun 02 15:30:58.630055 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.630028 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:30:58.639227 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.639199 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq"] Jun 02 15:30:58.647665 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.647637 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e99d9a1b-69d6-4484-8ad8-af755b11eaf6-proc\") pod \"perf-node-gather-daemonset-w5tlq\" (UID: \"e99d9a1b-69d6-4484-8ad8-af755b11eaf6\") " pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:30:58.647830 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.647683 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e99d9a1b-69d6-4484-8ad8-af755b11eaf6-podres\") pod \"perf-node-gather-daemonset-w5tlq\" (UID: \"e99d9a1b-69d6-4484-8ad8-af755b11eaf6\") " pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:30:58.647830 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.647733 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5q8r\" (UniqueName: \"kubernetes.io/projected/e99d9a1b-69d6-4484-8ad8-af755b11eaf6-kube-api-access-t5q8r\") pod \"perf-node-gather-daemonset-w5tlq\" (UID: \"e99d9a1b-69d6-4484-8ad8-af755b11eaf6\") " pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:30:58.647830 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.647775 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e99d9a1b-69d6-4484-8ad8-af755b11eaf6-lib-modules\") pod \"perf-node-gather-daemonset-w5tlq\" (UID: \"e99d9a1b-69d6-4484-8ad8-af755b11eaf6\") " pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:30:58.647993 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.647830 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e99d9a1b-69d6-4484-8ad8-af755b11eaf6-sys\") pod \"perf-node-gather-daemonset-w5tlq\" (UID: \"e99d9a1b-69d6-4484-8ad8-af755b11eaf6\") " pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:30:58.749066 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.749030 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e99d9a1b-69d6-4484-8ad8-af755b11eaf6-sys\") pod \"perf-node-gather-daemonset-w5tlq\" (UID: \"e99d9a1b-69d6-4484-8ad8-af755b11eaf6\") " pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:30:58.750233 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.750210 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e99d9a1b-69d6-4484-8ad8-af755b11eaf6-proc\") pod \"perf-node-gather-daemonset-w5tlq\" (UID: \"e99d9a1b-69d6-4484-8ad8-af755b11eaf6\") " pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:30:58.750418 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.750403 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e99d9a1b-69d6-4484-8ad8-af755b11eaf6-podres\") pod \"perf-node-gather-daemonset-w5tlq\" (UID: \"e99d9a1b-69d6-4484-8ad8-af755b11eaf6\") " pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:30:58.750552 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.750521 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e99d9a1b-69d6-4484-8ad8-af755b11eaf6-podres\") pod \"perf-node-gather-daemonset-w5tlq\" (UID: \"e99d9a1b-69d6-4484-8ad8-af755b11eaf6\") " pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:30:58.750552 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.749277 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e99d9a1b-69d6-4484-8ad8-af755b11eaf6-sys\") pod \"perf-node-gather-daemonset-w5tlq\" (UID: \"e99d9a1b-69d6-4484-8ad8-af755b11eaf6\") " pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:30:58.750763 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.750520 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5q8r\" (UniqueName: \"kubernetes.io/projected/e99d9a1b-69d6-4484-8ad8-af755b11eaf6-kube-api-access-t5q8r\") pod \"perf-node-gather-daemonset-w5tlq\" (UID: \"e99d9a1b-69d6-4484-8ad8-af755b11eaf6\") " pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:30:58.750763 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.750422 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e99d9a1b-69d6-4484-8ad8-af755b11eaf6-proc\") pod \"perf-node-gather-daemonset-w5tlq\" (UID: \"e99d9a1b-69d6-4484-8ad8-af755b11eaf6\") " pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:30:58.750763 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.750637 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e99d9a1b-69d6-4484-8ad8-af755b11eaf6-lib-modules\") pod \"perf-node-gather-daemonset-w5tlq\" (UID: \"e99d9a1b-69d6-4484-8ad8-af755b11eaf6\") " pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:30:58.750763 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.750736 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e99d9a1b-69d6-4484-8ad8-af755b11eaf6-lib-modules\") pod \"perf-node-gather-daemonset-w5tlq\" (UID: \"e99d9a1b-69d6-4484-8ad8-af755b11eaf6\") " pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:30:58.759260 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.759231 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5q8r\" (UniqueName: \"kubernetes.io/projected/e99d9a1b-69d6-4484-8ad8-af755b11eaf6-kube-api-access-t5q8r\") pod \"perf-node-gather-daemonset-w5tlq\" (UID: \"e99d9a1b-69d6-4484-8ad8-af755b11eaf6\") " pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:30:58.793952 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.793932 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-4td4k_89e51119-f144-4cb2-89c7-f1b76551e89a/download-server/0.log" Jun 02 15:30:58.943182 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:58.942685 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:30:59.094279 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:59.094245 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq"] Jun 02 15:30:59.098944 ip-10-0-128-172 kubenswrapper[2566]: W0602 15:30:59.097455 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode99d9a1b_69d6_4484_8ad8_af755b11eaf6.slice/crio-3357d81f0972ac6a625684dde9fe38d687186ec8707f4c956d5e10d372fbf852 WatchSource:0}: Error finding container 3357d81f0972ac6a625684dde9fe38d687186ec8707f4c956d5e10d372fbf852: Status 404 returned error can't find the container with id 3357d81f0972ac6a625684dde9fe38d687186ec8707f4c956d5e10d372fbf852 Jun 02 15:30:59.173637 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:59.173562 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" event={"ID":"e99d9a1b-69d6-4484-8ad8-af755b11eaf6","Type":"ContainerStarted","Data":"3357d81f0972ac6a625684dde9fe38d687186ec8707f4c956d5e10d372fbf852"} Jun 02 15:30:59.827108 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:59.827077 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b49x5_798cd11a-6fbd-4c5e-8642-cb8ac8000c11/dns/0.log" Jun 02 15:30:59.851676 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:59.851649 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b49x5_798cd11a-6fbd-4c5e-8642-cb8ac8000c11/kube-rbac-proxy/0.log" Jun 02 15:30:59.927589 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:30:59.927564 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7zgg4_81690d60-d545-4a62-805e-c966443073b4/dns-node-resolver/0.log" Jun 02 15:31:00.179392 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:00.179301 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" event={"ID":"e99d9a1b-69d6-4484-8ad8-af755b11eaf6","Type":"ContainerStarted","Data":"f6b9697856dcca2472e1703add57f5cda8ae142d9581d06d8703af81cc46de8c"} Jun 02 15:31:00.179547 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:00.179453 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:31:00.195026 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:00.194978 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" podStartSLOduration=2.194964139 podStartE2EDuration="2.194964139s" podCreationTimestamp="2026-06-02 15:30:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:31:00.194273977 +0000 UTC m=+979.779924979" watchObservedRunningTime="2026-06-02 15:31:00.194964139 +0000 UTC m=+979.780615140" Jun 02 15:31:00.422183 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:00.422157 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vpzdk_ee7fa008-6c9e-4db5-9cb5-11f5b181e582/node-ca/0.log" Jun 02 15:31:01.400585 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:01.400552 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6j6m8_e75e6c78-7324-4e26-b921-1d69f6192acf/serve-healthcheck-canary/0.log" Jun 02 15:31:01.883654 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:01.883627 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b7vmn_e20284df-0021-488a-8774-b075d317fa5c/kube-rbac-proxy/0.log" Jun 02 15:31:01.907747 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:01.907723 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b7vmn_e20284df-0021-488a-8774-b075d317fa5c/exporter/0.log" Jun 02 15:31:01.929517 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:01.929496 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b7vmn_e20284df-0021-488a-8774-b075d317fa5c/extractor/0.log" Jun 02 15:31:06.192136 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:06.192112 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hq4ql/perf-node-gather-daemonset-w5tlq" Jun 02 15:31:06.698322 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:06.698294 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-4ld2x_577d500f-1be8-4414-a410-75d2eaf658f1/migrator/0.log" Jun 02 15:31:06.720459 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:06.720430 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-4ld2x_577d500f-1be8-4414-a410-75d2eaf658f1/graceful-termination/0.log" Jun 02 15:31:07.050885 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:07.050821 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-sdbsw_a6ae8769-7f7c-4353-886a-51d7a39dee7e/kube-storage-version-migrator-operator/1.log" Jun 02 15:31:07.052040 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:07.052016 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-sdbsw_a6ae8769-7f7c-4353-886a-51d7a39dee7e/kube-storage-version-migrator-operator/0.log" Jun 02 15:31:08.016917 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:08.016844 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7g7rb_9ca3a2de-9281-482c-b7be-6a283c9a6cb9/kube-multus/0.log" Jun 02 15:31:08.487654 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:08.487626 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ws4sb_6b4a2cb3-34d0-41a5-9c84-d7cd4e818043/kube-multus-additional-cni-plugins/0.log" Jun 02 15:31:08.511159 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:08.511138 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ws4sb_6b4a2cb3-34d0-41a5-9c84-d7cd4e818043/egress-router-binary-copy/0.log" Jun 02 15:31:08.532404 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:08.532380 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ws4sb_6b4a2cb3-34d0-41a5-9c84-d7cd4e818043/cni-plugins/0.log" Jun 02 15:31:08.554488 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:08.554465 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ws4sb_6b4a2cb3-34d0-41a5-9c84-d7cd4e818043/bond-cni-plugin/0.log" Jun 02 15:31:08.576787 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:08.576759 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ws4sb_6b4a2cb3-34d0-41a5-9c84-d7cd4e818043/routeoverride-cni/0.log" Jun 02 15:31:08.597181 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:08.597160 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ws4sb_6b4a2cb3-34d0-41a5-9c84-d7cd4e818043/whereabouts-cni-bincopy/0.log" Jun 02 15:31:08.618774 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:08.618749 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ws4sb_6b4a2cb3-34d0-41a5-9c84-d7cd4e818043/whereabouts-cni/0.log" Jun 02 15:31:08.790304 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:08.790279 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-md8jp_4814aa17-8f1d-4de5-80a7-f0d823d2c818/network-metrics-daemon/0.log" Jun 02 15:31:08.813495 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:08.813473 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-md8jp_4814aa17-8f1d-4de5-80a7-f0d823d2c818/kube-rbac-proxy/0.log" Jun 02 15:31:09.640629 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:09.640594 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/ovn-controller/0.log" Jun 02 15:31:09.660776 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:09.660748 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/ovn-acl-logging/0.log" Jun 02 15:31:09.666535 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:09.666489 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/ovn-acl-logging/1.log" Jun 02 15:31:09.687805 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:09.687777 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/kube-rbac-proxy-node/0.log" Jun 02 15:31:09.708465 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:09.708443 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 15:31:09.726243 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:09.726216 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/northd/0.log" Jun 02 15:31:09.750016 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:09.749987 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/nbdb/0.log" Jun 02 15:31:09.771053 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:09.771029 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/sbdb/0.log" Jun 02 15:31:09.876582 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:09.876546 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mlbxc_3399fc44-4af2-4e59-8a97-a22f8110b914/ovnkube-controller/0.log" Jun 02 15:31:11.415654 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:11.415621 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-6xl9v_9f1fef37-4e7b-4565-a20d-8e4d7994625e/network-check-target-container/0.log" Jun 02 15:31:12.377398 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:12.377367 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-z7fp7_f747a7ca-d127-4064-95aa-13e4dafe9d22/iptables-alerter/0.log" Jun 02 15:31:12.982947 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:12.982921 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-2s766_366b12b3-4c11-478e-a8e2-ff79880ae709/tuned/0.log" Jun 02 15:31:14.783687 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:14.783658 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-755bbf9bfb-gbgqf_ff885980-5700-4d87-bc33-31824b96742f/cluster-samples-operator/0.log" Jun 02 15:31:14.802837 ip-10-0-128-172 kubenswrapper[2566]: I0602 15:31:14.802774 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-755bbf9bfb-gbgqf_ff885980-5700-4d87-bc33-31824b96742f/cluster-samples-operator-watch/0.log"