Jun 03 07:56:57.514277 ip-10-0-128-28 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 07:56:57.514290 ip-10-0-128-28 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 07:56:57.514300 ip-10-0-128-28 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 07:56:57.514590 ip-10-0-128-28 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 07:57:07.604739 ip-10-0-128-28 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 07:57:07.604760 ip-10-0-128-28 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 04d30a3b3f694d938342af1bbe3b6cbd -- Jun 03 07:59:18.900769 ip-10-0-128-28 systemd[1]: Starting Kubernetes Kubelet... Jun 03 07:59:19.361118 ip-10-0-128-28 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 07:59:19.361118 ip-10-0-128-28 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 07:59:19.361118 ip-10-0-128-28 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 07:59:19.361118 ip-10-0-128-28 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 07:59:19.361118 ip-10-0-128-28 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 07:59:19.362921 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.362804 2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 07:59:19.366053 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366038 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 07:59:19.366053 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366053 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366056 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366059 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366062 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366065 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366069 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366072 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366075 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366077 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366080 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366083 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366086 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366089 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366093 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366096 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366099 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366102 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366105 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366107 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 07:59:19.366125 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366111 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366113 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366116 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366125 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366129 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366140 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366143 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366146 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366149 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366152 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366155 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366157 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366160 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366162 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366166 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366170 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366172 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366175 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366178 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 07:59:19.366599 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366181 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366183 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366186 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366189 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366192 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366194 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366197 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366199 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366202 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366205 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366207 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366211 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366213 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366216 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366219 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366221 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366224 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366227 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366229 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366232 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 07:59:19.367069 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366235 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366237 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366240 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366243 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366246 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366248 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366251 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366253 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366256 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366258 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366261 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366263 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366274 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366277 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366279 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366288 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366290 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366293 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366295 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366298 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 07:59:19.367571 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366301 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366303 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366306 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366309 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366313 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366315 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366318 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366707 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366712 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366715 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366717 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366720 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366723 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366726 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366729 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366731 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366734 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366737 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366739 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366742 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 07:59:19.368080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366744 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366747 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366751 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366754 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366757 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366761 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366764 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366768 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366772 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366775 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366778 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366781 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366784 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366787 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366789 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366792 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366795 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366797 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366800 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 07:59:19.368587 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366803 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366805 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366808 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366811 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366814 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366816 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366819 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366821 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366824 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366826 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366829 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366832 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366835 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366837 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366839 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366842 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366844 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366847 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366849 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366852 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 07:59:19.369080 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366854 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366857 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366860 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366863 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366865 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366868 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366871 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366874 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366876 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366879 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366881 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366885 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366888 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366890 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366893 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366895 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366898 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366900 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366903 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 07:59:19.369595 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366905 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366908 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366910 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366912 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366915 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366917 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366920 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366923 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366925 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366928 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366930 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366932 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366935 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366938 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.366940 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367014 2575 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367021 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367028 2575 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367032 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367036 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367040 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 07:59:19.370073 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367044 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367048 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367051 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367054 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367058 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367062 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367065 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367068 2575 flags.go:64] FLAG: --cgroup-root="" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367071 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367074 2575 flags.go:64] FLAG: --client-ca-file="" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367077 2575 flags.go:64] FLAG: --cloud-config="" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367080 2575 flags.go:64] FLAG: --cloud-provider="external" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367083 2575 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367087 2575 flags.go:64] FLAG: --cluster-domain="" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367090 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367093 2575 flags.go:64] FLAG: --config-dir="" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367099 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367103 2575 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367106 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367109 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367112 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367115 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367119 2575 flags.go:64] FLAG: --contention-profiling="false" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367121 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 07:59:19.370650 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367124 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367127 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367130 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367135 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367139 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367142 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367144 2575 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367148 2575 flags.go:64] FLAG: --enable-server="true" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367150 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367156 2575 flags.go:64] FLAG: --event-burst="100" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367159 2575 flags.go:64] FLAG: --event-qps="50" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367162 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367165 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367168 2575 flags.go:64] FLAG: --eviction-hard="" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367172 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367175 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367178 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367181 2575 flags.go:64] FLAG: --eviction-soft="" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367184 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367186 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367190 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367193 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367196 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367199 2575 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367204 2575 flags.go:64] FLAG: --feature-gates="" Jun 03 07:59:19.371238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367207 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367210 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367213 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367217 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367220 2575 flags.go:64] FLAG: --healthz-port="10248" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367222 2575 flags.go:64] FLAG: --help="false" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367225 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-128-28.ec2.internal" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367228 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367231 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367234 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367238 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367245 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367248 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367251 2575 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367254 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367256 2575 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367259 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367262 2575 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367265 2575 flags.go:64] FLAG: --kube-reserved="" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367268 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367271 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367274 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367277 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367280 2575 flags.go:64] FLAG: --lock-file="" Jun 03 07:59:19.371874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367283 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367286 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367289 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367294 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367297 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367300 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367303 2575 flags.go:64] FLAG: --logging-format="text" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367308 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367311 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367314 2575 flags.go:64] FLAG: --manifest-url="" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367317 2575 flags.go:64] FLAG: --manifest-url-header="" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367321 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367324 2575 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367329 2575 flags.go:64] FLAG: --max-pods="110" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367331 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367335 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367337 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367340 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367343 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367346 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367350 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367356 2575 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367360 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367362 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 07:59:19.372504 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367365 2575 flags.go:64] FLAG: --pod-cidr="" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367368 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367374 2575 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367377 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367380 2575 flags.go:64] FLAG: --pods-per-core="0" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367383 2575 flags.go:64] FLAG: --port="10250" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367386 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367389 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-079cbaf7098f1b311" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367392 2575 flags.go:64] FLAG: --qos-reserved="" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367395 2575 flags.go:64] FLAG: --read-only-port="10255" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367398 2575 flags.go:64] FLAG: --register-node="true" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367401 2575 flags.go:64] FLAG: --register-schedulable="true" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367404 2575 flags.go:64] FLAG: --register-with-taints="" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367407 2575 flags.go:64] FLAG: --registry-burst="10" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367410 2575 flags.go:64] FLAG: --registry-qps="5" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367413 2575 flags.go:64] FLAG: --reserved-cpus="" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367417 2575 flags.go:64] FLAG: --reserved-memory="" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367421 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367424 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367427 2575 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367444 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367447 2575 flags.go:64] FLAG: --runonce="false" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367450 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367453 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367456 2575 flags.go:64] FLAG: --seccomp-default="false" Jun 03 07:59:19.373083 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367459 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367462 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367465 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367468 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367472 2575 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367475 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367478 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367481 2575 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367484 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367487 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367490 2575 flags.go:64] FLAG: --system-cgroups="" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367492 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367498 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367501 2575 flags.go:64] FLAG: --tls-cert-file="" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367504 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367510 2575 flags.go:64] FLAG: --tls-min-version="" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367513 2575 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367516 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367521 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367524 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367527 2575 flags.go:64] FLAG: --v="2" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367531 2575 flags.go:64] FLAG: --version="false" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367535 2575 flags.go:64] FLAG: --vmodule="" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367541 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.367544 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 07:59:19.373937 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367635 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367640 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367643 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367646 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367648 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367651 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367654 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367656 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367659 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367662 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367665 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367668 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367671 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367674 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367676 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367679 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367681 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367686 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367690 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 07:59:19.374590 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367693 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367696 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367698 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367701 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367703 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367706 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367710 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367712 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367715 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367718 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367720 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367724 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367726 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367729 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367731 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367734 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367737 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367739 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367742 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367744 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 07:59:19.375333 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367747 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367750 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367752 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367755 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367757 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367760 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367763 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367765 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367768 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367770 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367773 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367775 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367778 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367781 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367783 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367785 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367788 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367790 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367795 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367797 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 07:59:19.376248 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367799 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367802 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367805 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367810 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367814 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367817 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367819 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367822 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367824 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367827 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367830 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367832 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367835 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367837 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367840 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367842 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367845 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367848 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367851 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 07:59:19.377148 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367857 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 07:59:19.377805 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367859 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 07:59:19.377805 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367862 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 07:59:19.377805 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367864 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 07:59:19.377805 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367867 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 07:59:19.377805 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367869 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 07:59:19.377805 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367872 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 07:59:19.377805 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.367874 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 07:59:19.377805 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.368579 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 07:59:19.377805 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.376263 2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 07:59:19.377805 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.376282 2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 07:59:19.377805 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376365 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 07:59:19.377805 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376373 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 07:59:19.377805 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376379 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 07:59:19.377805 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376384 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 07:59:19.377805 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376390 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376396 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376403 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376408 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376413 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376418 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376422 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376427 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376449 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376454 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376458 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376462 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376466 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376471 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376481 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376486 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376490 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376494 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376499 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376503 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 07:59:19.378239 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376507 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376511 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376515 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376519 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376525 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376529 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376533 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376540 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376545 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376550 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376554 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376558 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376562 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376566 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376571 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376575 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376579 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376583 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376587 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376592 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 07:59:19.378940 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376596 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376600 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376605 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376609 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376616 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376622 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376626 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376631 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376635 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376640 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376644 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376647 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376652 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376656 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376660 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376664 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376669 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376673 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376677 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376682 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 07:59:19.379800 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376688 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376692 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376697 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376701 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376705 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376709 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376714 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376718 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376722 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376726 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376730 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376735 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376739 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376743 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376747 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376752 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376756 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376760 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376764 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376768 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 07:59:19.380458 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376772 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 07:59:19.381082 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376777 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 07:59:19.381082 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.376785 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 07:59:19.381082 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376952 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 07:59:19.381082 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376961 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 07:59:19.381082 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376966 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 07:59:19.381082 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376971 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 07:59:19.381082 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376976 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 07:59:19.381082 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376981 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 07:59:19.381082 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376985 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 07:59:19.381082 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376990 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 07:59:19.381082 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.376994 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 07:59:19.381082 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377002 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 07:59:19.381082 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377009 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 07:59:19.381082 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377014 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 07:59:19.381082 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377019 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377023 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377028 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377033 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377037 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377041 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377045 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377049 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377054 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377057 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377062 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377066 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377070 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377074 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377079 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377083 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377087 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377091 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377095 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377100 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 07:59:19.381492 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377104 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377109 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377114 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377118 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377122 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377127 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377131 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377135 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377140 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377144 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377148 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377154 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377160 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377164 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377168 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377173 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377177 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377182 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377186 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 07:59:19.382016 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377190 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377195 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377199 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377203 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377207 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377211 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377215 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377219 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377223 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377227 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377231 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377236 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377240 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377244 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377248 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377253 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377257 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377261 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377265 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377269 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 07:59:19.382510 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377274 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 07:59:19.383097 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377278 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 07:59:19.383097 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377283 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 07:59:19.383097 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377288 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 07:59:19.383097 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377292 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 07:59:19.383097 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377297 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 07:59:19.383097 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377301 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 07:59:19.383097 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377305 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 07:59:19.383097 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377309 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 07:59:19.383097 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377313 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 07:59:19.383097 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377317 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 07:59:19.383097 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377321 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 07:59:19.383097 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377326 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 07:59:19.383097 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377330 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 07:59:19.383097 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:19.377334 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 07:59:19.383097 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.377342 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 07:59:19.383636 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.378132 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 07:59:19.383636 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.380659 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 07:59:19.383636 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.383574 2575 server.go:1019] "Starting client certificate rotation" Jun 03 07:59:19.383722 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.383677 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 07:59:19.384416 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.384403 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 07:59:19.408974 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.408951 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 07:59:19.411054 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.411026 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 07:59:19.424510 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.424488 2575 log.go:25] "Validated CRI v1 runtime API" Jun 03 07:59:19.431815 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.431798 2575 log.go:25] "Validated CRI v1 image API" Jun 03 07:59:19.432948 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.432936 2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 07:59:19.435252 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.435235 2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 95cab253-bab3-49ec-a819-33b9f0118c84:/dev/nvme0n1p4 c77cc04c-661a-4b23-bb4f-5b0a25aeea11:/dev/nvme0n1p3] Jun 03 07:59:19.435297 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.435252 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 07:59:19.439484 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.439349 2575 manager.go:217] Machine: {Timestamp:2026-06-03 07:59:19.438868805 +0000 UTC m=+0.418211709 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099990 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22a0b201bf782908c327dd04710809 SystemUUID:ec22a0b2-01bf-7829-08c3-27dd04710809 BootID:04d30a3b-3f69-4d93-8342-af1bbe3b6cbd Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e9:a1:7b:62:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e9:a1:7b:62:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:13:0c:28:3b:1f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 07:59:19.440598 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.440587 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 07:59:19.440682 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.440663 2575 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 07:59:19.442336 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.442311 2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 07:59:19.442480 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.442335 2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-28.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 07:59:19.442552 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.442489 2575 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 07:59:19.442552 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.442497 2575 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 07:59:19.442552 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.442505 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 07:59:19.443236 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.443226 2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 07:59:19.444480 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.444468 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 03 07:59:19.444586 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.444577 2575 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 07:59:19.446379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.446361 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 07:59:19.446842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.446832 2575 kubelet.go:491] "Attempting to sync node with API server" Jun 03 07:59:19.446888 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.446846 2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 07:59:19.446888 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.446857 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 07:59:19.446888 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.446866 2575 kubelet.go:397] "Adding apiserver pod source" Jun 03 07:59:19.446888 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.446875 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 07:59:19.448017 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.448004 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 07:59:19.448074 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.448023 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 07:59:19.451518 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.451501 2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 07:59:19.454205 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.454184 2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 07:59:19.457041 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:19.457019 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 07:59:19.457112 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:19.457023 2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 07:59:19.457950 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.457934 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 07:59:19.458027 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.457957 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 07:59:19.458027 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.457966 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 07:59:19.458027 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.457975 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 07:59:19.458027 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.457988 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 07:59:19.458027 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.457997 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 07:59:19.458027 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.458005 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 07:59:19.458027 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.458014 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 07:59:19.458027 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.458024 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 07:59:19.458293 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.458034 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 07:59:19.458293 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.458046 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 07:59:19.458293 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.458056 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 07:59:19.458922 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.458911 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 07:59:19.458977 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.458925 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 07:59:19.461677 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.461658 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nbqpk" Jun 03 07:59:19.461842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.461829 2575 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 07:59:19.461912 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.461902 2575 server.go:1295] "Started kubelet" Jun 03 07:59:19.461984 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.461958 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 07:59:19.462078 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.462035 2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 07:59:19.462131 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.462099 2575 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 07:59:19.462353 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.461974 2575 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-28.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 07:59:19.462588 ip-10-0-128-28 systemd[1]: Started Kubernetes Kubelet. Jun 03 07:59:19.463137 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.463122 2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 07:59:19.464834 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.464815 2575 server.go:317] "Adding debug handlers to kubelet server" Jun 03 07:59:19.467733 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.467715 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 07:59:19.468260 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.468243 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 07:59:19.468479 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.468459 2575 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 07:59:19.468479 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.468477 2575 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 07:59:19.468626 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.468613 2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 07:59:19.468688 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.468677 2575 reconstruct.go:97] "Volume reconstruction finished" Jun 03 07:59:19.468739 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.468685 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nbqpk" Jun 03 07:59:19.468739 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.468690 2575 reconciler.go:26] "Reconciler: start to sync state" Jun 03 07:59:19.469109 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.469093 2575 factory.go:55] Registering systemd factory Jun 03 07:59:19.469109 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:19.469101 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found" Jun 03 07:59:19.469235 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.469112 2575 factory.go:223] Registration of the systemd container factory successfully Jun 03 07:59:19.469389 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.469375 2575 factory.go:153] Registering CRI-O factory Jun 03 07:59:19.469461 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.469410 2575 factory.go:223] Registration of the crio container factory successfully Jun 03 07:59:19.469520 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.469479 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 07:59:19.469520 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.469497 2575 factory.go:103] Registering Raw factory Jun 03 07:59:19.469520 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.469511 2575 manager.go:1196] Started watching for new ooms in manager Jun 03 07:59:19.469898 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:19.469876 2575 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 07:59:19.470166 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.470147 2575 manager.go:319] Starting recovery of all containers Jun 03 07:59:19.475620 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.475599 2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 07:59:19.476625 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.476583 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 07:59:19.480915 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:19.480891 2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-28.ec2.internal\" not found" node="ip-10-0-128-28.ec2.internal" Jun 03 07:59:19.482955 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.482864 2575 manager.go:324] Recovery completed Jun 03 07:59:19.486192 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:19.486170 2575 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 03 07:59:19.489040 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.489028 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 07:59:19.492349 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.492336 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientMemory" Jun 03 07:59:19.492456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.492359 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 07:59:19.492456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.492371 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientPID" Jun 03 07:59:19.492770 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.492754 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 07:59:19.492770 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.492764 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 07:59:19.492877 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.492793 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 03 07:59:19.494635 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.494625 2575 policy_none.go:49] "None policy: Start" Jun 03 07:59:19.494672 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.494640 2575 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 07:59:19.494672 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.494650 2575 state_mem.go:35] "Initializing new in-memory state store" Jun 03 07:59:19.532011 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.531980 2575 manager.go:341] "Starting Device Plugin manager" Jun 03 07:59:19.543276 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:19.532037 2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 07:59:19.543276 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.532049 2575 server.go:85] "Starting device plugin registration server" Jun 03 07:59:19.543276 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.532261 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 07:59:19.543276 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.532273 2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 07:59:19.543276 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.532343 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 07:59:19.543276 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.532419 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 07:59:19.543276 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.532427 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 07:59:19.543276 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:19.532948 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 07:59:19.543276 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:19.532983 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-28.ec2.internal\" not found" Jun 03 07:59:19.602444 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.602418 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 07:59:19.602518 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.602471 2575 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 07:59:19.602518 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.602492 2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 07:59:19.602518 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.602498 2575 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 07:59:19.602608 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:19.602533 2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 07:59:19.605008 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.604987 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 07:59:19.633294 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.633251 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 07:59:19.633959 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.633945 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientMemory" Jun 03 07:59:19.634041 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.633974 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 07:59:19.634041 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.633988 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientPID" Jun 03 07:59:19.634041 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.634015 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-28.ec2.internal" Jun 03 07:59:19.643268 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.643248 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-28.ec2.internal" Jun 03 07:59:19.643357 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:19.643270 2575 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-28.ec2.internal\": node \"ip-10-0-128-28.ec2.internal\" not found" Jun 03 07:59:19.657599 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:19.657582 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found" Jun 03 07:59:19.703859 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.703834 2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal"] Jun 03 07:59:19.703940 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.703894 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 07:59:19.704598 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.704583 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientMemory" Jun 03 07:59:19.704683 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.704609 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 07:59:19.704683 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.704620 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientPID" Jun 03 07:59:19.705691 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.705679 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 07:59:19.705844 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.705830 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal" Jun 03 07:59:19.705937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.705863 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 07:59:19.706360 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.706345 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientMemory" Jun 03 07:59:19.706360 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.706353 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientMemory" Jun 03 07:59:19.706475 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.706375 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 07:59:19.706475 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.706387 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientPID" Jun 03 07:59:19.706475 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.706375 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 07:59:19.706475 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.706467 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientPID" Jun 03 07:59:19.707304 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.707290 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal" Jun 03 07:59:19.707346 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.707323 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 07:59:19.708042 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.708019 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientMemory" Jun 03 07:59:19.708100 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.708051 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 07:59:19.708100 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.708076 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientPID" Jun 03 07:59:19.736966 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:19.736950 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-28.ec2.internal\" not found" node="ip-10-0-128-28.ec2.internal" Jun 03 07:59:19.741023 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:19.741007 2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-28.ec2.internal\" not found" node="ip-10-0-128-28.ec2.internal" Jun 03 07:59:19.757688 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:19.757672 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found" Jun 03 07:59:19.771278 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.771262 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60d9a94fe0fb6badc03a89f43c34129d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal\" (UID: \"60d9a94fe0fb6badc03a89f43c34129d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal" Jun 03 07:59:19.771326 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.771285 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60d9a94fe0fb6badc03a89f43c34129d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal\" (UID: \"60d9a94fe0fb6badc03a89f43c34129d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal" Jun 03 07:59:19.771326 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.771301 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/23d8c441f7d9cf4fc58ff38513145034-config\") pod \"kube-apiserver-proxy-ip-10-0-128-28.ec2.internal\" (UID: \"23d8c441f7d9cf4fc58ff38513145034\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal" Jun 03 07:59:19.857921 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:19.857893 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found" Jun 03 07:59:19.872238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.872216 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60d9a94fe0fb6badc03a89f43c34129d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal\" (UID: \"60d9a94fe0fb6badc03a89f43c34129d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal" Jun 03 07:59:19.872314 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.872281 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60d9a94fe0fb6badc03a89f43c34129d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal\" (UID: \"60d9a94fe0fb6badc03a89f43c34129d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal" Jun 03 07:59:19.872373 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.872309 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/23d8c441f7d9cf4fc58ff38513145034-config\") pod \"kube-apiserver-proxy-ip-10-0-128-28.ec2.internal\" (UID: \"23d8c441f7d9cf4fc58ff38513145034\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal" Jun 03 07:59:19.872373 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.872312 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60d9a94fe0fb6badc03a89f43c34129d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal\" (UID: \"60d9a94fe0fb6badc03a89f43c34129d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal" Jun 03 07:59:19.872373 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.872346 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60d9a94fe0fb6badc03a89f43c34129d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal\" (UID: \"60d9a94fe0fb6badc03a89f43c34129d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal" Jun 03 07:59:19.872373 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:19.872369 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/23d8c441f7d9cf4fc58ff38513145034-config\") pod \"kube-apiserver-proxy-ip-10-0-128-28.ec2.internal\" (UID: \"23d8c441f7d9cf4fc58ff38513145034\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal" Jun 03 07:59:19.958645 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:19.958608 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found" Jun 03 07:59:20.039082 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:20.039055 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal" Jun 03 07:59:20.044507 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:20.044487 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal" Jun 03 07:59:20.059700 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:20.059682 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found" Jun 03 07:59:20.160238 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:20.160213 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found" Jun 03 07:59:20.260755 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:20.260689 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found" Jun 03 07:59:20.361353 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:20.361328 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found" Jun 03 07:59:20.383759 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:20.383733 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 07:59:20.384180 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:20.383866 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 07:59:20.384180 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:20.383914 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 07:59:20.462256 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:20.462228 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found" Jun 03 07:59:20.468825 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:20.468465 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 07:59:20.470648 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:20.470615 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 07:54:19 +0000 UTC" deadline="2027-11-19 18:57:01.131900563 +0000 UTC" Jun 03 07:59:20.470648 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:20.470648 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12826h57m40.661256827s" Jun 03 07:59:20.480018 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:20.480000 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 07:59:20.506597 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:20.506576 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5r2kr" Jun 03 07:59:20.511866 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:20.511816 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5r2kr" Jun 03 07:59:20.562875 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:20.562853 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found" Jun 03 07:59:20.563719 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:20.563698 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d8c441f7d9cf4fc58ff38513145034.slice/crio-e654361a39955eae38c49b0dad73b046463decaa1fff248962e52c05fb7cc5ba WatchSource:0}: Error finding container e654361a39955eae38c49b0dad73b046463decaa1fff248962e52c05fb7cc5ba: Status 404 returned error can't find the container with id e654361a39955eae38c49b0dad73b046463decaa1fff248962e52c05fb7cc5ba Jun 03 07:59:20.563923 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:20.563910 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d9a94fe0fb6badc03a89f43c34129d.slice/crio-42dd6d9bd39a068317838a7695ec7e31d4ee427f05f982a966d95bbbea89129b WatchSource:0}: Error finding container 42dd6d9bd39a068317838a7695ec7e31d4ee427f05f982a966d95bbbea89129b: Status 404 returned error can't find the container with id 42dd6d9bd39a068317838a7695ec7e31d4ee427f05f982a966d95bbbea89129b Jun 03 07:59:20.567906 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:20.567893 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 07:59:20.605152 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:20.605106 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal" event={"ID":"23d8c441f7d9cf4fc58ff38513145034","Type":"ContainerStarted","Data":"e654361a39955eae38c49b0dad73b046463decaa1fff248962e52c05fb7cc5ba"} Jun 03 07:59:20.605973 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:20.605954 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal" event={"ID":"60d9a94fe0fb6badc03a89f43c34129d","Type":"ContainerStarted","Data":"42dd6d9bd39a068317838a7695ec7e31d4ee427f05f982a966d95bbbea89129b"} Jun 03 07:59:20.663118 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:20.663102 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found" Jun 03 07:59:20.763575 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:20.763532 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found" Jun 03 07:59:20.864004 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:20.863982 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found" Jun 03 07:59:20.884064 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:20.884047 2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 07:59:20.964743 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:20.964723 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found" Jun 03 07:59:20.999922 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:20.999903 2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 07:59:21.069539 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.069476 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal" Jun 03 07:59:21.079857 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.079832 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 07:59:21.084954 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.084863 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal" Jun 03 07:59:21.092320 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.092299 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 07:59:21.361423 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.361347 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 07:59:21.448325 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.448295 2575 apiserver.go:52] "Watching apiserver" Jun 03 07:59:21.453196 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.453174 2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 07:59:21.453623 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.453597 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx","openshift-cluster-node-tuning-operator/tuned-r2hph","openshift-multus/multus-additional-cni-plugins-k8llk","openshift-multus/network-metrics-daemon-rqpqj","openshift-network-diagnostics/network-check-target-dd4vj","openshift-network-operator/iptables-alerter-9bgfk","openshift-dns/node-resolver-dgbmm","openshift-image-registry/node-ca-wpg8p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal","openshift-multus/multus-dxqvm","openshift-ovn-kubernetes/ovnkube-node-n47h8","kube-system/konnectivity-agent-l5qvl"] Jun 03 07:59:21.455186 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.455018 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9bgfk" Jun 03 07:59:21.456127 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.456022 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.457062 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.457041 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.457230 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.457210 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cp7xl\"" Jun 03 07:59:21.457558 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.457415 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 07:59:21.457558 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.457427 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 07:59:21.457700 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.457559 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 07:59:21.459117 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.458462 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cltrw\"" Jun 03 07:59:21.459117 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.458462 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 07:59:21.459117 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.458540 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 07:59:21.459117 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.458547 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 07:59:21.459117 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.458762 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 07:59:21.459117 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.458941 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 07:59:21.459117 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.458966 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fjqlq\"" Jun 03 07:59:21.460416 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.460371 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.460737 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.460672 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:21.460817 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:21.460763 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 07:59:21.461804 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.461785 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:21.461891 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:21.461854 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd4vj" podUID="0dbef335-62ed-405a-a0d5-74cc429ec15e" Jun 03 07:59:21.462056 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.462027 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 07:59:21.462469 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.462244 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 07:59:21.462469 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.462282 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 07:59:21.462469 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.462355 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 07:59:21.462659 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.462531 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-stgtl\"" Jun 03 07:59:21.462659 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.462571 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 07:59:21.463423 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.463219 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dgbmm" Jun 03 07:59:21.465117 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.464844 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 07:59:21.465206 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.465169 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h5scv\"" Jun 03 07:59:21.465260 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.465201 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 07:59:21.468191 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.468164 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wpg8p" Jun 03 07:59:21.469716 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.469695 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.469950 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.469928 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 07:59:21.470361 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.470343 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 07:59:21.471074 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.470608 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 07:59:21.471074 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.470915 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-97k94\"" Jun 03 07:59:21.471908 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.471710 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t4vb7\"" Jun 03 07:59:21.472053 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.472031 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 07:59:21.472409 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.472390 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.474101 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.474082 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l5qvl" Jun 03 07:59:21.474565 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.474546 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 07:59:21.474658 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.474640 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 07:59:21.474821 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.474804 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pnzfr\"" Jun 03 07:59:21.474875 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.474863 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 07:59:21.475011 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.474997 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 07:59:21.475238 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.475222 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 07:59:21.475358 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.475340 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 07:59:21.475859 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.475840 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5c85t\"" Jun 03 07:59:21.475952 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.475849 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 07:59:21.476138 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.476116 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 07:59:21.482535 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.482512 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-var-lib-kubelet\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.482640 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.482550 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-node-log\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.482640 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.482574 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39d791cc-5930-4e19-a8db-498ce4237bf2-ovn-node-metrics-cert\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.482640 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.482600 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-kubernetes\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.482640 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.482621 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs\") pod \"network-metrics-daemon-rqpqj\" (UID: \"d56b198a-8bb2-4f98-9300-d4dffff20c44\") " pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:21.482827 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.482647 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f787947a-a855-4f90-ac17-9d832a9748aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.482827 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.482672 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.482827 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.482697 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-var-lib-kubelet\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.482827 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.482796 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjdlb\" (UniqueName: \"kubernetes.io/projected/d56b198a-8bb2-4f98-9300-d4dffff20c44-kube-api-access-wjdlb\") pod \"network-metrics-daemon-rqpqj\" (UID: \"d56b198a-8bb2-4f98-9300-d4dffff20c44\") " pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:21.483020 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.482847 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f787947a-a855-4f90-ac17-9d832a9748aa-system-cni-dir\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.483020 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.482872 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-699c2\" (UniqueName: \"kubernetes.io/projected/39d791cc-5930-4e19-a8db-498ce4237bf2-kube-api-access-699c2\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.483020 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.482911 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-lib-modules\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.483020 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.482973 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-cnibin\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.483020 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.482997 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-os-release\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.483303 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483036 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dlq9\" (UniqueName: \"kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9\") pod \"network-check-target-dd4vj\" (UID: \"0dbef335-62ed-405a-a0d5-74cc429ec15e\") " pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:21.483303 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483061 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.483303 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483134 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-etc-selinux\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.483303 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483163 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-sysctl-conf\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.483303 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483186 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-sys\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.483303 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483208 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f2cf176-8955-4aeb-a63e-5c75c3c73886-host\") pod \"node-ca-wpg8p\" (UID: \"6f2cf176-8955-4aeb-a63e-5c75c3c73886\") " pod="openshift-image-registry/node-ca-wpg8p" Jun 03 07:59:21.483303 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483233 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-multus-conf-dir\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.483303 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483260 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgzkr\" (UniqueName: \"kubernetes.io/projected/f787947a-a855-4f90-ac17-9d832a9748aa-kube-api-access-dgzkr\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.483303 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483285 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-run-systemd\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.483303 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483307 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-run-ovn\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.483762 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483329 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-host\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.483762 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483366 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-var-lib-cni-multus\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.483762 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483395 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-hostroot\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.483762 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-kubelet\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.483762 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483476 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-cni-bin\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.483762 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483512 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5scm8\" (UniqueName: \"kubernetes.io/projected/050f3ecb-7b61-4926-b709-60dfcc68e7a3-kube-api-access-5scm8\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.483762 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483539 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrdxn\" (UniqueName: \"kubernetes.io/projected/8e98347d-1bbd-4bf5-84fc-9d8a4386606c-kube-api-access-lrdxn\") pod \"node-resolver-dgbmm\" (UID: \"8e98347d-1bbd-4bf5-84fc-9d8a4386606c\") " pod="openshift-dns/node-resolver-dgbmm" Jun 03 07:59:21.483762 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483560 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-run-netns\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.483762 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483596 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-device-dir\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.483762 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483642 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsb66\" (UniqueName: \"kubernetes.io/projected/6f2cf176-8955-4aeb-a63e-5c75c3c73886-kube-api-access-rsb66\") pod \"node-ca-wpg8p\" (UID: \"6f2cf176-8955-4aeb-a63e-5c75c3c73886\") " pod="openshift-image-registry/node-ca-wpg8p" Jun 03 07:59:21.483762 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483667 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f787947a-a855-4f90-ac17-9d832a9748aa-os-release\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.483762 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483692 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-run-ovn-kubernetes\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.483762 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-cni-netd\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.483762 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483738 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39d791cc-5930-4e19-a8db-498ce4237bf2-ovnkube-config\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.483762 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483758 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39d791cc-5930-4e19-a8db-498ce4237bf2-ovnkube-script-lib\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.484386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483796 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-modprobe-d\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.484386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483839 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-sysconfig\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.484386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483859 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e98347d-1bbd-4bf5-84fc-9d8a4386606c-tmp-dir\") pod \"node-resolver-dgbmm\" (UID: \"8e98347d-1bbd-4bf5-84fc-9d8a4386606c\") " pod="openshift-dns/node-resolver-dgbmm" Jun 03 07:59:21.484386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483874 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-etc-kubernetes\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.484386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483899 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-etc-openvswitch\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.484386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483923 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-system-cni-dir\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.484386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbn2t\" (UniqueName: \"kubernetes.io/projected/efd627d9-3a4c-4826-814c-08197e84cfb2-kube-api-access-gbn2t\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.484386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483959 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-socket-dir\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.484386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483975 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwzzw\" (UniqueName: \"kubernetes.io/projected/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-kube-api-access-xwzzw\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.484386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.483990 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-systemd\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.484386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484004 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e98347d-1bbd-4bf5-84fc-9d8a4386606c-hosts-file\") pod \"node-resolver-dgbmm\" (UID: \"8e98347d-1bbd-4bf5-84fc-9d8a4386606c\") " pod="openshift-dns/node-resolver-dgbmm" Jun 03 07:59:21.484386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/efd627d9-3a4c-4826-814c-08197e84cfb2-multus-daemon-config\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.484386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484039 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-run-multus-certs\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.484386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484058 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-sys-fs\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.484386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484104 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-run-k8s-cni-cncf-io\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.484386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484141 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-run-netns\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.484386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484180 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-systemd-units\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.485244 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484224 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-slash\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.485244 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484259 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-tuned\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.485244 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484278 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f2cf176-8955-4aeb-a63e-5c75c3c73886-serviceca\") pod \"node-ca-wpg8p\" (UID: \"6f2cf176-8955-4aeb-a63e-5c75c3c73886\") " pod="openshift-image-registry/node-ca-wpg8p" Jun 03 07:59:21.485244 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efd627d9-3a4c-4826-814c-08197e84cfb2-cni-binary-copy\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.485244 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484322 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f90b753a-1b54-478c-812a-e8d590c0ab53-iptables-alerter-script\") pod \"iptables-alerter-9bgfk\" (UID: \"f90b753a-1b54-478c-812a-e8d590c0ab53\") " pod="openshift-network-operator/iptables-alerter-9bgfk" Jun 03 07:59:21.485244 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484347 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f787947a-a855-4f90-ac17-9d832a9748aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.485244 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39d791cc-5930-4e19-a8db-498ce4237bf2-env-overrides\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.485244 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484395 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-multus-socket-dir-parent\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.485244 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484428 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-run-openvswitch\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.485244 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484466 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-log-socket\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.485244 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484489 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-registration-dir\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.485244 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484517 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/050f3ecb-7b61-4926-b709-60dfcc68e7a3-tmp\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.485244 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484547 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-var-lib-cni-bin\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.485244 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r8q8\" (UniqueName: \"kubernetes.io/projected/f90b753a-1b54-478c-812a-e8d590c0ab53-kube-api-access-5r8q8\") pod \"iptables-alerter-9bgfk\" (UID: \"f90b753a-1b54-478c-812a-e8d590c0ab53\") " pod="openshift-network-operator/iptables-alerter-9bgfk" Jun 03 07:59:21.485244 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484597 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f787947a-a855-4f90-ac17-9d832a9748aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.485244 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484620 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-var-lib-openvswitch\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.485987 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484673 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-sysctl-d\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.485987 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484698 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f90b753a-1b54-478c-812a-e8d590c0ab53-host-slash\") pod \"iptables-alerter-9bgfk\" (UID: \"f90b753a-1b54-478c-812a-e8d590c0ab53\") " pod="openshift-network-operator/iptables-alerter-9bgfk" Jun 03 07:59:21.485987 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484756 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f787947a-a855-4f90-ac17-9d832a9748aa-cnibin\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.485987 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484779 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f787947a-a855-4f90-ac17-9d832a9748aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.485987 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484823 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-run\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.485987 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.484840 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-multus-cni-dir\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.512508 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.512478 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 07:54:20 +0000 UTC" deadline="2027-11-03 01:45:25.762676256 +0000 UTC" Jun 03 07:59:21.512597 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.512508 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12425h46m4.250171675s" Jun 03 07:59:21.569508 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.569480 2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 07:59:21.585195 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585166 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/050f3ecb-7b61-4926-b709-60dfcc68e7a3-tmp\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.585318 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585204 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-var-lib-cni-bin\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.585318 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585227 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5r8q8\" (UniqueName: \"kubernetes.io/projected/f90b753a-1b54-478c-812a-e8d590c0ab53-kube-api-access-5r8q8\") pod \"iptables-alerter-9bgfk\" (UID: \"f90b753a-1b54-478c-812a-e8d590c0ab53\") " pod="openshift-network-operator/iptables-alerter-9bgfk" Jun 03 07:59:21.585318 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585288 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-var-lib-cni-bin\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.585481 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585408 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f787947a-a855-4f90-ac17-9d832a9748aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.585481 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585464 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-var-lib-openvswitch\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.585575 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585482 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-sysctl-d\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.585575 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585498 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f90b753a-1b54-478c-812a-e8d590c0ab53-host-slash\") pod \"iptables-alerter-9bgfk\" (UID: \"f90b753a-1b54-478c-812a-e8d590c0ab53\") " pod="openshift-network-operator/iptables-alerter-9bgfk" Jun 03 07:59:21.585575 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585515 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f787947a-a855-4f90-ac17-9d832a9748aa-cnibin\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.585575 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585561 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 07:59:21.585575 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585569 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f90b753a-1b54-478c-812a-e8d590c0ab53-host-slash\") pod \"iptables-alerter-9bgfk\" (UID: \"f90b753a-1b54-478c-812a-e8d590c0ab53\") " pod="openshift-network-operator/iptables-alerter-9bgfk" Jun 03 07:59:21.585801 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585574 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-var-lib-openvswitch\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.585801 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585577 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f787947a-a855-4f90-ac17-9d832a9748aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.585801 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585613 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-run\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.585801 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585615 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f787947a-a855-4f90-ac17-9d832a9748aa-cnibin\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.585801 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585599 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f787947a-a855-4f90-ac17-9d832a9748aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.585801 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585643 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-multus-cni-dir\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.585801 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585666 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-var-lib-kubelet\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.585801 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585666 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-sysctl-d\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.585801 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585683 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-run\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.585801 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585689 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-node-log\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.585801 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585713 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39d791cc-5930-4e19-a8db-498ce4237bf2-ovn-node-metrics-cert\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.585801 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585727 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-var-lib-kubelet\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.585801 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585737 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-kubernetes\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.585801 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585763 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs\") pod \"network-metrics-daemon-rqpqj\" (UID: \"d56b198a-8bb2-4f98-9300-d4dffff20c44\") " pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:21.585801 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585778 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-node-log\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.585801 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585788 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-multus-cni-dir\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.585801 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585789 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f787947a-a855-4f90-ac17-9d832a9748aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.586608 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585824 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.586608 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585834 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-kubernetes\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.586608 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585852 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-var-lib-kubelet\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.586608 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585878 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjdlb\" (UniqueName: \"kubernetes.io/projected/d56b198a-8bb2-4f98-9300-d4dffff20c44-kube-api-access-wjdlb\") pod \"network-metrics-daemon-rqpqj\" (UID: \"d56b198a-8bb2-4f98-9300-d4dffff20c44\") " pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:21.586608 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585901 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f787947a-a855-4f90-ac17-9d832a9748aa-system-cni-dir\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.586608 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:21.585924 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 07:59:21.586608 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:21.585999 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs podName:d56b198a-8bb2-4f98-9300-d4dffff20c44 nodeName:}" failed. No retries permitted until 2026-06-03 07:59:22.085976968 +0000 UTC m=+3.065319875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs") pod "network-metrics-daemon-rqpqj" (UID: "d56b198a-8bb2-4f98-9300-d4dffff20c44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 07:59:21.586608 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.585925 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-699c2\" (UniqueName: \"kubernetes.io/projected/39d791cc-5930-4e19-a8db-498ce4237bf2-kube-api-access-699c2\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.586608 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586118 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-lib-modules\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.586608 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586145 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-cnibin\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.586608 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586146 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f787947a-a855-4f90-ac17-9d832a9748aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.586608 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586177 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-os-release\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.586608 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586222 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dlq9\" (UniqueName: \"kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9\") pod \"network-check-target-dd4vj\" (UID: \"0dbef335-62ed-405a-a0d5-74cc429ec15e\") " pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:21.586608 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586236 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-os-release\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.586608 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586224 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f787947a-a855-4f90-ac17-9d832a9748aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.586608 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586273 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-var-lib-kubelet\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.586608 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586305 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586328 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-etc-selinux\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586348 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-sysctl-conf\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586360 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-lib-modules\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586369 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-sys\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586389 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f2cf176-8955-4aeb-a63e-5c75c3c73886-host\") pod \"node-ca-wpg8p\" (UID: \"6f2cf176-8955-4aeb-a63e-5c75c3c73886\") " pod="openshift-image-registry/node-ca-wpg8p" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586407 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-cnibin\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586410 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-multus-conf-dir\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586461 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-multus-conf-dir\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586462 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dgzkr\" (UniqueName: \"kubernetes.io/projected/f787947a-a855-4f90-ac17-9d832a9748aa-kube-api-access-dgzkr\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586493 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-run-systemd\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586507 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f787947a-a855-4f90-ac17-9d832a9748aa-system-cni-dir\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586513 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-run-ovn\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586551 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-run-ovn\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586556 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-host\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586583 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-var-lib-cni-multus\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586595 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-sys\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586605 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-sysctl-conf\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.587379 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586607 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-hostroot\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.588159 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586647 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-hostroot\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.588159 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586647 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-kubelet\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.588159 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586678 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-kubelet\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.588159 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586683 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.588159 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586680 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-cni-bin\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.588159 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586694 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-var-lib-cni-multus\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.588159 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586711 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-cni-bin\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.588159 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586726 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-host\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.588159 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586731 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.588159 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586641 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-run-systemd\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.588159 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586758 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5scm8\" (UniqueName: \"kubernetes.io/projected/050f3ecb-7b61-4926-b709-60dfcc68e7a3-kube-api-access-5scm8\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.588159 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586764 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f2cf176-8955-4aeb-a63e-5c75c3c73886-host\") pod \"node-ca-wpg8p\" (UID: \"6f2cf176-8955-4aeb-a63e-5c75c3c73886\") " pod="openshift-image-registry/node-ca-wpg8p" Jun 03 07:59:21.588159 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586785 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lrdxn\" (UniqueName: \"kubernetes.io/projected/8e98347d-1bbd-4bf5-84fc-9d8a4386606c-kube-api-access-lrdxn\") pod \"node-resolver-dgbmm\" (UID: \"8e98347d-1bbd-4bf5-84fc-9d8a4386606c\") " pod="openshift-dns/node-resolver-dgbmm" Jun 03 07:59:21.588159 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586794 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-etc-selinux\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.588159 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586826 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5433f7ef-1518-4ece-8406-614de4489441-agent-certs\") pod \"konnectivity-agent-l5qvl\" (UID: \"5433f7ef-1518-4ece-8406-614de4489441\") " pod="kube-system/konnectivity-agent-l5qvl" Jun 03 07:59:21.588159 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586851 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5433f7ef-1518-4ece-8406-614de4489441-konnectivity-ca\") pod \"konnectivity-agent-l5qvl\" (UID: \"5433f7ef-1518-4ece-8406-614de4489441\") " pod="kube-system/konnectivity-agent-l5qvl" Jun 03 07:59:21.588159 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586878 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-run-netns\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.588842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586909 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-device-dir\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.588842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586924 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-run-netns\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.588842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586932 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsb66\" (UniqueName: \"kubernetes.io/projected/6f2cf176-8955-4aeb-a63e-5c75c3c73886-kube-api-access-rsb66\") pod \"node-ca-wpg8p\" (UID: \"6f2cf176-8955-4aeb-a63e-5c75c3c73886\") " pod="openshift-image-registry/node-ca-wpg8p" Jun 03 07:59:21.588842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586958 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f787947a-a855-4f90-ac17-9d832a9748aa-os-release\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.588842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586977 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-device-dir\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.588842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.586982 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-run-ovn-kubernetes\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.588842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587014 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-cni-netd\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.588842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587018 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-run-ovn-kubernetes\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.588842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587046 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39d791cc-5930-4e19-a8db-498ce4237bf2-ovnkube-config\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.588842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587054 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-cni-netd\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.588842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587070 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39d791cc-5930-4e19-a8db-498ce4237bf2-ovnkube-script-lib\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.588842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587083 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f787947a-a855-4f90-ac17-9d832a9748aa-os-release\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.588842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587109 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-modprobe-d\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.588842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587133 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-sysconfig\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.588842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587157 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e98347d-1bbd-4bf5-84fc-9d8a4386606c-tmp-dir\") pod \"node-resolver-dgbmm\" (UID: \"8e98347d-1bbd-4bf5-84fc-9d8a4386606c\") " pod="openshift-dns/node-resolver-dgbmm" Jun 03 07:59:21.588842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587181 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-etc-kubernetes\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.588842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587197 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-sysconfig\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587206 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-etc-openvswitch\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587218 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-modprobe-d\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587232 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-system-cni-dir\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587260 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gbn2t\" (UniqueName: \"kubernetes.io/projected/efd627d9-3a4c-4826-814c-08197e84cfb2-kube-api-access-gbn2t\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587285 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-socket-dir\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587285 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-etc-kubernetes\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587333 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-system-cni-dir\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587348 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-etc-openvswitch\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587376 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xwzzw\" (UniqueName: \"kubernetes.io/projected/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-kube-api-access-xwzzw\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587471 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-socket-dir\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587497 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e98347d-1bbd-4bf5-84fc-9d8a4386606c-tmp-dir\") pod \"node-resolver-dgbmm\" (UID: \"8e98347d-1bbd-4bf5-84fc-9d8a4386606c\") " pod="openshift-dns/node-resolver-dgbmm" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587518 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-systemd\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587553 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e98347d-1bbd-4bf5-84fc-9d8a4386606c-hosts-file\") pod \"node-resolver-dgbmm\" (UID: \"8e98347d-1bbd-4bf5-84fc-9d8a4386606c\") " pod="openshift-dns/node-resolver-dgbmm" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587564 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-systemd\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587588 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/efd627d9-3a4c-4826-814c-08197e84cfb2-multus-daemon-config\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587637 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e98347d-1bbd-4bf5-84fc-9d8a4386606c-hosts-file\") pod \"node-resolver-dgbmm\" (UID: \"8e98347d-1bbd-4bf5-84fc-9d8a4386606c\") " pod="openshift-dns/node-resolver-dgbmm" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587660 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39d791cc-5930-4e19-a8db-498ce4237bf2-ovnkube-config\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.589630 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587692 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-run-multus-certs\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.590456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587730 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-run-multus-certs\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.590456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587738 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-sys-fs\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.590456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587767 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-run-k8s-cni-cncf-io\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.590456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587792 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-run-netns\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.590456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587811 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-sys-fs\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.590456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587817 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-systemd-units\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.590456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587877 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-slash\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.590456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587925 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-tuned\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.590456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587952 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f2cf176-8955-4aeb-a63e-5c75c3c73886-serviceca\") pod \"node-ca-wpg8p\" (UID: \"6f2cf176-8955-4aeb-a63e-5c75c3c73886\") " pod="openshift-image-registry/node-ca-wpg8p" Jun 03 07:59:21.590456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587970 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39d791cc-5930-4e19-a8db-498ce4237bf2-ovnkube-script-lib\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.590456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.587999 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efd627d9-3a4c-4826-814c-08197e84cfb2-cni-binary-copy\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.590456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588022 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-host-slash\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.590456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588027 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f90b753a-1b54-478c-812a-e8d590c0ab53-iptables-alerter-script\") pod \"iptables-alerter-9bgfk\" (UID: \"f90b753a-1b54-478c-812a-e8d590c0ab53\") " pod="openshift-network-operator/iptables-alerter-9bgfk" Jun 03 07:59:21.590456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588057 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-systemd-units\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.590456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588079 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f787947a-a855-4f90-ac17-9d832a9748aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.590456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588085 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-run-k8s-cni-cncf-io\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.590456 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588123 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-host-run-netns\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.591035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588154 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39d791cc-5930-4e19-a8db-498ce4237bf2-env-overrides\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.591035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588216 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/efd627d9-3a4c-4826-814c-08197e84cfb2-multus-daemon-config\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.591035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588589 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efd627d9-3a4c-4826-814c-08197e84cfb2-cni-binary-copy\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.591035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588659 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f2cf176-8955-4aeb-a63e-5c75c3c73886-serviceca\") pod \"node-ca-wpg8p\" (UID: \"6f2cf176-8955-4aeb-a63e-5c75c3c73886\") " pod="openshift-image-registry/node-ca-wpg8p" Jun 03 07:59:21.591035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588790 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-multus-socket-dir-parent\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.591035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588818 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-run-openvswitch\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.591035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588840 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-log-socket\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.591035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588862 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-registration-dir\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.591035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588868 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/efd627d9-3a4c-4826-814c-08197e84cfb2-multus-socket-dir-parent\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.591035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588932 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-run-openvswitch\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.591035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588981 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-registration-dir\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.591035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588983 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39d791cc-5930-4e19-a8db-498ce4237bf2-log-socket\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.591035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.588819 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f90b753a-1b54-478c-812a-e8d590c0ab53-iptables-alerter-script\") pod \"iptables-alerter-9bgfk\" (UID: \"f90b753a-1b54-478c-812a-e8d590c0ab53\") " pod="openshift-network-operator/iptables-alerter-9bgfk" Jun 03 07:59:21.591035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.589473 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/050f3ecb-7b61-4926-b709-60dfcc68e7a3-tmp\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.591035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.589784 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f787947a-a855-4f90-ac17-9d832a9748aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.591035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.590043 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39d791cc-5930-4e19-a8db-498ce4237bf2-env-overrides\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.591035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.590469 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39d791cc-5930-4e19-a8db-498ce4237bf2-ovn-node-metrics-cert\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.591867 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.590757 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/050f3ecb-7b61-4926-b709-60dfcc68e7a3-etc-tuned\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.593009 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.592991 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r8q8\" (UniqueName: \"kubernetes.io/projected/f90b753a-1b54-478c-812a-e8d590c0ab53-kube-api-access-5r8q8\") pod \"iptables-alerter-9bgfk\" (UID: \"f90b753a-1b54-478c-812a-e8d590c0ab53\") " pod="openshift-network-operator/iptables-alerter-9bgfk" Jun 03 07:59:21.594824 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:21.594803 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 07:59:21.594937 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:21.594829 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 07:59:21.594937 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.594825 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-699c2\" (UniqueName: \"kubernetes.io/projected/39d791cc-5930-4e19-a8db-498ce4237bf2-kube-api-access-699c2\") pod \"ovnkube-node-n47h8\" (UID: \"39d791cc-5930-4e19-a8db-498ce4237bf2\") " pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.594937 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:21.594841 2575 projected.go:194] Error preparing data for projected volume kube-api-access-4dlq9 for pod openshift-network-diagnostics/network-check-target-dd4vj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 07:59:21.594937 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:21.594910 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9 podName:0dbef335-62ed-405a-a0d5-74cc429ec15e nodeName:}" failed. No retries permitted until 2026-06-03 07:59:22.094893873 +0000 UTC m=+3.074236778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4dlq9" (UniqueName: "kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9") pod "network-check-target-dd4vj" (UID: "0dbef335-62ed-405a-a0d5-74cc429ec15e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 07:59:21.596306 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.596084 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5scm8\" (UniqueName: \"kubernetes.io/projected/050f3ecb-7b61-4926-b709-60dfcc68e7a3-kube-api-access-5scm8\") pod \"tuned-r2hph\" (UID: \"050f3ecb-7b61-4926-b709-60dfcc68e7a3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.596306 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.596272 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjdlb\" (UniqueName: \"kubernetes.io/projected/d56b198a-8bb2-4f98-9300-d4dffff20c44-kube-api-access-wjdlb\") pod \"network-metrics-daemon-rqpqj\" (UID: \"d56b198a-8bb2-4f98-9300-d4dffff20c44\") " pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:21.597082 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.597057 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwzzw\" (UniqueName: \"kubernetes.io/projected/1cfa20b7-84b5-4070-aa99-5b03fc3cb859-kube-api-access-xwzzw\") pod \"aws-ebs-csi-driver-node-7gnrx\" (UID: \"1cfa20b7-84b5-4070-aa99-5b03fc3cb859\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.597396 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.597264 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsb66\" (UniqueName: \"kubernetes.io/projected/6f2cf176-8955-4aeb-a63e-5c75c3c73886-kube-api-access-rsb66\") pod \"node-ca-wpg8p\" (UID: \"6f2cf176-8955-4aeb-a63e-5c75c3c73886\") " pod="openshift-image-registry/node-ca-wpg8p" Jun 03 07:59:21.597655 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.597597 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbn2t\" (UniqueName: \"kubernetes.io/projected/efd627d9-3a4c-4826-814c-08197e84cfb2-kube-api-access-gbn2t\") pod \"multus-dxqvm\" (UID: \"efd627d9-3a4c-4826-814c-08197e84cfb2\") " pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.598209 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.598187 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgzkr\" (UniqueName: \"kubernetes.io/projected/f787947a-a855-4f90-ac17-9d832a9748aa-kube-api-access-dgzkr\") pod \"multus-additional-cni-plugins-k8llk\" (UID: \"f787947a-a855-4f90-ac17-9d832a9748aa\") " pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.598696 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.598667 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrdxn\" (UniqueName: \"kubernetes.io/projected/8e98347d-1bbd-4bf5-84fc-9d8a4386606c-kube-api-access-lrdxn\") pod \"node-resolver-dgbmm\" (UID: \"8e98347d-1bbd-4bf5-84fc-9d8a4386606c\") " pod="openshift-dns/node-resolver-dgbmm" Jun 03 07:59:21.690007 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.689934 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5433f7ef-1518-4ece-8406-614de4489441-agent-certs\") pod \"konnectivity-agent-l5qvl\" (UID: \"5433f7ef-1518-4ece-8406-614de4489441\") " pod="kube-system/konnectivity-agent-l5qvl" Jun 03 07:59:21.690007 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.689967 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5433f7ef-1518-4ece-8406-614de4489441-konnectivity-ca\") pod \"konnectivity-agent-l5qvl\" (UID: \"5433f7ef-1518-4ece-8406-614de4489441\") " pod="kube-system/konnectivity-agent-l5qvl" Jun 03 07:59:21.690524 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.690502 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5433f7ef-1518-4ece-8406-614de4489441-konnectivity-ca\") pod \"konnectivity-agent-l5qvl\" (UID: \"5433f7ef-1518-4ece-8406-614de4489441\") " pod="kube-system/konnectivity-agent-l5qvl" Jun 03 07:59:21.692343 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.692322 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5433f7ef-1518-4ece-8406-614de4489441-agent-certs\") pod \"konnectivity-agent-l5qvl\" (UID: \"5433f7ef-1518-4ece-8406-614de4489441\") " pod="kube-system/konnectivity-agent-l5qvl" Jun 03 07:59:21.771410 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.771374 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9bgfk" Jun 03 07:59:21.777209 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.777192 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" Jun 03 07:59:21.786007 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.785989 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r2hph" Jun 03 07:59:21.791665 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.791649 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k8llk" Jun 03 07:59:21.798130 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.798113 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dgbmm" Jun 03 07:59:21.804893 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.804873 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wpg8p" Jun 03 07:59:21.811411 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.811395 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dxqvm" Jun 03 07:59:21.817949 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.817933 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:21.822499 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.822480 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l5qvl" Jun 03 07:59:21.941156 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:21.941089 2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 07:59:22.092276 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.092250 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs\") pod \"network-metrics-daemon-rqpqj\" (UID: \"d56b198a-8bb2-4f98-9300-d4dffff20c44\") " pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:22.092473 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:22.092407 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 07:59:22.092536 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:22.092482 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs podName:d56b198a-8bb2-4f98-9300-d4dffff20c44 nodeName:}" failed. No retries permitted until 2026-06-03 07:59:23.092463816 +0000 UTC m=+4.071806708 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs") pod "network-metrics-daemon-rqpqj" (UID: "d56b198a-8bb2-4f98-9300-d4dffff20c44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 07:59:22.150559 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:22.150529 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5433f7ef_1518_4ece_8406_614de4489441.slice/crio-aeb1b78911f8dd5275de391d1812b3310553a06d7efde461c87874d66105c777 WatchSource:0}: Error finding container aeb1b78911f8dd5275de391d1812b3310553a06d7efde461c87874d66105c777: Status 404 returned error can't find the container with id aeb1b78911f8dd5275de391d1812b3310553a06d7efde461c87874d66105c777 Jun 03 07:59:22.151614 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:22.151576 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf787947a_a855_4f90_ac17_9d832a9748aa.slice/crio-c80d3bdd87bffdecb43301d7f8db8c9a25e4eac7063a71da17eaaac46d757f13 WatchSource:0}: Error finding container c80d3bdd87bffdecb43301d7f8db8c9a25e4eac7063a71da17eaaac46d757f13: Status 404 returned error can't find the container with id c80d3bdd87bffdecb43301d7f8db8c9a25e4eac7063a71da17eaaac46d757f13 Jun 03 07:59:22.155149 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:22.155128 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cfa20b7_84b5_4070_aa99_5b03fc3cb859.slice/crio-0df6ce07db7cddc5a83f8b6d199fc414df3b3ca2f2e93d52a1107cfa44a01eb5 WatchSource:0}: Error finding container 0df6ce07db7cddc5a83f8b6d199fc414df3b3ca2f2e93d52a1107cfa44a01eb5: Status 404 returned error can't find the container with id 0df6ce07db7cddc5a83f8b6d199fc414df3b3ca2f2e93d52a1107cfa44a01eb5 Jun 03 07:59:22.155649 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:22.155632 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefd627d9_3a4c_4826_814c_08197e84cfb2.slice/crio-be19e87338cf802a1a6c389589d43572ee15bd6050a28344643866ef937e29fb WatchSource:0}: Error finding container be19e87338cf802a1a6c389589d43572ee15bd6050a28344643866ef937e29fb: Status 404 returned error can't find the container with id be19e87338cf802a1a6c389589d43572ee15bd6050a28344643866ef937e29fb Jun 03 07:59:22.156759 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:22.156687 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d791cc_5930_4e19_a8db_498ce4237bf2.slice/crio-6ad6a06da0713890d6962e399b157a3cf66d784c372cf605105974cdfc5f8dd0 WatchSource:0}: Error finding container 6ad6a06da0713890d6962e399b157a3cf66d784c372cf605105974cdfc5f8dd0: Status 404 returned error can't find the container with id 6ad6a06da0713890d6962e399b157a3cf66d784c372cf605105974cdfc5f8dd0 Jun 03 07:59:22.163870 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:22.163832 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f2cf176_8955_4aeb_a63e_5c75c3c73886.slice/crio-f16a9e92d66034331478a4b4ed01d03a1c4db72cf63b8050cfca3d5726272fb9 WatchSource:0}: Error finding container f16a9e92d66034331478a4b4ed01d03a1c4db72cf63b8050cfca3d5726272fb9: Status 404 returned error can't find the container with id f16a9e92d66034331478a4b4ed01d03a1c4db72cf63b8050cfca3d5726272fb9 Jun 03 07:59:22.165292 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:22.165189 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050f3ecb_7b61_4926_b709_60dfcc68e7a3.slice/crio-ddfcb5a826a8a11e496e891bf1bb022c6475e97136052bf722a2aa14eea20154 WatchSource:0}: Error finding container ddfcb5a826a8a11e496e891bf1bb022c6475e97136052bf722a2aa14eea20154: Status 404 returned error can't find the container with id ddfcb5a826a8a11e496e891bf1bb022c6475e97136052bf722a2aa14eea20154 Jun 03 07:59:22.193472 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.193401 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dlq9\" (UniqueName: \"kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9\") pod \"network-check-target-dd4vj\" (UID: \"0dbef335-62ed-405a-a0d5-74cc429ec15e\") " pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:22.193574 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:22.193555 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 07:59:22.193637 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:22.193583 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 07:59:22.193637 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:22.193595 2575 projected.go:194] Error preparing data for projected volume kube-api-access-4dlq9 for pod openshift-network-diagnostics/network-check-target-dd4vj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 07:59:22.193738 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:22.193650 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9 podName:0dbef335-62ed-405a-a0d5-74cc429ec15e nodeName:}" failed. No retries permitted until 2026-06-03 07:59:23.193632558 +0000 UTC m=+4.172975465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4dlq9" (UniqueName: "kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9") pod "network-check-target-dd4vj" (UID: "0dbef335-62ed-405a-a0d5-74cc429ec15e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 07:59:22.512868 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.512773 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 07:54:20 +0000 UTC" deadline="2027-10-28 03:39:25.103338426 +0000 UTC" Jun 03 07:59:22.512868 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.512809 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12283h40m2.59053369s" Jun 03 07:59:22.548804 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.548025 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-j5mgp"] Jun 03 07:59:22.551622 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.551016 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:22.551622 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:22.551093 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5mgp" podUID="4d7b0246-ed7e-47be-89de-5061a041b35e" Jun 03 07:59:22.597145 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.596961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret\") pod \"global-pull-secret-syncer-j5mgp\" (UID: \"4d7b0246-ed7e-47be-89de-5061a041b35e\") " pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:22.597145 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.597003 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d7b0246-ed7e-47be-89de-5061a041b35e-kubelet-config\") pod \"global-pull-secret-syncer-j5mgp\" (UID: \"4d7b0246-ed7e-47be-89de-5061a041b35e\") " pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:22.597145 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.597087 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d7b0246-ed7e-47be-89de-5061a041b35e-dbus\") pod \"global-pull-secret-syncer-j5mgp\" (UID: \"4d7b0246-ed7e-47be-89de-5061a041b35e\") " pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:22.615331 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.615297 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dgbmm" event={"ID":"8e98347d-1bbd-4bf5-84fc-9d8a4386606c","Type":"ContainerStarted","Data":"226004a3d819b35c5dacfd429a91d4e55007b7f418026222e8fbb4edb0482461"} Jun 03 07:59:22.619788 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.619723 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dxqvm" event={"ID":"efd627d9-3a4c-4826-814c-08197e84cfb2","Type":"ContainerStarted","Data":"be19e87338cf802a1a6c389589d43572ee15bd6050a28344643866ef937e29fb"} Jun 03 07:59:22.622372 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.622318 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8llk" event={"ID":"f787947a-a855-4f90-ac17-9d832a9748aa","Type":"ContainerStarted","Data":"c80d3bdd87bffdecb43301d7f8db8c9a25e4eac7063a71da17eaaac46d757f13"} Jun 03 07:59:22.636310 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.636261 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" event={"ID":"39d791cc-5930-4e19-a8db-498ce4237bf2","Type":"ContainerStarted","Data":"6ad6a06da0713890d6962e399b157a3cf66d784c372cf605105974cdfc5f8dd0"} Jun 03 07:59:22.639962 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.639892 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" event={"ID":"1cfa20b7-84b5-4070-aa99-5b03fc3cb859","Type":"ContainerStarted","Data":"0df6ce07db7cddc5a83f8b6d199fc414df3b3ca2f2e93d52a1107cfa44a01eb5"} Jun 03 07:59:22.642058 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.642001 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l5qvl" event={"ID":"5433f7ef-1518-4ece-8406-614de4489441","Type":"ContainerStarted","Data":"aeb1b78911f8dd5275de391d1812b3310553a06d7efde461c87874d66105c777"} Jun 03 07:59:22.651386 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.650803 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal" event={"ID":"23d8c441f7d9cf4fc58ff38513145034","Type":"ContainerStarted","Data":"36819e3093bc64f9dcdb531dcc5c54b4782b634d005e7b0c19ba2b5cc3cc9c43"} Jun 03 07:59:22.662763 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.662711 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal" podStartSLOduration=1.662696774 podStartE2EDuration="1.662696774s" podCreationTimestamp="2026-06-03 07:59:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 07:59:22.661632731 +0000 UTC m=+3.640975643" watchObservedRunningTime="2026-06-03 07:59:22.662696774 +0000 UTC m=+3.642039687" Jun 03 07:59:22.670856 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.670829 2575 generic.go:358] "Generic (PLEG): container finished" podID="60d9a94fe0fb6badc03a89f43c34129d" containerID="ca14fab33a4e37f2dea71fc18bc6dcc747bc8579598238db27f425fcc586574e" exitCode=0 Jun 03 07:59:22.670953 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.670905 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal" event={"ID":"60d9a94fe0fb6badc03a89f43c34129d","Type":"ContainerDied","Data":"ca14fab33a4e37f2dea71fc18bc6dcc747bc8579598238db27f425fcc586574e"} Jun 03 07:59:22.680855 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.680775 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r2hph" event={"ID":"050f3ecb-7b61-4926-b709-60dfcc68e7a3","Type":"ContainerStarted","Data":"ddfcb5a826a8a11e496e891bf1bb022c6475e97136052bf722a2aa14eea20154"} Jun 03 07:59:22.688520 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.688495 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wpg8p" event={"ID":"6f2cf176-8955-4aeb-a63e-5c75c3c73886","Type":"ContainerStarted","Data":"f16a9e92d66034331478a4b4ed01d03a1c4db72cf63b8050cfca3d5726272fb9"} Jun 03 07:59:22.695076 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.695040 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9bgfk" event={"ID":"f90b753a-1b54-478c-812a-e8d590c0ab53","Type":"ContainerStarted","Data":"c72ccccc55392105b007265a78f7f96f3622e8c51e63b52efdfddf60daf46b46"} Jun 03 07:59:22.697646 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.697363 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret\") pod \"global-pull-secret-syncer-j5mgp\" (UID: \"4d7b0246-ed7e-47be-89de-5061a041b35e\") " pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:22.697646 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.697400 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d7b0246-ed7e-47be-89de-5061a041b35e-kubelet-config\") pod \"global-pull-secret-syncer-j5mgp\" (UID: \"4d7b0246-ed7e-47be-89de-5061a041b35e\") " pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:22.697646 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.697483 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d7b0246-ed7e-47be-89de-5061a041b35e-dbus\") pod \"global-pull-secret-syncer-j5mgp\" (UID: \"4d7b0246-ed7e-47be-89de-5061a041b35e\") " pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:22.697646 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:22.697490 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 07:59:22.697646 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:22.697541 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret podName:4d7b0246-ed7e-47be-89de-5061a041b35e nodeName:}" failed. No retries permitted until 2026-06-03 07:59:23.197524699 +0000 UTC m=+4.176867592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret") pod "global-pull-secret-syncer-j5mgp" (UID: "4d7b0246-ed7e-47be-89de-5061a041b35e") : object "kube-system"/"original-pull-secret" not registered Jun 03 07:59:22.697646 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.697562 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d7b0246-ed7e-47be-89de-5061a041b35e-kubelet-config\") pod \"global-pull-secret-syncer-j5mgp\" (UID: \"4d7b0246-ed7e-47be-89de-5061a041b35e\") " pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:22.697646 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:22.697617 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d7b0246-ed7e-47be-89de-5061a041b35e-dbus\") pod \"global-pull-secret-syncer-j5mgp\" (UID: \"4d7b0246-ed7e-47be-89de-5061a041b35e\") " pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:23.102833 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:23.102749 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs\") pod \"network-metrics-daemon-rqpqj\" (UID: \"d56b198a-8bb2-4f98-9300-d4dffff20c44\") " pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:23.103004 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:23.102894 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 07:59:23.103004 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:23.102957 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs podName:d56b198a-8bb2-4f98-9300-d4dffff20c44 nodeName:}" failed. No retries permitted until 2026-06-03 07:59:25.102939329 +0000 UTC m=+6.082282220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs") pod "network-metrics-daemon-rqpqj" (UID: "d56b198a-8bb2-4f98-9300-d4dffff20c44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 07:59:23.203979 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:23.203218 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dlq9\" (UniqueName: \"kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9\") pod \"network-check-target-dd4vj\" (UID: \"0dbef335-62ed-405a-a0d5-74cc429ec15e\") " pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:23.203979 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:23.203297 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret\") pod \"global-pull-secret-syncer-j5mgp\" (UID: \"4d7b0246-ed7e-47be-89de-5061a041b35e\") " pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:23.203979 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:23.203461 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 07:59:23.203979 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:23.203520 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret podName:4d7b0246-ed7e-47be-89de-5061a041b35e nodeName:}" failed. No retries permitted until 2026-06-03 07:59:24.203502377 +0000 UTC m=+5.182845283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret") pod "global-pull-secret-syncer-j5mgp" (UID: "4d7b0246-ed7e-47be-89de-5061a041b35e") : object "kube-system"/"original-pull-secret" not registered Jun 03 07:59:23.203979 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:23.203602 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 07:59:23.203979 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:23.203615 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 07:59:23.203979 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:23.203628 2575 projected.go:194] Error preparing data for projected volume kube-api-access-4dlq9 for pod openshift-network-diagnostics/network-check-target-dd4vj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 07:59:23.203979 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:23.203663 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9 podName:0dbef335-62ed-405a-a0d5-74cc429ec15e nodeName:}" failed. No retries permitted until 2026-06-03 07:59:25.203651457 +0000 UTC m=+6.182994366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4dlq9" (UniqueName: "kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9") pod "network-check-target-dd4vj" (UID: "0dbef335-62ed-405a-a0d5-74cc429ec15e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 07:59:23.606305 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:23.605839 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:23.606305 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:23.605959 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd4vj" podUID="0dbef335-62ed-405a-a0d5-74cc429ec15e" Jun 03 07:59:23.606305 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:23.606111 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:23.606305 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:23.606251 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 07:59:23.709006 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:23.708904 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal" event={"ID":"60d9a94fe0fb6badc03a89f43c34129d","Type":"ContainerStarted","Data":"cf01b8675fe9fd5eaa36dbf46f06d86f6e5daefd91a77f4bfb82dfbf0804e03e"} Jun 03 07:59:24.213726 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:24.213689 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret\") pod \"global-pull-secret-syncer-j5mgp\" (UID: \"4d7b0246-ed7e-47be-89de-5061a041b35e\") " pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:24.213916 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:24.213826 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 07:59:24.213916 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:24.213888 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret podName:4d7b0246-ed7e-47be-89de-5061a041b35e nodeName:}" failed. No retries permitted until 2026-06-03 07:59:26.213869554 +0000 UTC m=+7.193212447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret") pod "global-pull-secret-syncer-j5mgp" (UID: "4d7b0246-ed7e-47be-89de-5061a041b35e") : object "kube-system"/"original-pull-secret" not registered Jun 03 07:59:24.603748 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:24.603667 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:24.603911 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:24.603802 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5mgp" podUID="4d7b0246-ed7e-47be-89de-5061a041b35e" Jun 03 07:59:25.122763 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:25.122708 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs\") pod \"network-metrics-daemon-rqpqj\" (UID: \"d56b198a-8bb2-4f98-9300-d4dffff20c44\") " pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:25.123226 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:25.122840 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 07:59:25.123226 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:25.122913 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs podName:d56b198a-8bb2-4f98-9300-d4dffff20c44 nodeName:}" failed. No retries permitted until 2026-06-03 07:59:29.122893397 +0000 UTC m=+10.102236295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs") pod "network-metrics-daemon-rqpqj" (UID: "d56b198a-8bb2-4f98-9300-d4dffff20c44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 07:59:25.223946 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:25.223913 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dlq9\" (UniqueName: \"kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9\") pod \"network-check-target-dd4vj\" (UID: \"0dbef335-62ed-405a-a0d5-74cc429ec15e\") " pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:25.224113 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:25.224081 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 07:59:25.224113 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:25.224109 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 07:59:25.224238 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:25.224123 2575 projected.go:194] Error preparing data for projected volume kube-api-access-4dlq9 for pod openshift-network-diagnostics/network-check-target-dd4vj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 07:59:25.224238 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:25.224189 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9 podName:0dbef335-62ed-405a-a0d5-74cc429ec15e nodeName:}" failed. No retries permitted until 2026-06-03 07:59:29.224169521 +0000 UTC m=+10.203512416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4dlq9" (UniqueName: "kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9") pod "network-check-target-dd4vj" (UID: "0dbef335-62ed-405a-a0d5-74cc429ec15e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 07:59:25.603655 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:25.603573 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:25.603824 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:25.603707 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 07:59:25.604201 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:25.604181 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:25.604297 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:25.604278 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd4vj" podUID="0dbef335-62ed-405a-a0d5-74cc429ec15e" Jun 03 07:59:26.232774 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:26.232736 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret\") pod \"global-pull-secret-syncer-j5mgp\" (UID: \"4d7b0246-ed7e-47be-89de-5061a041b35e\") " pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:26.233213 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:26.232903 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 07:59:26.233213 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:26.232976 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret podName:4d7b0246-ed7e-47be-89de-5061a041b35e nodeName:}" failed. No retries permitted until 2026-06-03 07:59:30.232956924 +0000 UTC m=+11.212299813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret") pod "global-pull-secret-syncer-j5mgp" (UID: "4d7b0246-ed7e-47be-89de-5061a041b35e") : object "kube-system"/"original-pull-secret" not registered Jun 03 07:59:26.602757 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:26.602687 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:26.602913 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:26.602812 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5mgp" podUID="4d7b0246-ed7e-47be-89de-5061a041b35e" Jun 03 07:59:27.603641 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:27.603609 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:27.604067 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:27.603727 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd4vj" podUID="0dbef335-62ed-405a-a0d5-74cc429ec15e" Jun 03 07:59:27.604228 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:27.604202 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:27.604340 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:27.604311 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 07:59:28.603111 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:28.603075 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:28.603274 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:28.603222 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5mgp" podUID="4d7b0246-ed7e-47be-89de-5061a041b35e" Jun 03 07:59:29.157507 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:29.157475 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs\") pod \"network-metrics-daemon-rqpqj\" (UID: \"d56b198a-8bb2-4f98-9300-d4dffff20c44\") " pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:29.157914 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:29.157602 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 07:59:29.157914 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:29.157671 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs podName:d56b198a-8bb2-4f98-9300-d4dffff20c44 nodeName:}" failed. No retries permitted until 2026-06-03 07:59:37.15765107 +0000 UTC m=+18.136993984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs") pod "network-metrics-daemon-rqpqj" (UID: "d56b198a-8bb2-4f98-9300-d4dffff20c44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 07:59:29.258738 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:29.258705 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dlq9\" (UniqueName: \"kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9\") pod \"network-check-target-dd4vj\" (UID: \"0dbef335-62ed-405a-a0d5-74cc429ec15e\") " pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:29.258874 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:29.258863 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 07:59:29.258924 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:29.258882 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 07:59:29.258924 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:29.258894 2575 projected.go:194] Error preparing data for projected volume kube-api-access-4dlq9 for pod openshift-network-diagnostics/network-check-target-dd4vj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 07:59:29.258991 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:29.258950 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9 podName:0dbef335-62ed-405a-a0d5-74cc429ec15e nodeName:}" failed. No retries permitted until 2026-06-03 07:59:37.258932472 +0000 UTC m=+18.238275378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4dlq9" (UniqueName: "kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9") pod "network-check-target-dd4vj" (UID: "0dbef335-62ed-405a-a0d5-74cc429ec15e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 07:59:29.603884 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:29.603808 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:29.604033 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:29.603933 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd4vj" podUID="0dbef335-62ed-405a-a0d5-74cc429ec15e" Jun 03 07:59:29.604271 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:29.604251 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:29.604382 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:29.604361 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 07:59:30.267577 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:30.267491 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret\") pod \"global-pull-secret-syncer-j5mgp\" (UID: \"4d7b0246-ed7e-47be-89de-5061a041b35e\") " pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:30.268003 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:30.267703 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 07:59:30.268003 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:30.267765 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret podName:4d7b0246-ed7e-47be-89de-5061a041b35e nodeName:}" failed. No retries permitted until 2026-06-03 07:59:38.267745897 +0000 UTC m=+19.247088800 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret") pod "global-pull-secret-syncer-j5mgp" (UID: "4d7b0246-ed7e-47be-89de-5061a041b35e") : object "kube-system"/"original-pull-secret" not registered Jun 03 07:59:30.603326 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:30.603244 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:30.603502 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:30.603371 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5mgp" podUID="4d7b0246-ed7e-47be-89de-5061a041b35e" Jun 03 07:59:31.603267 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:31.603232 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:31.603731 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:31.603232 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:31.603731 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:31.603367 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 07:59:31.603731 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:31.603463 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd4vj" podUID="0dbef335-62ed-405a-a0d5-74cc429ec15e" Jun 03 07:59:32.602891 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:32.602825 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:32.603024 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:32.602928 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5mgp" podUID="4d7b0246-ed7e-47be-89de-5061a041b35e" Jun 03 07:59:33.602701 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:33.602671 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:33.603104 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:33.602787 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd4vj" podUID="0dbef335-62ed-405a-a0d5-74cc429ec15e" Jun 03 07:59:33.603104 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:33.602850 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:33.603104 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:33.602978 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 07:59:34.603124 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:34.603091 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:34.603566 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:34.603221 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5mgp" podUID="4d7b0246-ed7e-47be-89de-5061a041b35e" Jun 03 07:59:35.602707 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:35.602672 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:35.602884 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:35.602830 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd4vj" podUID="0dbef335-62ed-405a-a0d5-74cc429ec15e" Jun 03 07:59:35.603000 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:35.602873 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:35.603052 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:35.603013 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 07:59:36.602738 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:36.602698 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:36.603256 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:36.602822 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5mgp" podUID="4d7b0246-ed7e-47be-89de-5061a041b35e" Jun 03 07:59:37.219255 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:37.219217 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs\") pod \"network-metrics-daemon-rqpqj\" (UID: \"d56b198a-8bb2-4f98-9300-d4dffff20c44\") " pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:37.219470 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:37.219387 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 07:59:37.219537 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:37.219473 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs podName:d56b198a-8bb2-4f98-9300-d4dffff20c44 nodeName:}" failed. No retries permitted until 2026-06-03 07:59:53.21945738 +0000 UTC m=+34.198800269 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs") pod "network-metrics-daemon-rqpqj" (UID: "d56b198a-8bb2-4f98-9300-d4dffff20c44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 07:59:37.320257 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:37.320218 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dlq9\" (UniqueName: \"kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9\") pod \"network-check-target-dd4vj\" (UID: \"0dbef335-62ed-405a-a0d5-74cc429ec15e\") " pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:37.320448 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:37.320363 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 07:59:37.320448 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:37.320381 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 07:59:37.320448 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:37.320392 2575 projected.go:194] Error preparing data for projected volume kube-api-access-4dlq9 for pod openshift-network-diagnostics/network-check-target-dd4vj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 07:59:37.320608 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:37.320486 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9 podName:0dbef335-62ed-405a-a0d5-74cc429ec15e nodeName:}" failed. No retries permitted until 2026-06-03 07:59:53.320428937 +0000 UTC m=+34.299771840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4dlq9" (UniqueName: "kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9") pod "network-check-target-dd4vj" (UID: "0dbef335-62ed-405a-a0d5-74cc429ec15e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 07:59:37.603680 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:37.603595 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:37.604106 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:37.603718 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 07:59:37.604106 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:37.603764 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:37.604106 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:37.603873 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd4vj" podUID="0dbef335-62ed-405a-a0d5-74cc429ec15e" Jun 03 07:59:38.329125 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:38.329097 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret\") pod \"global-pull-secret-syncer-j5mgp\" (UID: \"4d7b0246-ed7e-47be-89de-5061a041b35e\") " pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:38.329304 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:38.329214 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 07:59:38.329304 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:38.329271 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret podName:4d7b0246-ed7e-47be-89de-5061a041b35e nodeName:}" failed. No retries permitted until 2026-06-03 07:59:54.329255389 +0000 UTC m=+35.308598278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret") pod "global-pull-secret-syncer-j5mgp" (UID: "4d7b0246-ed7e-47be-89de-5061a041b35e") : object "kube-system"/"original-pull-secret" not registered Jun 03 07:59:38.603640 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:38.603566 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:38.603780 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:38.603694 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5mgp" podUID="4d7b0246-ed7e-47be-89de-5061a041b35e" Jun 03 07:59:39.603846 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:39.603813 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:39.604255 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:39.603926 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 07:59:39.604255 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:39.603996 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:39.604255 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:39.604114 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd4vj" podUID="0dbef335-62ed-405a-a0d5-74cc429ec15e" Jun 03 07:59:40.603095 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:40.602960 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:40.603215 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:40.603193 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5mgp" podUID="4d7b0246-ed7e-47be-89de-5061a041b35e" Jun 03 07:59:40.741966 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:40.741875 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r2hph" event={"ID":"050f3ecb-7b61-4926-b709-60dfcc68e7a3","Type":"ContainerStarted","Data":"417c064848548aa68212cc04bcbaa51928c1fd6f3dedb9b141f2e58fca1519b1"} Jun 03 07:59:40.743703 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:40.743677 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wpg8p" event={"ID":"6f2cf176-8955-4aeb-a63e-5c75c3c73886","Type":"ContainerStarted","Data":"ed890ef30343d75d10a137d3e6307d4d02ad28f88b7c5fe86fa1796d729f25e9"} Jun 03 07:59:40.745094 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:40.745062 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dgbmm" event={"ID":"8e98347d-1bbd-4bf5-84fc-9d8a4386606c","Type":"ContainerStarted","Data":"37e666b915274ee5e238c948d7a1751be8d722838d28326e6428a8e80d435bc5"} Jun 03 07:59:40.746591 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:40.746565 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dxqvm" event={"ID":"efd627d9-3a4c-4826-814c-08197e84cfb2","Type":"ContainerStarted","Data":"4a15c927f344e4f4c330dc0499c4cac5d9b5910cbf3c4620640bb5f6fe164b83"} Jun 03 07:59:40.747992 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:40.747968 2575 generic.go:358] "Generic (PLEG): container finished" podID="f787947a-a855-4f90-ac17-9d832a9748aa" containerID="949b4bc6942d1fd186457bdeeb4bcd62876e4cfcfb5f04448c6dc6f5e42db0b3" exitCode=0 Jun 03 07:59:40.748081 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:40.748035 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8llk" event={"ID":"f787947a-a855-4f90-ac17-9d832a9748aa","Type":"ContainerDied","Data":"949b4bc6942d1fd186457bdeeb4bcd62876e4cfcfb5f04448c6dc6f5e42db0b3"} Jun 03 07:59:40.749450 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:40.749409 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" event={"ID":"1cfa20b7-84b5-4070-aa99-5b03fc3cb859","Type":"ContainerStarted","Data":"47a5b715be36b5aa49894995ea1351ec4b14f4d881667749cdc09f3b1c5e13be"} Jun 03 07:59:40.750588 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:40.750566 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l5qvl" event={"ID":"5433f7ef-1518-4ece-8406-614de4489441","Type":"ContainerStarted","Data":"525c3f110d2b7b97904f5f8677fdc7391c9b003b633b10b59c785ed32716e214"} Jun 03 07:59:40.758383 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:40.758339 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r2hph" podStartSLOduration=3.529455871 podStartE2EDuration="21.758325185s" podCreationTimestamp="2026-06-03 07:59:19 +0000 UTC" firstStartedPulling="2026-06-03 07:59:22.166648763 +0000 UTC m=+3.145991670" lastFinishedPulling="2026-06-03 07:59:40.395518083 +0000 UTC m=+21.374860984" observedRunningTime="2026-06-03 07:59:40.75814773 +0000 UTC m=+21.737490765" watchObservedRunningTime="2026-06-03 07:59:40.758325185 +0000 UTC m=+21.737668098" Jun 03 07:59:40.758836 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:40.758809 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal" podStartSLOduration=19.758800234 podStartE2EDuration="19.758800234s" podCreationTimestamp="2026-06-03 07:59:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 07:59:23.720785554 +0000 UTC m=+4.700128467" watchObservedRunningTime="2026-06-03 07:59:40.758800234 +0000 UTC m=+21.738143146" Jun 03 07:59:40.769613 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:40.769574 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l5qvl" podStartSLOduration=3.528453824 podStartE2EDuration="21.769558363s" podCreationTimestamp="2026-06-03 07:59:19 +0000 UTC" firstStartedPulling="2026-06-03 07:59:22.152865646 +0000 UTC m=+3.132208550" lastFinishedPulling="2026-06-03 07:59:40.393970196 +0000 UTC m=+21.373313089" observedRunningTime="2026-06-03 07:59:40.769520795 +0000 UTC m=+21.748863706" watchObservedRunningTime="2026-06-03 07:59:40.769558363 +0000 UTC m=+21.748901276" Jun 03 07:59:40.794409 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:40.794374 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-dgbmm" podStartSLOduration=8.257740526 podStartE2EDuration="21.794360991s" podCreationTimestamp="2026-06-03 07:59:19 +0000 UTC" firstStartedPulling="2026-06-03 07:59:22.160916152 +0000 UTC m=+3.140259042" lastFinishedPulling="2026-06-03 07:59:35.697536615 +0000 UTC m=+16.676879507" observedRunningTime="2026-06-03 07:59:40.781050962 +0000 UTC m=+21.760393875" watchObservedRunningTime="2026-06-03 07:59:40.794360991 +0000 UTC m=+21.773703901" Jun 03 07:59:40.794530 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:40.794510 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-dxqvm" podStartSLOduration=3.543935997 podStartE2EDuration="21.794504905s" podCreationTimestamp="2026-06-03 07:59:19 +0000 UTC" firstStartedPulling="2026-06-03 07:59:22.161321773 +0000 UTC m=+3.140664666" lastFinishedPulling="2026-06-03 07:59:40.411890682 +0000 UTC m=+21.391233574" observedRunningTime="2026-06-03 07:59:40.794243841 +0000 UTC m=+21.773586752" watchObservedRunningTime="2026-06-03 07:59:40.794504905 +0000 UTC m=+21.773847816" Jun 03 07:59:40.825783 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:40.825730 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wpg8p" podStartSLOduration=8.294162927 podStartE2EDuration="21.825710718s" podCreationTimestamp="2026-06-03 07:59:19 +0000 UTC" firstStartedPulling="2026-06-03 07:59:22.165982139 +0000 UTC m=+3.145325029" lastFinishedPulling="2026-06-03 07:59:35.697529918 +0000 UTC m=+16.676872820" observedRunningTime="2026-06-03 07:59:40.825128076 +0000 UTC m=+21.804470987" watchObservedRunningTime="2026-06-03 07:59:40.825710718 +0000 UTC m=+21.805053629" Jun 03 07:59:41.603347 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:41.603188 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:41.603505 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:41.603188 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:41.603505 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:41.603442 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd4vj" podUID="0dbef335-62ed-405a-a0d5-74cc429ec15e" Jun 03 07:59:41.603593 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:41.603518 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 07:59:41.663830 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:41.663806 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 07:59:41.756886 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:41.756858 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n47h8_39d791cc-5930-4e19-a8db-498ce4237bf2/ovn-acl-logging/0.log" Jun 03 07:59:41.757719 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:41.757210 2575 generic.go:358] "Generic (PLEG): container finished" podID="39d791cc-5930-4e19-a8db-498ce4237bf2" containerID="2eef3031af646012177b063390acd1727c45ae6e126208afe52e83fcd9cf4fed" exitCode=1 Jun 03 07:59:41.757719 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:41.757298 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" event={"ID":"39d791cc-5930-4e19-a8db-498ce4237bf2","Type":"ContainerStarted","Data":"c7e4d49105a6007146392e37c3089a074e819f4ca8dae246dfb63f449d5f47da"} Jun 03 07:59:41.757719 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:41.757335 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" event={"ID":"39d791cc-5930-4e19-a8db-498ce4237bf2","Type":"ContainerStarted","Data":"cef01f4efdc6c3ab18c1ba0f8921270b006b64c6f89ea8354a90838e7c92a73c"} Jun 03 07:59:41.757719 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:41.757349 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" event={"ID":"39d791cc-5930-4e19-a8db-498ce4237bf2","Type":"ContainerStarted","Data":"45c12db59271946d1015056eabf6f60b640b0c1f1f62360faa5e882cd964453d"} Jun 03 07:59:41.757719 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:41.757362 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" event={"ID":"39d791cc-5930-4e19-a8db-498ce4237bf2","Type":"ContainerStarted","Data":"dc5f2506e339d2522f3bc7c0145e86d37d6989ca7a44259d579162f426cdab62"} Jun 03 07:59:41.757719 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:41.757374 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" event={"ID":"39d791cc-5930-4e19-a8db-498ce4237bf2","Type":"ContainerDied","Data":"2eef3031af646012177b063390acd1727c45ae6e126208afe52e83fcd9cf4fed"} Jun 03 07:59:41.757719 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:41.757390 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" event={"ID":"39d791cc-5930-4e19-a8db-498ce4237bf2","Type":"ContainerStarted","Data":"66b0457d95e927685ab49de7e6b162cf1e67ac84a5a2039a5f01f21a1f913ddd"} Jun 03 07:59:41.759084 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:41.759060 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" event={"ID":"1cfa20b7-84b5-4070-aa99-5b03fc3cb859","Type":"ContainerStarted","Data":"b208ea67592150c8cca47952e7c973f2538a088aeca81cc402988b5154e57290"} Jun 03 07:59:41.760328 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:41.760304 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9bgfk" event={"ID":"f90b753a-1b54-478c-812a-e8d590c0ab53","Type":"ContainerStarted","Data":"f00c7f1e2edca147746e9cd7103630254816510c9114d1f4166da68e6fdf59a1"} Jun 03 07:59:42.545326 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:42.545175 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T07:59:41.663823423Z","UUID":"cd4cc930-ce20-4177-9976-8247b2003f7d","Handler":null,"Name":"","Endpoint":""} Jun 03 07:59:42.547375 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:42.547347 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 07:59:42.547506 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:42.547473 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 07:59:42.603418 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:42.603394 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:42.603577 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:42.603553 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5mgp" podUID="4d7b0246-ed7e-47be-89de-5061a041b35e" Jun 03 07:59:42.763600 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:42.763567 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" event={"ID":"1cfa20b7-84b5-4070-aa99-5b03fc3cb859","Type":"ContainerStarted","Data":"7d52b27be62c0f5835afea8c84d11127fcbf013028a9b6f75e1f35a9d67d13f5"} Jun 03 07:59:42.778677 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:42.778634 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7gnrx" podStartSLOduration=3.403638848 podStartE2EDuration="23.778621133s" podCreationTimestamp="2026-06-03 07:59:19 +0000 UTC" firstStartedPulling="2026-06-03 07:59:22.16124911 +0000 UTC m=+3.140592001" lastFinishedPulling="2026-06-03 07:59:42.536231394 +0000 UTC m=+23.515574286" observedRunningTime="2026-06-03 07:59:42.778618925 +0000 UTC m=+23.757961836" watchObservedRunningTime="2026-06-03 07:59:42.778621133 +0000 UTC m=+23.757964040" Jun 03 07:59:42.778939 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:42.778919 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9bgfk" podStartSLOduration=5.549361515 podStartE2EDuration="23.778912202s" podCreationTimestamp="2026-06-03 07:59:19 +0000 UTC" firstStartedPulling="2026-06-03 07:59:22.164603282 +0000 UTC m=+3.143946171" lastFinishedPulling="2026-06-03 07:59:40.394153962 +0000 UTC m=+21.373496858" observedRunningTime="2026-06-03 07:59:41.773175813 +0000 UTC m=+22.752518724" watchObservedRunningTime="2026-06-03 07:59:42.778912202 +0000 UTC m=+23.758255091" Jun 03 07:59:43.602971 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:43.602888 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:43.602971 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:43.602923 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:43.603173 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:43.603006 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 07:59:43.603173 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:43.603110 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd4vj" podUID="0dbef335-62ed-405a-a0d5-74cc429ec15e" Jun 03 07:59:43.768390 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:43.768356 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n47h8_39d791cc-5930-4e19-a8db-498ce4237bf2/ovn-acl-logging/0.log" Jun 03 07:59:43.768874 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:43.768843 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" event={"ID":"39d791cc-5930-4e19-a8db-498ce4237bf2","Type":"ContainerStarted","Data":"ab8a716fa408e977391e5504342899fc5dbad87d524f3ed279a743b67c87c1af"} Jun 03 07:59:44.603227 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:44.603192 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:44.603419 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:44.603303 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5mgp" podUID="4d7b0246-ed7e-47be-89de-5061a041b35e" Jun 03 07:59:44.636886 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:44.636852 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l5qvl" Jun 03 07:59:44.637413 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:44.637391 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l5qvl" Jun 03 07:59:44.771089 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:44.771064 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l5qvl" Jun 03 07:59:44.771576 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:44.771560 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l5qvl" Jun 03 07:59:45.603376 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:45.603214 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:45.603643 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:45.603251 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:45.603643 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:45.603492 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 07:59:45.603643 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:45.603564 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd4vj" podUID="0dbef335-62ed-405a-a0d5-74cc429ec15e" Jun 03 07:59:45.773826 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:45.773792 2575 generic.go:358] "Generic (PLEG): container finished" podID="f787947a-a855-4f90-ac17-9d832a9748aa" containerID="c8799b005c4023f0cdd5999f379dae6699c05ebd6eed34c65dcf36e3c19e398b" exitCode=0 Jun 03 07:59:45.774573 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:45.773879 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8llk" event={"ID":"f787947a-a855-4f90-ac17-9d832a9748aa","Type":"ContainerDied","Data":"c8799b005c4023f0cdd5999f379dae6699c05ebd6eed34c65dcf36e3c19e398b"} Jun 03 07:59:45.779005 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:45.778988 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n47h8_39d791cc-5930-4e19-a8db-498ce4237bf2/ovn-acl-logging/0.log" Jun 03 07:59:45.779542 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:45.779507 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" event={"ID":"39d791cc-5930-4e19-a8db-498ce4237bf2","Type":"ContainerStarted","Data":"8b44552b290ab1732689ff66aadddd98070cf0cc04f97f1b1197ab574227f0fa"} Jun 03 07:59:45.779821 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:45.779800 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:45.779890 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:45.779829 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:45.779890 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:45.779842 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:45.779963 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:45.779948 2575 scope.go:117] "RemoveContainer" containerID="2eef3031af646012177b063390acd1727c45ae6e126208afe52e83fcd9cf4fed" Jun 03 07:59:45.797477 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:45.797458 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:45.797576 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:45.797542 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 07:59:46.603340 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:46.603317 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:46.603427 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:46.603406 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5mgp" podUID="4d7b0246-ed7e-47be-89de-5061a041b35e" Jun 03 07:59:46.784679 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:46.784597 2575 generic.go:358] "Generic (PLEG): container finished" podID="f787947a-a855-4f90-ac17-9d832a9748aa" containerID="de5b4eb9b24ba3b3ce19d0b011d7b2f5a998a5524469b6f6a9ec799bbb235985" exitCode=0 Jun 03 07:59:46.785124 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:46.784682 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8llk" event={"ID":"f787947a-a855-4f90-ac17-9d832a9748aa","Type":"ContainerDied","Data":"de5b4eb9b24ba3b3ce19d0b011d7b2f5a998a5524469b6f6a9ec799bbb235985"} Jun 03 07:59:46.788148 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:46.788131 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n47h8_39d791cc-5930-4e19-a8db-498ce4237bf2/ovn-acl-logging/0.log" Jun 03 07:59:46.788540 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:46.788518 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" event={"ID":"39d791cc-5930-4e19-a8db-498ce4237bf2","Type":"ContainerStarted","Data":"098cbc9543d13d76660af45cffc7d7c7a2ff23fad2b0940bc0f27c9dc31eb5fb"} Jun 03 07:59:46.827145 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:46.827100 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" podStartSLOduration=9.223183303 podStartE2EDuration="27.82708665s" podCreationTimestamp="2026-06-03 07:59:19 +0000 UTC" firstStartedPulling="2026-06-03 07:59:22.161330034 +0000 UTC m=+3.140672939" lastFinishedPulling="2026-06-03 07:59:40.765233397 +0000 UTC m=+21.744576286" observedRunningTime="2026-06-03 07:59:46.826848839 +0000 UTC m=+27.806191767" watchObservedRunningTime="2026-06-03 07:59:46.82708665 +0000 UTC m=+27.806429562" Jun 03 07:59:47.382965 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:47.382934 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j5mgp"] Jun 03 07:59:47.383119 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:47.383058 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:47.383165 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:47.383146 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5mgp" podUID="4d7b0246-ed7e-47be-89de-5061a041b35e" Jun 03 07:59:47.385912 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:47.385886 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dd4vj"] Jun 03 07:59:47.386035 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:47.386002 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:47.386136 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:47.386106 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd4vj" podUID="0dbef335-62ed-405a-a0d5-74cc429ec15e" Jun 03 07:59:47.386443 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:47.386411 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rqpqj"] Jun 03 07:59:47.386536 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:47.386523 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:47.386647 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:47.386626 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 07:59:47.792277 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:47.792043 2575 generic.go:358] "Generic (PLEG): container finished" podID="f787947a-a855-4f90-ac17-9d832a9748aa" containerID="96a5c9a62a0827cf75720300677c6a62c90f2bfe83d48cdea30056bf92f5e492" exitCode=0 Jun 03 07:59:47.792277 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:47.792129 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8llk" event={"ID":"f787947a-a855-4f90-ac17-9d832a9748aa","Type":"ContainerDied","Data":"96a5c9a62a0827cf75720300677c6a62c90f2bfe83d48cdea30056bf92f5e492"} Jun 03 07:59:48.603202 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:48.603170 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:48.603202 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:48.603187 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:48.603424 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:48.603288 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 07:59:48.603424 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:48.603360 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd4vj" podUID="0dbef335-62ed-405a-a0d5-74cc429ec15e" Jun 03 07:59:49.604804 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:49.604781 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:49.605171 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:49.604862 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5mgp" podUID="4d7b0246-ed7e-47be-89de-5061a041b35e" Jun 03 07:59:50.603067 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:50.603033 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:50.603243 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:50.603033 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:50.603243 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:50.603150 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd4vj" podUID="0dbef335-62ed-405a-a0d5-74cc429ec15e" Jun 03 07:59:50.603336 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:50.603245 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 07:59:51.603754 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:51.603690 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:51.604239 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:51.603789 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5mgp" podUID="4d7b0246-ed7e-47be-89de-5061a041b35e" Jun 03 07:59:52.602961 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:52.602930 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:52.603235 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:52.602933 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:52.603235 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:52.603039 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dd4vj" podUID="0dbef335-62ed-405a-a0d5-74cc429ec15e" Jun 03 07:59:52.603235 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:52.603155 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 07:59:53.245565 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.245490 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs\") pod \"network-metrics-daemon-rqpqj\" (UID: \"d56b198a-8bb2-4f98-9300-d4dffff20c44\") " pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:53.246139 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:53.245641 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 07:59:53.246139 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:53.245711 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs podName:d56b198a-8bb2-4f98-9300-d4dffff20c44 nodeName:}" failed. No retries permitted until 2026-06-03 08:00:25.245693501 +0000 UTC m=+66.225036404 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs") pod "network-metrics-daemon-rqpqj" (UID: "d56b198a-8bb2-4f98-9300-d4dffff20c44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 07:59:53.345955 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.345926 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dlq9\" (UniqueName: \"kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9\") pod \"network-check-target-dd4vj\" (UID: \"0dbef335-62ed-405a-a0d5-74cc429ec15e\") " pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:53.346154 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:53.346134 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 07:59:53.346226 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:53.346159 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 07:59:53.346226 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:53.346172 2575 projected.go:194] Error preparing data for projected volume kube-api-access-4dlq9 for pod openshift-network-diagnostics/network-check-target-dd4vj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 07:59:53.346328 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:53.346233 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9 podName:0dbef335-62ed-405a-a0d5-74cc429ec15e nodeName:}" failed. No retries permitted until 2026-06-03 08:00:25.346214018 +0000 UTC m=+66.325556921 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4dlq9" (UniqueName: "kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9") pod "network-check-target-dd4vj" (UID: "0dbef335-62ed-405a-a0d5-74cc429ec15e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 07:59:53.386047 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.386016 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeReady" Jun 03 07:59:53.386180 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.386148 2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 07:59:53.427692 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.427509 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5rxfl"] Jun 03 07:59:53.456354 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.456320 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rz58k"] Jun 03 07:59:53.456505 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.456482 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5rxfl" Jun 03 07:59:53.458616 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.458587 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hgsv2\"" Jun 03 07:59:53.458616 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.458599 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 07:59:53.458616 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.458611 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 07:59:53.469829 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.469754 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rz58k"] Jun 03 07:59:53.469829 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.469779 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5rxfl"] Jun 03 07:59:53.469971 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.469875 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 07:59:53.471881 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.471842 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 07:59:53.471988 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.471902 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 07:59:53.472052 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.471986 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9qc5s\"" Jun 03 07:59:53.472052 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.471986 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 07:59:53.603633 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.603560 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:53.606325 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.606303 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 07:59:53.648470 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.648443 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 07:59:53.648579 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.648482 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r95bx\" (UniqueName: \"kubernetes.io/projected/18c59173-7593-42ad-9c17-2c8580e0a1da-kube-api-access-r95bx\") pod \"ingress-canary-rz58k\" (UID: \"18c59173-7593-42ad-9c17-2c8580e0a1da\") " pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 07:59:53.648579 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.648514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fe74542c-965c-4cec-886b-0c09af3fb49e-config-volume\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 07:59:53.648579 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.648539 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe74542c-965c-4cec-886b-0c09af3fb49e-tmp-dir\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 07:59:53.648579 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.648565 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert\") pod \"ingress-canary-rz58k\" (UID: \"18c59173-7593-42ad-9c17-2c8580e0a1da\") " pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 07:59:53.648758 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.648628 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn92m\" (UniqueName: \"kubernetes.io/projected/fe74542c-965c-4cec-886b-0c09af3fb49e-kube-api-access-bn92m\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 07:59:53.749690 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.749660 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert\") pod \"ingress-canary-rz58k\" (UID: \"18c59173-7593-42ad-9c17-2c8580e0a1da\") " pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 07:59:53.749800 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.749703 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bn92m\" (UniqueName: \"kubernetes.io/projected/fe74542c-965c-4cec-886b-0c09af3fb49e-kube-api-access-bn92m\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 07:59:53.749800 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.749751 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 07:59:53.749800 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.749772 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r95bx\" (UniqueName: \"kubernetes.io/projected/18c59173-7593-42ad-9c17-2c8580e0a1da-kube-api-access-r95bx\") pod \"ingress-canary-rz58k\" (UID: \"18c59173-7593-42ad-9c17-2c8580e0a1da\") " pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 07:59:53.749924 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:53.749800 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 07:59:53.749924 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.749855 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fe74542c-965c-4cec-886b-0c09af3fb49e-config-volume\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 07:59:53.749924 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:53.749865 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert podName:18c59173-7593-42ad-9c17-2c8580e0a1da nodeName:}" failed. No retries permitted until 2026-06-03 07:59:54.249849232 +0000 UTC m=+35.229192148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert") pod "ingress-canary-rz58k" (UID: "18c59173-7593-42ad-9c17-2c8580e0a1da") : secret "canary-serving-cert" not found Jun 03 07:59:53.749924 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:53.749869 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 07:59:53.749924 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.749886 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe74542c-965c-4cec-886b-0c09af3fb49e-tmp-dir\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 07:59:53.749924 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:53.749919 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls podName:fe74542c-965c-4cec-886b-0c09af3fb49e nodeName:}" failed. No retries permitted until 2026-06-03 07:59:54.249903666 +0000 UTC m=+35.229246555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls") pod "dns-default-5rxfl" (UID: "fe74542c-965c-4cec-886b-0c09af3fb49e") : secret "dns-default-metrics-tls" not found Jun 03 07:59:53.750224 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.750136 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe74542c-965c-4cec-886b-0c09af3fb49e-tmp-dir\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 07:59:53.750331 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.750316 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fe74542c-965c-4cec-886b-0c09af3fb49e-config-volume\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 07:59:53.758940 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.758915 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn92m\" (UniqueName: \"kubernetes.io/projected/fe74542c-965c-4cec-886b-0c09af3fb49e-kube-api-access-bn92m\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 07:59:53.759103 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:53.759083 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r95bx\" (UniqueName: \"kubernetes.io/projected/18c59173-7593-42ad-9c17-2c8580e0a1da-kube-api-access-r95bx\") pod \"ingress-canary-rz58k\" (UID: \"18c59173-7593-42ad-9c17-2c8580e0a1da\") " pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 07:59:54.254172 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:54.254148 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert\") pod \"ingress-canary-rz58k\" (UID: \"18c59173-7593-42ad-9c17-2c8580e0a1da\") " pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 07:59:54.254516 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:54.254245 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 07:59:54.254516 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:54.254268 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 07:59:54.254516 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:54.254323 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert podName:18c59173-7593-42ad-9c17-2c8580e0a1da nodeName:}" failed. No retries permitted until 2026-06-03 07:59:55.254308738 +0000 UTC m=+36.233651631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert") pod "ingress-canary-rz58k" (UID: "18c59173-7593-42ad-9c17-2c8580e0a1da") : secret "canary-serving-cert" not found Jun 03 07:59:54.254516 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:54.254335 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 07:59:54.254516 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:54.254373 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls podName:fe74542c-965c-4cec-886b-0c09af3fb49e nodeName:}" failed. No retries permitted until 2026-06-03 07:59:55.254358549 +0000 UTC m=+36.233701460 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls") pod "dns-default-5rxfl" (UID: "fe74542c-965c-4cec-886b-0c09af3fb49e") : secret "dns-default-metrics-tls" not found Jun 03 07:59:54.354660 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:54.354632 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret\") pod \"global-pull-secret-syncer-j5mgp\" (UID: \"4d7b0246-ed7e-47be-89de-5061a041b35e\") " pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:54.356842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:54.356821 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d7b0246-ed7e-47be-89de-5061a041b35e-original-pull-secret\") pod \"global-pull-secret-syncer-j5mgp\" (UID: \"4d7b0246-ed7e-47be-89de-5061a041b35e\") " pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:54.513539 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:54.513514 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5mgp" Jun 03 07:59:54.603421 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:54.603384 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 07:59:54.603571 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:54.603390 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 07:59:54.605485 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:54.605419 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 07:59:54.605485 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:54.605423 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 07:59:54.605485 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:54.605446 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 07:59:54.606000 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:54.605983 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ddh22\"" Jun 03 07:59:54.606000 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:54.605998 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qvj7p\"" Jun 03 07:59:54.658338 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:54.658262 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j5mgp"] Jun 03 07:59:54.661662 ip-10-0-128-28 kubenswrapper[2575]: W0603 07:59:54.661637 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d7b0246_ed7e_47be_89de_5061a041b35e.slice/crio-664d2f672782991d9d248d1f5b1ca4c386b0aa3efc0897d5786377f9e3c392a6 WatchSource:0}: Error finding container 664d2f672782991d9d248d1f5b1ca4c386b0aa3efc0897d5786377f9e3c392a6: Status 404 returned error can't find the container with id 664d2f672782991d9d248d1f5b1ca4c386b0aa3efc0897d5786377f9e3c392a6 Jun 03 07:59:54.809592 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:54.809565 2575 generic.go:358] "Generic (PLEG): container finished" podID="f787947a-a855-4f90-ac17-9d832a9748aa" containerID="7411ec0a4bb53ab4934998cd1c7658a5736630cd5cbed2e84af98a18d8bb98c4" exitCode=0 Jun 03 07:59:54.809719 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:54.809642 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8llk" event={"ID":"f787947a-a855-4f90-ac17-9d832a9748aa","Type":"ContainerDied","Data":"7411ec0a4bb53ab4934998cd1c7658a5736630cd5cbed2e84af98a18d8bb98c4"} Jun 03 07:59:54.810707 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:54.810683 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j5mgp" event={"ID":"4d7b0246-ed7e-47be-89de-5061a041b35e","Type":"ContainerStarted","Data":"664d2f672782991d9d248d1f5b1ca4c386b0aa3efc0897d5786377f9e3c392a6"} Jun 03 07:59:55.262276 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:55.262203 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert\") pod \"ingress-canary-rz58k\" (UID: \"18c59173-7593-42ad-9c17-2c8580e0a1da\") " pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 07:59:55.262792 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:55.262311 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 07:59:55.262792 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:55.262361 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 07:59:55.262792 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:55.262424 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 07:59:55.262792 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:55.262454 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert podName:18c59173-7593-42ad-9c17-2c8580e0a1da nodeName:}" failed. No retries permitted until 2026-06-03 07:59:57.262418701 +0000 UTC m=+38.241761612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert") pod "ingress-canary-rz58k" (UID: "18c59173-7593-42ad-9c17-2c8580e0a1da") : secret "canary-serving-cert" not found Jun 03 07:59:55.262792 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:55.262491 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls podName:fe74542c-965c-4cec-886b-0c09af3fb49e nodeName:}" failed. No retries permitted until 2026-06-03 07:59:57.262475974 +0000 UTC m=+38.241818875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls") pod "dns-default-5rxfl" (UID: "fe74542c-965c-4cec-886b-0c09af3fb49e") : secret "dns-default-metrics-tls" not found Jun 03 07:59:55.815842 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:55.815808 2575 generic.go:358] "Generic (PLEG): container finished" podID="f787947a-a855-4f90-ac17-9d832a9748aa" containerID="cf5b7ce202e0e306862b2d901909501a57e7e1442d8ac80582d41fce5d5ec408" exitCode=0 Jun 03 07:59:55.816011 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:55.815878 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8llk" event={"ID":"f787947a-a855-4f90-ac17-9d832a9748aa","Type":"ContainerDied","Data":"cf5b7ce202e0e306862b2d901909501a57e7e1442d8ac80582d41fce5d5ec408"} Jun 03 07:59:56.821521 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:56.821476 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8llk" event={"ID":"f787947a-a855-4f90-ac17-9d832a9748aa","Type":"ContainerStarted","Data":"3ee8c6fddffde307f739aa7f0176f753674628bc2348506d792c546ab08205f4"} Jun 03 07:59:56.852717 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:56.852665 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k8llk" podStartSLOduration=5.888645135 podStartE2EDuration="37.852650723s" podCreationTimestamp="2026-06-03 07:59:19 +0000 UTC" firstStartedPulling="2026-06-03 07:59:22.15363671 +0000 UTC m=+3.132979599" lastFinishedPulling="2026-06-03 07:59:54.117642298 +0000 UTC m=+35.096985187" observedRunningTime="2026-06-03 07:59:56.852103741 +0000 UTC m=+37.831446649" watchObservedRunningTime="2026-06-03 07:59:56.852650723 +0000 UTC m=+37.831993633" Jun 03 07:59:57.278762 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:57.278722 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 07:59:57.278945 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:57.278812 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert\") pod \"ingress-canary-rz58k\" (UID: \"18c59173-7593-42ad-9c17-2c8580e0a1da\") " pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 07:59:57.278945 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:57.278900 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 07:59:57.278945 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:57.278926 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 07:59:57.279162 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:57.278981 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls podName:fe74542c-965c-4cec-886b-0c09af3fb49e nodeName:}" failed. No retries permitted until 2026-06-03 08:00:01.278956186 +0000 UTC m=+42.258299094 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls") pod "dns-default-5rxfl" (UID: "fe74542c-965c-4cec-886b-0c09af3fb49e") : secret "dns-default-metrics-tls" not found Jun 03 07:59:57.279162 ip-10-0-128-28 kubenswrapper[2575]: E0603 07:59:57.279002 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert podName:18c59173-7593-42ad-9c17-2c8580e0a1da nodeName:}" failed. No retries permitted until 2026-06-03 08:00:01.278992397 +0000 UTC m=+42.258335293 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert") pod "ingress-canary-rz58k" (UID: "18c59173-7593-42ad-9c17-2c8580e0a1da") : secret "canary-serving-cert" not found Jun 03 07:59:58.826558 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:58.826478 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j5mgp" event={"ID":"4d7b0246-ed7e-47be-89de-5061a041b35e","Type":"ContainerStarted","Data":"38a51c92652ca5e1e5a2223be5647369317f197edc83fa9dd4f3b559e1516fab"} Jun 03 07:59:58.840018 ip-10-0-128-28 kubenswrapper[2575]: I0603 07:59:58.839976 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j5mgp" podStartSLOduration=32.927793715 podStartE2EDuration="36.8399616s" podCreationTimestamp="2026-06-03 07:59:22 +0000 UTC" firstStartedPulling="2026-06-03 07:59:54.663284902 +0000 UTC m=+35.642627791" lastFinishedPulling="2026-06-03 07:59:58.575452784 +0000 UTC m=+39.554795676" observedRunningTime="2026-06-03 07:59:58.838910487 +0000 UTC m=+39.818253397" watchObservedRunningTime="2026-06-03 07:59:58.8399616 +0000 UTC m=+39.819304501" Jun 03 08:00:01.307613 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:01.307575 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 08:00:01.307968 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:01.307624 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert\") pod \"ingress-canary-rz58k\" (UID: \"18c59173-7593-42ad-9c17-2c8580e0a1da\") " pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 08:00:01.307968 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:01.307715 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:00:01.307968 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:01.307727 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:00:01.307968 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:01.307763 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert podName:18c59173-7593-42ad-9c17-2c8580e0a1da nodeName:}" failed. No retries permitted until 2026-06-03 08:00:09.307749386 +0000 UTC m=+50.287092275 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert") pod "ingress-canary-rz58k" (UID: "18c59173-7593-42ad-9c17-2c8580e0a1da") : secret "canary-serving-cert" not found Jun 03 08:00:01.307968 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:01.307782 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls podName:fe74542c-965c-4cec-886b-0c09af3fb49e nodeName:}" failed. No retries permitted until 2026-06-03 08:00:09.307768353 +0000 UTC m=+50.287111263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls") pod "dns-default-5rxfl" (UID: "fe74542c-965c-4cec-886b-0c09af3fb49e") : secret "dns-default-metrics-tls" not found Jun 03 08:00:09.357814 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:09.357773 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert\") pod \"ingress-canary-rz58k\" (UID: \"18c59173-7593-42ad-9c17-2c8580e0a1da\") " pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 08:00:09.358271 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:09.357865 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 08:00:09.358271 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:09.357947 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:00:09.358271 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:09.357947 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:00:09.358271 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:09.358056 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert podName:18c59173-7593-42ad-9c17-2c8580e0a1da nodeName:}" failed. No retries permitted until 2026-06-03 08:00:25.358027876 +0000 UTC m=+66.337370788 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert") pod "ingress-canary-rz58k" (UID: "18c59173-7593-42ad-9c17-2c8580e0a1da") : secret "canary-serving-cert" not found Jun 03 08:00:09.358271 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:09.358090 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls podName:fe74542c-965c-4cec-886b-0c09af3fb49e nodeName:}" failed. No retries permitted until 2026-06-03 08:00:25.358079288 +0000 UTC m=+66.337422177 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls") pod "dns-default-5rxfl" (UID: "fe74542c-965c-4cec-886b-0c09af3fb49e") : secret "dns-default-metrics-tls" not found Jun 03 08:00:17.802153 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:17.802120 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n47h8" Jun 03 08:00:25.262230 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:25.262187 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs\") pod \"network-metrics-daemon-rqpqj\" (UID: \"d56b198a-8bb2-4f98-9300-d4dffff20c44\") " pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 08:00:25.264619 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:25.264601 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 08:00:25.273178 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:25.273159 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 08:00:25.273241 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:25.273212 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs podName:d56b198a-8bb2-4f98-9300-d4dffff20c44 nodeName:}" failed. No retries permitted until 2026-06-03 08:01:29.273197321 +0000 UTC m=+130.252540215 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs") pod "network-metrics-daemon-rqpqj" (UID: "d56b198a-8bb2-4f98-9300-d4dffff20c44") : secret "metrics-daemon-secret" not found Jun 03 08:00:25.362940 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:25.362910 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert\") pod \"ingress-canary-rz58k\" (UID: \"18c59173-7593-42ad-9c17-2c8580e0a1da\") " pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 08:00:25.363048 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:25.362963 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dlq9\" (UniqueName: \"kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9\") pod \"network-check-target-dd4vj\" (UID: \"0dbef335-62ed-405a-a0d5-74cc429ec15e\") " pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 08:00:25.363114 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:25.363049 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:00:25.363114 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:25.363108 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert podName:18c59173-7593-42ad-9c17-2c8580e0a1da nodeName:}" failed. No retries permitted until 2026-06-03 08:00:57.36309421 +0000 UTC m=+98.342437121 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert") pod "ingress-canary-rz58k" (UID: "18c59173-7593-42ad-9c17-2c8580e0a1da") : secret "canary-serving-cert" not found Jun 03 08:00:25.363114 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:25.363098 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 08:00:25.363273 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:25.363179 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:00:25.363273 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:25.363242 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls podName:fe74542c-965c-4cec-886b-0c09af3fb49e nodeName:}" failed. No retries permitted until 2026-06-03 08:00:57.363224324 +0000 UTC m=+98.342567237 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls") pod "dns-default-5rxfl" (UID: "fe74542c-965c-4cec-886b-0c09af3fb49e") : secret "dns-default-metrics-tls" not found Jun 03 08:00:25.365592 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:25.365577 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 08:00:25.374879 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:25.374866 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 08:00:25.388047 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:25.388017 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dlq9\" (UniqueName: \"kubernetes.io/projected/0dbef335-62ed-405a-a0d5-74cc429ec15e-kube-api-access-4dlq9\") pod \"network-check-target-dd4vj\" (UID: \"0dbef335-62ed-405a-a0d5-74cc429ec15e\") " pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 08:00:25.515530 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:25.515456 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qvj7p\"" Jun 03 08:00:25.524124 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:25.524106 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 08:00:25.642613 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:25.642582 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dd4vj"] Jun 03 08:00:25.645991 ip-10-0-128-28 kubenswrapper[2575]: W0603 08:00:25.645964 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dbef335_62ed_405a_a0d5_74cc429ec15e.slice/crio-26a57c342c24923840fdb726c5a3a8eaaa734df2658c3534c8b4577e5e183e51 WatchSource:0}: Error finding container 26a57c342c24923840fdb726c5a3a8eaaa734df2658c3534c8b4577e5e183e51: Status 404 returned error can't find the container with id 26a57c342c24923840fdb726c5a3a8eaaa734df2658c3534c8b4577e5e183e51 Jun 03 08:00:25.872967 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:25.872931 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dd4vj" event={"ID":"0dbef335-62ed-405a-a0d5-74cc429ec15e","Type":"ContainerStarted","Data":"26a57c342c24923840fdb726c5a3a8eaaa734df2658c3534c8b4577e5e183e51"} Jun 03 08:00:28.880742 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:28.880704 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dd4vj" event={"ID":"0dbef335-62ed-405a-a0d5-74cc429ec15e","Type":"ContainerStarted","Data":"00e8d9ffb6fbedf3d5bdcb5254427b2565b893ac10fe5ae5039ddb0356c3b22a"} Jun 03 08:00:28.881189 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:28.880812 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 08:00:57.369877 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:57.369842 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 08:00:57.370237 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:57.369891 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert\") pod \"ingress-canary-rz58k\" (UID: \"18c59173-7593-42ad-9c17-2c8580e0a1da\") " pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 08:00:57.370237 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:57.369972 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:00:57.370237 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:57.369976 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:00:57.370237 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:57.370030 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert podName:18c59173-7593-42ad-9c17-2c8580e0a1da nodeName:}" failed. No retries permitted until 2026-06-03 08:02:01.370014672 +0000 UTC m=+162.349357575 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert") pod "ingress-canary-rz58k" (UID: "18c59173-7593-42ad-9c17-2c8580e0a1da") : secret "canary-serving-cert" not found Jun 03 08:00:57.370237 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:00:57.370042 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls podName:fe74542c-965c-4cec-886b-0c09af3fb49e nodeName:}" failed. No retries permitted until 2026-06-03 08:02:01.370036824 +0000 UTC m=+162.349379713 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls") pod "dns-default-5rxfl" (UID: "fe74542c-965c-4cec-886b-0c09af3fb49e") : secret "dns-default-metrics-tls" not found Jun 03 08:00:59.884862 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:59.884828 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dd4vj" Jun 03 08:00:59.897876 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:00:59.897822 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dd4vj" podStartSLOduration=97.829910557 podStartE2EDuration="1m40.897810337s" podCreationTimestamp="2026-06-03 07:59:19 +0000 UTC" firstStartedPulling="2026-06-03 08:00:25.647903952 +0000 UTC m=+66.627246845" lastFinishedPulling="2026-06-03 08:00:28.715803733 +0000 UTC m=+69.695146625" observedRunningTime="2026-06-03 08:00:28.894553881 +0000 UTC m=+69.873896792" watchObservedRunningTime="2026-06-03 08:00:59.897810337 +0000 UTC m=+100.877153247" Jun 03 08:01:29.278039 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:29.277999 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs\") pod \"network-metrics-daemon-rqpqj\" (UID: \"d56b198a-8bb2-4f98-9300-d4dffff20c44\") " pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 08:01:29.278548 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:29.278149 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 08:01:29.278548 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:29.278224 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs podName:d56b198a-8bb2-4f98-9300-d4dffff20c44 nodeName:}" failed. No retries permitted until 2026-06-03 08:03:31.278208051 +0000 UTC m=+252.257550953 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs") pod "network-metrics-daemon-rqpqj" (UID: "d56b198a-8bb2-4f98-9300-d4dffff20c44") : secret "metrics-daemon-secret" not found Jun 03 08:01:49.410207 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.410173 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-rzm6d"] Jun 03 08:01:49.412629 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.412615 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-rzm6d" Jun 03 08:01:49.414540 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.414519 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-l89zb\"" Jun 03 08:01:49.419803 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.419781 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-rzm6d"] Jun 03 08:01:49.509100 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.509074 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfj5v\" (UniqueName: \"kubernetes.io/projected/06e4f150-44cb-4e82-90a4-eded2af66af3-kube-api-access-mfj5v\") pod \"network-check-source-56d84b9f44-rzm6d\" (UID: \"06e4f150-44cb-4e82-90a4-eded2af66af3\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-rzm6d" Jun 03 08:01:49.514918 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.514896 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl"] Jun 03 08:01:49.517529 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.517510 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl" Jun 03 08:01:49.519507 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.519486 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dkcfc\"" Jun 03 08:01:49.519613 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.519509 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 08:01:49.519675 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.519656 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 08:01:49.519997 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.519978 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 08:01:49.533081 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.533059 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl"] Jun 03 08:01:49.610235 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.610205 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfj5v\" (UniqueName: \"kubernetes.io/projected/06e4f150-44cb-4e82-90a4-eded2af66af3-kube-api-access-mfj5v\") pod \"network-check-source-56d84b9f44-rzm6d\" (UID: \"06e4f150-44cb-4e82-90a4-eded2af66af3\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-rzm6d" Jun 03 08:01:49.610356 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.610265 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkcdd\" (UniqueName: \"kubernetes.io/projected/da0a23f7-d439-4793-939c-4b680c73b53d-kube-api-access-mkcdd\") pod \"cluster-samples-operator-755bbf9bfb-4gvnl\" (UID: \"da0a23f7-d439-4793-939c-4b680c73b53d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl" Jun 03 08:01:49.610356 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.610345 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-4gvnl\" (UID: \"da0a23f7-d439-4793-939c-4b680c73b53d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl" Jun 03 08:01:49.615692 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.615668 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq"] Jun 03 08:01:49.618215 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.618196 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt"] Jun 03 08:01:49.618300 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.618272 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq" Jun 03 08:01:49.620156 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.620136 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 08:01:49.620283 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.620268 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 08:01:49.620530 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.620513 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 08:01:49.620530 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.620523 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-845898d757-kxct6"] Jun 03 08:01:49.620689 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.620589 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 08:01:49.620689 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.620664 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" Jun 03 08:01:49.621081 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.621062 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9m6v5\"" Jun 03 08:01:49.622968 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.622952 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:49.623213 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.623193 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 08:01:49.623370 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.623354 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 08:01:49.624055 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.624035 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 08:01:49.624253 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.624239 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 08:01:49.624336 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.624278 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cpsxg\"" Jun 03 08:01:49.624753 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.624738 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 08:01:49.625002 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.624986 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 08:01:49.625069 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.625027 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 08:01:49.625383 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.625296 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tlx7q\"" Jun 03 08:01:49.625534 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.625500 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 08:01:49.625609 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.625558 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 08:01:49.625706 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.625510 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 08:01:49.631206 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.631185 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq"] Jun 03 08:01:49.633133 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.633108 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt"] Jun 03 08:01:49.635410 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.635381 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-845898d757-kxct6"] Jun 03 08:01:49.638204 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.638185 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfj5v\" (UniqueName: \"kubernetes.io/projected/06e4f150-44cb-4e82-90a4-eded2af66af3-kube-api-access-mfj5v\") pod \"network-check-source-56d84b9f44-rzm6d\" (UID: \"06e4f150-44cb-4e82-90a4-eded2af66af3\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-rzm6d" Jun 03 08:01:49.710705 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.710646 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-2gmnt\" (UID: \"88e128a3-4f38-4e7d-8358-1ca2b0fdbada\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" Jun 03 08:01:49.710705 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.710678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-2gmnt\" (UID: \"88e128a3-4f38-4e7d-8358-1ca2b0fdbada\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" Jun 03 08:01:49.710705 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.710696 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:49.710867 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.710742 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:49.710867 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.710786 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f-serving-cert\") pod \"service-ca-operator-69877444c-j8tcq\" (UID: \"fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq" Jun 03 08:01:49.710867 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.710818 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mkcdd\" (UniqueName: \"kubernetes.io/projected/da0a23f7-d439-4793-939c-4b680c73b53d-kube-api-access-mkcdd\") pod \"cluster-samples-operator-755bbf9bfb-4gvnl\" (UID: \"da0a23f7-d439-4793-939c-4b680c73b53d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl" Jun 03 08:01:49.710867 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.710839 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f-config\") pod \"service-ca-operator-69877444c-j8tcq\" (UID: \"fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq" Jun 03 08:01:49.710988 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.710870 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q78sm\" (UniqueName: \"kubernetes.io/projected/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-kube-api-access-q78sm\") pod \"cluster-monitoring-operator-69b6cbdb88-2gmnt\" (UID: \"88e128a3-4f38-4e7d-8358-1ca2b0fdbada\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" Jun 03 08:01:49.710988 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.710966 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-stats-auth\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:49.710988 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.710984 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dchlf\" (UniqueName: \"kubernetes.io/projected/fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f-kube-api-access-dchlf\") pod \"service-ca-operator-69877444c-j8tcq\" (UID: \"fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq" Jun 03 08:01:49.711090 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.711009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-default-certificate\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:49.711090 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.711033 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj75v\" (UniqueName: \"kubernetes.io/projected/1b9a0f50-6201-4143-9517-5617425c02bc-kube-api-access-sj75v\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:49.711090 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.711061 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-4gvnl\" (UID: \"da0a23f7-d439-4793-939c-4b680c73b53d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl" Jun 03 08:01:49.711179 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:49.711117 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 08:01:49.711214 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:49.711179 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls podName:da0a23f7-d439-4793-939c-4b680c73b53d nodeName:}" failed. No retries permitted until 2026-06-03 08:01:50.2111647 +0000 UTC m=+151.190507609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-4gvnl" (UID: "da0a23f7-d439-4793-939c-4b680c73b53d") : secret "samples-operator-tls" not found Jun 03 08:01:49.721079 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.721059 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-rzm6d" Jun 03 08:01:49.722148 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.722128 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkcdd\" (UniqueName: \"kubernetes.io/projected/da0a23f7-d439-4793-939c-4b680c73b53d-kube-api-access-mkcdd\") pod \"cluster-samples-operator-755bbf9bfb-4gvnl\" (UID: \"da0a23f7-d439-4793-939c-4b680c73b53d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl" Jun 03 08:01:49.811364 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.811339 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:49.811508 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.811371 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f-serving-cert\") pod \"service-ca-operator-69877444c-j8tcq\" (UID: \"fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq" Jun 03 08:01:49.811508 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.811475 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f-config\") pod \"service-ca-operator-69877444c-j8tcq\" (UID: \"fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq" Jun 03 08:01:49.811609 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.811511 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q78sm\" (UniqueName: \"kubernetes.io/projected/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-kube-api-access-q78sm\") pod \"cluster-monitoring-operator-69b6cbdb88-2gmnt\" (UID: \"88e128a3-4f38-4e7d-8358-1ca2b0fdbada\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" Jun 03 08:01:49.811609 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.811547 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-stats-auth\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:49.811609 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:49.811581 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle podName:1b9a0f50-6201-4143-9517-5617425c02bc nodeName:}" failed. No retries permitted until 2026-06-03 08:01:50.311556279 +0000 UTC m=+151.290899193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle") pod "router-default-845898d757-kxct6" (UID: "1b9a0f50-6201-4143-9517-5617425c02bc") : configmap references non-existent config key: service-ca.crt Jun 03 08:01:49.811754 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.811633 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dchlf\" (UniqueName: \"kubernetes.io/projected/fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f-kube-api-access-dchlf\") pod \"service-ca-operator-69877444c-j8tcq\" (UID: \"fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq" Jun 03 08:01:49.811754 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.811684 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-default-certificate\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:49.811754 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.811716 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sj75v\" (UniqueName: \"kubernetes.io/projected/1b9a0f50-6201-4143-9517-5617425c02bc-kube-api-access-sj75v\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:49.811912 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.811781 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-2gmnt\" (UID: \"88e128a3-4f38-4e7d-8358-1ca2b0fdbada\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" Jun 03 08:01:49.811912 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.811826 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-2gmnt\" (UID: \"88e128a3-4f38-4e7d-8358-1ca2b0fdbada\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" Jun 03 08:01:49.811912 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.811851 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:49.812059 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:49.811960 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 08:01:49.812059 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:49.812004 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs podName:1b9a0f50-6201-4143-9517-5617425c02bc nodeName:}" failed. No retries permitted until 2026-06-03 08:01:50.311989618 +0000 UTC m=+151.291332508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs") pod "router-default-845898d757-kxct6" (UID: "1b9a0f50-6201-4143-9517-5617425c02bc") : secret "router-metrics-certs-default" not found Jun 03 08:01:49.812059 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:49.812035 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 08:01:49.812221 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:49.812116 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls podName:88e128a3-4f38-4e7d-8358-1ca2b0fdbada nodeName:}" failed. No retries permitted until 2026-06-03 08:01:50.312096184 +0000 UTC m=+151.291439093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-2gmnt" (UID: "88e128a3-4f38-4e7d-8358-1ca2b0fdbada") : secret "cluster-monitoring-operator-tls" not found Jun 03 08:01:49.812652 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.812624 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f-config\") pod \"service-ca-operator-69877444c-j8tcq\" (UID: \"fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq" Jun 03 08:01:49.812949 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.812926 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-2gmnt\" (UID: \"88e128a3-4f38-4e7d-8358-1ca2b0fdbada\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" Jun 03 08:01:49.814407 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.814371 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f-serving-cert\") pod \"service-ca-operator-69877444c-j8tcq\" (UID: \"fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq" Jun 03 08:01:49.814513 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.814484 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-default-certificate\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:49.814513 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.814496 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-stats-auth\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:49.819208 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.819188 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dchlf\" (UniqueName: \"kubernetes.io/projected/fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f-kube-api-access-dchlf\") pod \"service-ca-operator-69877444c-j8tcq\" (UID: \"fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq" Jun 03 08:01:49.820194 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.820174 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj75v\" (UniqueName: \"kubernetes.io/projected/1b9a0f50-6201-4143-9517-5617425c02bc-kube-api-access-sj75v\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:49.820493 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.820474 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q78sm\" (UniqueName: \"kubernetes.io/projected/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-kube-api-access-q78sm\") pod \"cluster-monitoring-operator-69b6cbdb88-2gmnt\" (UID: \"88e128a3-4f38-4e7d-8358-1ca2b0fdbada\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" Jun 03 08:01:49.835036 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.835010 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-rzm6d"] Jun 03 08:01:49.838625 ip-10-0-128-28 kubenswrapper[2575]: W0603 08:01:49.838605 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e4f150_44cb_4e82_90a4_eded2af66af3.slice/crio-994bc450e048b7c8142f0d1f18a0b5cac942b13026791eff6e228575304f1377 WatchSource:0}: Error finding container 994bc450e048b7c8142f0d1f18a0b5cac942b13026791eff6e228575304f1377: Status 404 returned error can't find the container with id 994bc450e048b7c8142f0d1f18a0b5cac942b13026791eff6e228575304f1377 Jun 03 08:01:49.928478 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:49.928427 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq" Jun 03 08:01:50.032653 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:50.032617 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-rzm6d" event={"ID":"06e4f150-44cb-4e82-90a4-eded2af66af3","Type":"ContainerStarted","Data":"a2e8b93c47cd6cc2223a34a2caa2b5b6203bb116085b1e5a853c49d186f31136"} Jun 03 08:01:50.032653 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:50.032657 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-rzm6d" event={"ID":"06e4f150-44cb-4e82-90a4-eded2af66af3","Type":"ContainerStarted","Data":"994bc450e048b7c8142f0d1f18a0b5cac942b13026791eff6e228575304f1377"} Jun 03 08:01:50.044144 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:50.044119 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq"] Jun 03 08:01:50.047044 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:50.047008 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-rzm6d" podStartSLOduration=1.046995919 podStartE2EDuration="1.046995919s" podCreationTimestamp="2026-06-03 08:01:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:01:50.046304256 +0000 UTC m=+151.025647171" watchObservedRunningTime="2026-06-03 08:01:50.046995919 +0000 UTC m=+151.026338829" Jun 03 08:01:50.047607 ip-10-0-128-28 kubenswrapper[2575]: W0603 08:01:50.047585 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb83f0e7_3e5c_49a5_9e8c_ffc3e778d02f.slice/crio-ccf846de975cb63ff6733143e528182a72cf351de0349b70aeea1553f2f5827f WatchSource:0}: Error finding container ccf846de975cb63ff6733143e528182a72cf351de0349b70aeea1553f2f5827f: Status 404 returned error can't find the container with id ccf846de975cb63ff6733143e528182a72cf351de0349b70aeea1553f2f5827f Jun 03 08:01:50.214685 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:50.214658 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-4gvnl\" (UID: \"da0a23f7-d439-4793-939c-4b680c73b53d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl" Jun 03 08:01:50.214831 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:50.214807 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 08:01:50.214893 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:50.214873 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls podName:da0a23f7-d439-4793-939c-4b680c73b53d nodeName:}" failed. No retries permitted until 2026-06-03 08:01:51.214854371 +0000 UTC m=+152.194197274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-4gvnl" (UID: "da0a23f7-d439-4793-939c-4b680c73b53d") : secret "samples-operator-tls" not found Jun 03 08:01:50.315734 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:50.315654 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:50.315734 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:50.315700 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:50.315939 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:50.315821 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 08:01:50.315939 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:50.315826 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle podName:1b9a0f50-6201-4143-9517-5617425c02bc nodeName:}" failed. No retries permitted until 2026-06-03 08:01:51.315806558 +0000 UTC m=+152.295149460 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle") pod "router-default-845898d757-kxct6" (UID: "1b9a0f50-6201-4143-9517-5617425c02bc") : configmap references non-existent config key: service-ca.crt Jun 03 08:01:50.316044 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:50.316007 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs podName:1b9a0f50-6201-4143-9517-5617425c02bc nodeName:}" failed. No retries permitted until 2026-06-03 08:01:51.315977409 +0000 UTC m=+152.295320302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs") pod "router-default-845898d757-kxct6" (UID: "1b9a0f50-6201-4143-9517-5617425c02bc") : secret "router-metrics-certs-default" not found Jun 03 08:01:50.316101 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:50.316050 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-2gmnt\" (UID: \"88e128a3-4f38-4e7d-8358-1ca2b0fdbada\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" Jun 03 08:01:50.316198 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:50.316182 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 08:01:50.316238 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:50.316232 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls podName:88e128a3-4f38-4e7d-8358-1ca2b0fdbada nodeName:}" failed. No retries permitted until 2026-06-03 08:01:51.316219083 +0000 UTC m=+152.295561975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-2gmnt" (UID: "88e128a3-4f38-4e7d-8358-1ca2b0fdbada") : secret "cluster-monitoring-operator-tls" not found Jun 03 08:01:51.035668 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:51.035634 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq" event={"ID":"fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f","Type":"ContainerStarted","Data":"ccf846de975cb63ff6733143e528182a72cf351de0349b70aeea1553f2f5827f"} Jun 03 08:01:51.223086 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:51.223046 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-4gvnl\" (UID: \"da0a23f7-d439-4793-939c-4b680c73b53d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl" Jun 03 08:01:51.223263 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:51.223202 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 08:01:51.223319 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:51.223276 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls podName:da0a23f7-d439-4793-939c-4b680c73b53d nodeName:}" failed. No retries permitted until 2026-06-03 08:01:53.223259538 +0000 UTC m=+154.202602437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-4gvnl" (UID: "da0a23f7-d439-4793-939c-4b680c73b53d") : secret "samples-operator-tls" not found Jun 03 08:01:51.324369 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:51.324271 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-2gmnt\" (UID: \"88e128a3-4f38-4e7d-8358-1ca2b0fdbada\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" Jun 03 08:01:51.324369 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:51.324332 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:51.324611 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:51.324455 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 08:01:51.324611 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:51.324485 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:51.324611 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:51.324520 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs podName:1b9a0f50-6201-4143-9517-5617425c02bc nodeName:}" failed. No retries permitted until 2026-06-03 08:01:53.324500367 +0000 UTC m=+154.303843474 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs") pod "router-default-845898d757-kxct6" (UID: "1b9a0f50-6201-4143-9517-5617425c02bc") : secret "router-metrics-certs-default" not found Jun 03 08:01:51.324611 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:51.324455 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 08:01:51.324611 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:51.324571 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle podName:1b9a0f50-6201-4143-9517-5617425c02bc nodeName:}" failed. No retries permitted until 2026-06-03 08:01:53.324562161 +0000 UTC m=+154.303905056 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle") pod "router-default-845898d757-kxct6" (UID: "1b9a0f50-6201-4143-9517-5617425c02bc") : configmap references non-existent config key: service-ca.crt Jun 03 08:01:51.324611 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:51.324601 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls podName:88e128a3-4f38-4e7d-8358-1ca2b0fdbada nodeName:}" failed. No retries permitted until 2026-06-03 08:01:53.324584939 +0000 UTC m=+154.303927842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-2gmnt" (UID: "88e128a3-4f38-4e7d-8358-1ca2b0fdbada") : secret "cluster-monitoring-operator-tls" not found Jun 03 08:01:53.041198 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:53.041156 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq" event={"ID":"fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f","Type":"ContainerStarted","Data":"27a6b7896f1727de02d5b936064301d6319fa3aeee4839cbd1f0a2110f73393c"} Jun 03 08:01:53.070213 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:53.070161 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq" podStartSLOduration=1.7522182370000001 podStartE2EDuration="4.070148957s" podCreationTimestamp="2026-06-03 08:01:49 +0000 UTC" firstStartedPulling="2026-06-03 08:01:50.049257693 +0000 UTC m=+151.028600586" lastFinishedPulling="2026-06-03 08:01:52.367188413 +0000 UTC m=+153.346531306" observedRunningTime="2026-06-03 08:01:53.069451805 +0000 UTC m=+154.048794707" watchObservedRunningTime="2026-06-03 08:01:53.070148957 +0000 UTC m=+154.049491898" Jun 03 08:01:53.240708 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:53.240670 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-4gvnl\" (UID: \"da0a23f7-d439-4793-939c-4b680c73b53d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl" Jun 03 08:01:53.240863 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:53.240779 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 08:01:53.240863 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:53.240833 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls podName:da0a23f7-d439-4793-939c-4b680c73b53d nodeName:}" failed. No retries permitted until 2026-06-03 08:01:57.240819327 +0000 UTC m=+158.220162216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-4gvnl" (UID: "da0a23f7-d439-4793-939c-4b680c73b53d") : secret "samples-operator-tls" not found Jun 03 08:01:53.341464 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:53.341371 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-2gmnt\" (UID: \"88e128a3-4f38-4e7d-8358-1ca2b0fdbada\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" Jun 03 08:01:53.341464 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:53.341413 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:53.341464 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:53.341462 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:53.341691 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:53.341534 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 08:01:53.341691 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:53.341578 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 08:01:53.341691 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:53.341582 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle podName:1b9a0f50-6201-4143-9517-5617425c02bc nodeName:}" failed. No retries permitted until 2026-06-03 08:01:57.341564813 +0000 UTC m=+158.320907719 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle") pod "router-default-845898d757-kxct6" (UID: "1b9a0f50-6201-4143-9517-5617425c02bc") : configmap references non-existent config key: service-ca.crt Jun 03 08:01:53.341691 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:53.341636 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls podName:88e128a3-4f38-4e7d-8358-1ca2b0fdbada nodeName:}" failed. No retries permitted until 2026-06-03 08:01:57.341622943 +0000 UTC m=+158.320965834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-2gmnt" (UID: "88e128a3-4f38-4e7d-8358-1ca2b0fdbada") : secret "cluster-monitoring-operator-tls" not found Jun 03 08:01:53.341691 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:53.341647 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs podName:1b9a0f50-6201-4143-9517-5617425c02bc nodeName:}" failed. No retries permitted until 2026-06-03 08:01:57.341641033 +0000 UTC m=+158.320983921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs") pod "router-default-845898d757-kxct6" (UID: "1b9a0f50-6201-4143-9517-5617425c02bc") : secret "router-metrics-certs-default" not found Jun 03 08:01:54.984205 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:54.984173 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-jlhff"] Jun 03 08:01:54.986994 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:54.986978 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-jlhff" Jun 03 08:01:54.988887 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:54.988858 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6h7zb\"" Jun 03 08:01:54.989404 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:54.989387 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 08:01:54.989488 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:54.989388 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 08:01:54.996479 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:54.996459 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-jlhff"] Jun 03 08:01:55.000747 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:55.000722 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dgbmm_8e98347d-1bbd-4bf5-84fc-9d8a4386606c/dns-node-resolver/0.log" Jun 03 08:01:55.154972 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:55.154941 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ln4x\" (UniqueName: \"kubernetes.io/projected/bbd74c2c-7712-4673-96ba-61b458ae9f8c-kube-api-access-4ln4x\") pod \"migrator-96c6f749-jlhff\" (UID: \"bbd74c2c-7712-4673-96ba-61b458ae9f8c\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-jlhff" Jun 03 08:01:55.255605 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:55.255519 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ln4x\" (UniqueName: \"kubernetes.io/projected/bbd74c2c-7712-4673-96ba-61b458ae9f8c-kube-api-access-4ln4x\") pod \"migrator-96c6f749-jlhff\" (UID: \"bbd74c2c-7712-4673-96ba-61b458ae9f8c\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-jlhff" Jun 03 08:01:55.262443 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:55.262419 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ln4x\" (UniqueName: \"kubernetes.io/projected/bbd74c2c-7712-4673-96ba-61b458ae9f8c-kube-api-access-4ln4x\") pod \"migrator-96c6f749-jlhff\" (UID: \"bbd74c2c-7712-4673-96ba-61b458ae9f8c\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-jlhff" Jun 03 08:01:55.295283 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:55.295262 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-jlhff" Jun 03 08:01:55.412252 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:55.412220 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-jlhff"] Jun 03 08:01:55.415379 ip-10-0-128-28 kubenswrapper[2575]: W0603 08:01:55.415337 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd74c2c_7712_4673_96ba_61b458ae9f8c.slice/crio-4d7efaf64706fecafd0546445259d90b9d8ad315a909771bf3829d9436df73b5 WatchSource:0}: Error finding container 4d7efaf64706fecafd0546445259d90b9d8ad315a909771bf3829d9436df73b5: Status 404 returned error can't find the container with id 4d7efaf64706fecafd0546445259d90b9d8ad315a909771bf3829d9436df73b5 Jun 03 08:01:55.999000 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:55.998974 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wpg8p_6f2cf176-8955-4aeb-a63e-5c75c3c73886/node-ca/0.log" Jun 03 08:01:56.047723 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:56.047692 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-jlhff" event={"ID":"bbd74c2c-7712-4673-96ba-61b458ae9f8c","Type":"ContainerStarted","Data":"4d7efaf64706fecafd0546445259d90b9d8ad315a909771bf3829d9436df73b5"} Jun 03 08:01:56.466618 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:56.466575 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5rxfl" podUID="fe74542c-965c-4cec-886b-0c09af3fb49e" Jun 03 08:01:56.479513 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:56.479462 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-rz58k" podUID="18c59173-7593-42ad-9c17-2c8580e0a1da" Jun 03 08:01:57.054675 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:57.054640 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-jlhff" event={"ID":"bbd74c2c-7712-4673-96ba-61b458ae9f8c","Type":"ContainerStarted","Data":"21b85ddd249146f5631f61a9b1a761656304f16b61e21d4ebd49328c7150aecc"} Jun 03 08:01:57.054675 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:57.054678 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-jlhff" event={"ID":"bbd74c2c-7712-4673-96ba-61b458ae9f8c","Type":"ContainerStarted","Data":"797ca57d28c155035139cc8e3b3fef46a170ec39f04804f7a24249db9f776c75"} Jun 03 08:01:57.055077 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:57.054703 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5rxfl" Jun 03 08:01:57.068697 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:57.068650 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-jlhff" podStartSLOduration=1.8192714030000001 podStartE2EDuration="3.068638951s" podCreationTimestamp="2026-06-03 08:01:54 +0000 UTC" firstStartedPulling="2026-06-03 08:01:55.417101392 +0000 UTC m=+156.396444284" lastFinishedPulling="2026-06-03 08:01:56.666468931 +0000 UTC m=+157.645811832" observedRunningTime="2026-06-03 08:01:57.068339934 +0000 UTC m=+158.047682845" watchObservedRunningTime="2026-06-03 08:01:57.068638951 +0000 UTC m=+158.047981862" Jun 03 08:01:57.274392 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:57.274313 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-4gvnl\" (UID: \"da0a23f7-d439-4793-939c-4b680c73b53d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl" Jun 03 08:01:57.274552 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:57.274475 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 08:01:57.274552 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:57.274534 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls podName:da0a23f7-d439-4793-939c-4b680c73b53d nodeName:}" failed. No retries permitted until 2026-06-03 08:02:05.274516971 +0000 UTC m=+166.253859877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-4gvnl" (UID: "da0a23f7-d439-4793-939c-4b680c73b53d") : secret "samples-operator-tls" not found Jun 03 08:01:57.374833 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:57.374801 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-2gmnt\" (UID: \"88e128a3-4f38-4e7d-8358-1ca2b0fdbada\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" Jun 03 08:01:57.374975 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:57.374838 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:57.374975 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:01:57.374863 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:01:57.374975 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:57.374949 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 08:01:57.375114 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:57.374980 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle podName:1b9a0f50-6201-4143-9517-5617425c02bc nodeName:}" failed. No retries permitted until 2026-06-03 08:02:05.374967104 +0000 UTC m=+166.354309994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle") pod "router-default-845898d757-kxct6" (UID: "1b9a0f50-6201-4143-9517-5617425c02bc") : configmap references non-existent config key: service-ca.crt Jun 03 08:01:57.375114 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:57.374999 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls podName:88e128a3-4f38-4e7d-8358-1ca2b0fdbada nodeName:}" failed. No retries permitted until 2026-06-03 08:02:05.374987546 +0000 UTC m=+166.354330438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-2gmnt" (UID: "88e128a3-4f38-4e7d-8358-1ca2b0fdbada") : secret "cluster-monitoring-operator-tls" not found Jun 03 08:01:57.375114 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:57.374949 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 08:01:57.375114 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:57.375026 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs podName:1b9a0f50-6201-4143-9517-5617425c02bc nodeName:}" failed. No retries permitted until 2026-06-03 08:02:05.375017728 +0000 UTC m=+166.354360618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs") pod "router-default-845898d757-kxct6" (UID: "1b9a0f50-6201-4143-9517-5617425c02bc") : secret "router-metrics-certs-default" not found Jun 03 08:01:57.619896 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:01:57.619860 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rqpqj" podUID="d56b198a-8bb2-4f98-9300-d4dffff20c44" Jun 03 08:02:01.406990 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:01.406950 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 08:02:01.407397 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:01.407022 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert\") pod \"ingress-canary-rz58k\" (UID: \"18c59173-7593-42ad-9c17-2c8580e0a1da\") " pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 08:02:01.407397 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:02:01.407114 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:02:01.407397 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:02:01.407131 2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:02:01.407397 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:02:01.407180 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert podName:18c59173-7593-42ad-9c17-2c8580e0a1da nodeName:}" failed. No retries permitted until 2026-06-03 08:04:03.407165877 +0000 UTC m=+284.386508779 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert") pod "ingress-canary-rz58k" (UID: "18c59173-7593-42ad-9c17-2c8580e0a1da") : secret "canary-serving-cert" not found Jun 03 08:02:01.407397 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:02:01.407193 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls podName:fe74542c-965c-4cec-886b-0c09af3fb49e nodeName:}" failed. No retries permitted until 2026-06-03 08:04:03.407187436 +0000 UTC m=+284.386530338 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls") pod "dns-default-5rxfl" (UID: "fe74542c-965c-4cec-886b-0c09af3fb49e") : secret "dns-default-metrics-tls" not found Jun 03 08:02:05.338632 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:05.338594 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-4gvnl\" (UID: \"da0a23f7-d439-4793-939c-4b680c73b53d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl" Jun 03 08:02:05.341030 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:05.341004 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da0a23f7-d439-4793-939c-4b680c73b53d-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-4gvnl\" (UID: \"da0a23f7-d439-4793-939c-4b680c73b53d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl" Jun 03 08:02:05.425629 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:05.425590 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl" Jun 03 08:02:05.439699 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:05.439673 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-2gmnt\" (UID: \"88e128a3-4f38-4e7d-8358-1ca2b0fdbada\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" Jun 03 08:02:05.439796 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:05.439713 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:02:05.439796 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:05.439733 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:02:05.439925 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:02:05.439905 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 08:02:05.439996 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:02:05.439985 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls podName:88e128a3-4f38-4e7d-8358-1ca2b0fdbada nodeName:}" failed. No retries permitted until 2026-06-03 08:02:21.43996363 +0000 UTC m=+182.419306741 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-2gmnt" (UID: "88e128a3-4f38-4e7d-8358-1ca2b0fdbada") : secret "cluster-monitoring-operator-tls" not found Jun 03 08:02:05.440299 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:05.440282 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9a0f50-6201-4143-9517-5617425c02bc-service-ca-bundle\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:02:05.441852 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:05.441831 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b9a0f50-6201-4143-9517-5617425c02bc-metrics-certs\") pod \"router-default-845898d757-kxct6\" (UID: \"1b9a0f50-6201-4143-9517-5617425c02bc\") " pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:02:05.542585 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:05.542556 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl"] Jun 03 08:02:05.549376 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:05.549355 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:02:05.669768 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:05.669736 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-845898d757-kxct6"] Jun 03 08:02:05.672689 ip-10-0-128-28 kubenswrapper[2575]: W0603 08:02:05.672660 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b9a0f50_6201_4143_9517_5617425c02bc.slice/crio-101d739c3f32c4668b8f32f6036d6f153b82106ee1aa23133c447342ab1e7bdc WatchSource:0}: Error finding container 101d739c3f32c4668b8f32f6036d6f153b82106ee1aa23133c447342ab1e7bdc: Status 404 returned error can't find the container with id 101d739c3f32c4668b8f32f6036d6f153b82106ee1aa23133c447342ab1e7bdc Jun 03 08:02:06.077286 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:06.077249 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-845898d757-kxct6" event={"ID":"1b9a0f50-6201-4143-9517-5617425c02bc","Type":"ContainerStarted","Data":"ec901efb2fdf9cf403c373bac0ac67b0a7e26d9b300cc1b34428653c5e27b57d"} Jun 03 08:02:06.077286 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:06.077290 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-845898d757-kxct6" event={"ID":"1b9a0f50-6201-4143-9517-5617425c02bc","Type":"ContainerStarted","Data":"101d739c3f32c4668b8f32f6036d6f153b82106ee1aa23133c447342ab1e7bdc"} Jun 03 08:02:06.078246 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:06.078217 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl" event={"ID":"da0a23f7-d439-4793-939c-4b680c73b53d","Type":"ContainerStarted","Data":"94deec2c5f0ca683dab047bb4c4fcf1d1637404e756fb8ff99c4d8e5535c3c67"} Jun 03 08:02:06.094580 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:06.094537 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-845898d757-kxct6" podStartSLOduration=17.094523481 podStartE2EDuration="17.094523481s" podCreationTimestamp="2026-06-03 08:01:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:02:06.09299186 +0000 UTC m=+167.072334770" watchObservedRunningTime="2026-06-03 08:02:06.094523481 +0000 UTC m=+167.073866391" Jun 03 08:02:06.549736 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:06.549703 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:02:06.552727 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:06.552702 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:02:07.081613 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:07.081575 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:02:07.082968 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:07.082931 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-845898d757-kxct6" Jun 03 08:02:08.085449 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:08.085402 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl" event={"ID":"da0a23f7-d439-4793-939c-4b680c73b53d","Type":"ContainerStarted","Data":"1fe80bac9b18fe54029cc285107f26a4c4080275cac90d0c41931fcafe5dcead"} Jun 03 08:02:08.085449 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:08.085452 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl" event={"ID":"da0a23f7-d439-4793-939c-4b680c73b53d","Type":"ContainerStarted","Data":"93a6de50055a698f9233c703ae7d9c0b7f542505fb16f9eb76b939d4a943d44c"} Jun 03 08:02:08.101809 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:08.101764 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4gvnl" podStartSLOduration=17.41175049 podStartE2EDuration="19.101752647s" podCreationTimestamp="2026-06-03 08:01:49 +0000 UTC" firstStartedPulling="2026-06-03 08:02:05.588968062 +0000 UTC m=+166.568310951" lastFinishedPulling="2026-06-03 08:02:07.278970212 +0000 UTC m=+168.258313108" observedRunningTime="2026-06-03 08:02:08.100891511 +0000 UTC m=+169.080234421" watchObservedRunningTime="2026-06-03 08:02:08.101752647 +0000 UTC m=+169.081095558" Jun 03 08:02:08.602705 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:08.602673 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 08:02:09.603863 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:09.603794 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 08:02:19.587586 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.587554 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8qpwh"] Jun 03 08:02:19.595462 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.595423 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8qpwh" Jun 03 08:02:19.600088 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.600067 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 08:02:19.600202 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.600188 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ntrnn\"" Jun 03 08:02:19.600792 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.600768 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 08:02:19.600974 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.600814 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 08:02:19.600974 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.600854 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8qpwh"] Jun 03 08:02:19.600974 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.600816 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 08:02:19.645775 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.645748 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ff006ff4-7222-4264-80e2-090c651c1205-crio-socket\") pod \"insights-runtime-extractor-8qpwh\" (UID: \"ff006ff4-7222-4264-80e2-090c651c1205\") " pod="openshift-insights/insights-runtime-extractor-8qpwh" Jun 03 08:02:19.645920 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.645783 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff006ff4-7222-4264-80e2-090c651c1205-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qpwh\" (UID: \"ff006ff4-7222-4264-80e2-090c651c1205\") " pod="openshift-insights/insights-runtime-extractor-8qpwh" Jun 03 08:02:19.645920 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.645852 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff006ff4-7222-4264-80e2-090c651c1205-data-volume\") pod \"insights-runtime-extractor-8qpwh\" (UID: \"ff006ff4-7222-4264-80e2-090c651c1205\") " pod="openshift-insights/insights-runtime-extractor-8qpwh" Jun 03 08:02:19.645920 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.645872 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb26c\" (UniqueName: \"kubernetes.io/projected/ff006ff4-7222-4264-80e2-090c651c1205-kube-api-access-tb26c\") pod \"insights-runtime-extractor-8qpwh\" (UID: \"ff006ff4-7222-4264-80e2-090c651c1205\") " pod="openshift-insights/insights-runtime-extractor-8qpwh" Jun 03 08:02:19.646032 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.645928 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff006ff4-7222-4264-80e2-090c651c1205-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qpwh\" (UID: \"ff006ff4-7222-4264-80e2-090c651c1205\") " pod="openshift-insights/insights-runtime-extractor-8qpwh" Jun 03 08:02:19.747007 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.746976 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff006ff4-7222-4264-80e2-090c651c1205-data-volume\") pod \"insights-runtime-extractor-8qpwh\" (UID: \"ff006ff4-7222-4264-80e2-090c651c1205\") " pod="openshift-insights/insights-runtime-extractor-8qpwh" Jun 03 08:02:19.747007 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.747007 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tb26c\" (UniqueName: \"kubernetes.io/projected/ff006ff4-7222-4264-80e2-090c651c1205-kube-api-access-tb26c\") pod \"insights-runtime-extractor-8qpwh\" (UID: \"ff006ff4-7222-4264-80e2-090c651c1205\") " pod="openshift-insights/insights-runtime-extractor-8qpwh" Jun 03 08:02:19.747204 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.747028 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff006ff4-7222-4264-80e2-090c651c1205-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qpwh\" (UID: \"ff006ff4-7222-4264-80e2-090c651c1205\") " pod="openshift-insights/insights-runtime-extractor-8qpwh" Jun 03 08:02:19.747204 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.747085 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ff006ff4-7222-4264-80e2-090c651c1205-crio-socket\") pod \"insights-runtime-extractor-8qpwh\" (UID: \"ff006ff4-7222-4264-80e2-090c651c1205\") " pod="openshift-insights/insights-runtime-extractor-8qpwh" Jun 03 08:02:19.747204 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.747105 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff006ff4-7222-4264-80e2-090c651c1205-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qpwh\" (UID: \"ff006ff4-7222-4264-80e2-090c651c1205\") " pod="openshift-insights/insights-runtime-extractor-8qpwh" Jun 03 08:02:19.747311 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.747202 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ff006ff4-7222-4264-80e2-090c651c1205-crio-socket\") pod \"insights-runtime-extractor-8qpwh\" (UID: \"ff006ff4-7222-4264-80e2-090c651c1205\") " pod="openshift-insights/insights-runtime-extractor-8qpwh" Jun 03 08:02:19.747381 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.747362 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff006ff4-7222-4264-80e2-090c651c1205-data-volume\") pod \"insights-runtime-extractor-8qpwh\" (UID: \"ff006ff4-7222-4264-80e2-090c651c1205\") " pod="openshift-insights/insights-runtime-extractor-8qpwh" Jun 03 08:02:19.747569 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.747554 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff006ff4-7222-4264-80e2-090c651c1205-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qpwh\" (UID: \"ff006ff4-7222-4264-80e2-090c651c1205\") " pod="openshift-insights/insights-runtime-extractor-8qpwh" Jun 03 08:02:19.749350 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.749331 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff006ff4-7222-4264-80e2-090c651c1205-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qpwh\" (UID: \"ff006ff4-7222-4264-80e2-090c651c1205\") " pod="openshift-insights/insights-runtime-extractor-8qpwh" Jun 03 08:02:19.758379 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.758351 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb26c\" (UniqueName: \"kubernetes.io/projected/ff006ff4-7222-4264-80e2-090c651c1205-kube-api-access-tb26c\") pod \"insights-runtime-extractor-8qpwh\" (UID: \"ff006ff4-7222-4264-80e2-090c651c1205\") " pod="openshift-insights/insights-runtime-extractor-8qpwh" Jun 03 08:02:19.904115 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:19.904088 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8qpwh" Jun 03 08:02:20.024789 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:20.024759 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8qpwh"] Jun 03 08:02:20.027697 ip-10-0-128-28 kubenswrapper[2575]: W0603 08:02:20.027672 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff006ff4_7222_4264_80e2_090c651c1205.slice/crio-5674e29ba9ba63572073cf23b40fb94942be1090bd260b5663cff6190a1679c3 WatchSource:0}: Error finding container 5674e29ba9ba63572073cf23b40fb94942be1090bd260b5663cff6190a1679c3: Status 404 returned error can't find the container with id 5674e29ba9ba63572073cf23b40fb94942be1090bd260b5663cff6190a1679c3 Jun 03 08:02:20.114676 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:20.114649 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8qpwh" event={"ID":"ff006ff4-7222-4264-80e2-090c651c1205","Type":"ContainerStarted","Data":"0d29acf0756130dbbd91ceb08629167cb5e83ddd6fe04e54443f43722ec6a1ce"} Jun 03 08:02:20.114793 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:20.114683 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8qpwh" event={"ID":"ff006ff4-7222-4264-80e2-090c651c1205","Type":"ContainerStarted","Data":"5674e29ba9ba63572073cf23b40fb94942be1090bd260b5663cff6190a1679c3"} Jun 03 08:02:21.118359 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:21.118315 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8qpwh" event={"ID":"ff006ff4-7222-4264-80e2-090c651c1205","Type":"ContainerStarted","Data":"959e6f5ec9e4d2e2b46d4638b9979f0c3034c6fe31256e794880bd750845988f"} Jun 03 08:02:21.460218 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:21.460136 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-2gmnt\" (UID: \"88e128a3-4f38-4e7d-8358-1ca2b0fdbada\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" Jun 03 08:02:21.462893 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:21.462856 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88e128a3-4f38-4e7d-8358-1ca2b0fdbada-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-2gmnt\" (UID: \"88e128a3-4f38-4e7d-8358-1ca2b0fdbada\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" Jun 03 08:02:21.741616 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:21.741537 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cpsxg\"" Jun 03 08:02:21.750296 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:21.750265 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" Jun 03 08:02:21.882074 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:21.882034 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt"] Jun 03 08:02:21.886548 ip-10-0-128-28 kubenswrapper[2575]: W0603 08:02:21.886514 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e128a3_4f38_4e7d_8358_1ca2b0fdbada.slice/crio-3fbefb50a15a2adfe6c769e6f03e258a07441a245d40c54aa4be611e2939e1c1 WatchSource:0}: Error finding container 3fbefb50a15a2adfe6c769e6f03e258a07441a245d40c54aa4be611e2939e1c1: Status 404 returned error can't find the container with id 3fbefb50a15a2adfe6c769e6f03e258a07441a245d40c54aa4be611e2939e1c1 Jun 03 08:02:22.122488 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:22.122450 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" event={"ID":"88e128a3-4f38-4e7d-8358-1ca2b0fdbada","Type":"ContainerStarted","Data":"3fbefb50a15a2adfe6c769e6f03e258a07441a245d40c54aa4be611e2939e1c1"} Jun 03 08:02:23.127027 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:23.126976 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8qpwh" event={"ID":"ff006ff4-7222-4264-80e2-090c651c1205","Type":"ContainerStarted","Data":"dc45fd6b47f993520e25e71daaa21963d5cfe94ba90aabb91a34a6bbadea75b6"} Jun 03 08:02:23.141307 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:23.141260 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8qpwh" podStartSLOduration=1.723794878 podStartE2EDuration="4.141245987s" podCreationTimestamp="2026-06-03 08:02:19 +0000 UTC" firstStartedPulling="2026-06-03 08:02:20.086368452 +0000 UTC m=+181.065711344" lastFinishedPulling="2026-06-03 08:02:22.503819561 +0000 UTC m=+183.483162453" observedRunningTime="2026-06-03 08:02:23.141053172 +0000 UTC m=+184.120396084" watchObservedRunningTime="2026-06-03 08:02:23.141245987 +0000 UTC m=+184.120588898" Jun 03 08:02:24.130756 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:24.130720 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" event={"ID":"88e128a3-4f38-4e7d-8358-1ca2b0fdbada","Type":"ContainerStarted","Data":"19e9f7c9f3fcad6943c9f81065b6367293b69833f52b9868263933753acccf6b"} Jun 03 08:02:24.146558 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:24.146507 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-2gmnt" podStartSLOduration=33.116340681 podStartE2EDuration="35.146493186s" podCreationTimestamp="2026-06-03 08:01:49 +0000 UTC" firstStartedPulling="2026-06-03 08:02:21.888731788 +0000 UTC m=+182.868074696" lastFinishedPulling="2026-06-03 08:02:23.918884297 +0000 UTC m=+184.898227201" observedRunningTime="2026-06-03 08:02:24.144971765 +0000 UTC m=+185.124314678" watchObservedRunningTime="2026-06-03 08:02:24.146493186 +0000 UTC m=+185.125836097" Jun 03 08:02:31.820419 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:31.820385 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d6pcw"] Jun 03 08:02:31.822573 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:31.822553 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:31.824501 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:31.824478 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 08:02:31.824615 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:31.824497 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 08:02:31.824729 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:31.824716 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 08:02:31.824813 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:31.824796 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-trm4b\"" Jun 03 08:02:31.825162 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:31.825146 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 08:02:31.944414 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:31.944386 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-node-exporter-textfile\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:31.944574 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:31.944424 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:31.944574 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:31.944523 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-node-exporter-accelerators-collector-config\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:31.944574 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:31.944550 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-node-exporter-wtmp\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:31.944710 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:31.944584 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-root\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:31.944710 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:31.944602 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8xk2\" (UniqueName: \"kubernetes.io/projected/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-kube-api-access-w8xk2\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:31.944710 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:31.944630 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-metrics-client-ca\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:31.944710 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:31.944664 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-node-exporter-tls\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:31.944710 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:31.944680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-sys\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.045964 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.045927 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-root\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.046090 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.045968 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w8xk2\" (UniqueName: \"kubernetes.io/projected/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-kube-api-access-w8xk2\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.046090 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.045996 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-metrics-client-ca\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.046090 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.046033 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-node-exporter-tls\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.046090 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.046035 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-root\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.046090 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.046060 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-sys\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.046259 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.046135 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-sys\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.046259 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.046166 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-node-exporter-textfile\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.046259 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.046192 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.046373 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.046289 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-node-exporter-accelerators-collector-config\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.046373 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.046335 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-node-exporter-wtmp\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.046534 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.046515 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-node-exporter-wtmp\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.046595 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.046512 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-node-exporter-textfile\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.046687 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.046670 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-metrics-client-ca\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.046883 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.046861 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-node-exporter-accelerators-collector-config\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.048293 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.048277 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.048402 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.048387 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-node-exporter-tls\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.052459 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.052420 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8xk2\" (UniqueName: \"kubernetes.io/projected/0faea3c7-fcd3-4151-bb47-b33b58e8bad7-kube-api-access-w8xk2\") pod \"node-exporter-d6pcw\" (UID: \"0faea3c7-fcd3-4151-bb47-b33b58e8bad7\") " pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.131680 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.131656 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d6pcw" Jun 03 08:02:32.139384 ip-10-0-128-28 kubenswrapper[2575]: W0603 08:02:32.139358 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0faea3c7_fcd3_4151_bb47_b33b58e8bad7.slice/crio-473dc964c9ed2b878e3d441d1fa65794c74b94aa1adfb083b0ffb76818f9f40a WatchSource:0}: Error finding container 473dc964c9ed2b878e3d441d1fa65794c74b94aa1adfb083b0ffb76818f9f40a: Status 404 returned error can't find the container with id 473dc964c9ed2b878e3d441d1fa65794c74b94aa1adfb083b0ffb76818f9f40a Jun 03 08:02:32.152955 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.152928 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6pcw" event={"ID":"0faea3c7-fcd3-4151-bb47-b33b58e8bad7","Type":"ContainerStarted","Data":"473dc964c9ed2b878e3d441d1fa65794c74b94aa1adfb083b0ffb76818f9f40a"} Jun 03 08:02:32.891836 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.891806 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 08:02:32.894648 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.894591 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:32.896773 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.896555 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 08:02:32.896773 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.896614 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 08:02:32.896773 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.896680 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 08:02:32.896773 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.896767 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 08:02:32.897042 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.896835 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jmngj\"" Jun 03 08:02:32.897042 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.896982 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 08:02:32.897042 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.897010 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 08:02:32.897185 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.897079 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 08:02:32.897185 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.897084 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 08:02:32.897576 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.897358 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 08:02:32.906760 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.906738 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 08:02:32.953638 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.953610 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0265d1a-2edc-432c-bcc6-467482a5ce00-config-out\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:32.953776 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.953648 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c0265d1a-2edc-432c-bcc6-467482a5ce00-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:32.953776 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.953741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:32.953776 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.953772 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:32.953930 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.953790 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-web-config\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:32.953930 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.953849 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0265d1a-2edc-432c-bcc6-467482a5ce00-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:32.953930 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.953868 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twdw2\" (UniqueName: \"kubernetes.io/projected/c0265d1a-2edc-432c-bcc6-467482a5ce00-kube-api-access-twdw2\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:32.954056 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.953932 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:32.954056 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.953981 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0265d1a-2edc-432c-bcc6-467482a5ce00-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:32.954056 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.954018 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:32.954056 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.954039 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:32.954239 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.954095 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0265d1a-2edc-432c-bcc6-467482a5ce00-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:32.954239 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:32.954149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-config-volume\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.054829 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.054795 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.054996 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.054835 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.054996 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.054868 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0265d1a-2edc-432c-bcc6-467482a5ce00-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.054996 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.054900 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-config-volume\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.054996 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.054931 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0265d1a-2edc-432c-bcc6-467482a5ce00-config-out\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.054996 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.054961 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c0265d1a-2edc-432c-bcc6-467482a5ce00-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.055262 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.055011 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.055262 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.055044 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.055262 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.055066 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-web-config\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.055262 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.055100 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0265d1a-2edc-432c-bcc6-467482a5ce00-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.055262 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.055126 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twdw2\" (UniqueName: \"kubernetes.io/projected/c0265d1a-2edc-432c-bcc6-467482a5ce00-kube-api-access-twdw2\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.055262 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.055183 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.055262 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.055223 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0265d1a-2edc-432c-bcc6-467482a5ce00-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.055641 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:02:33.055304 2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 03 08:02:33.056343 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.055707 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c0265d1a-2edc-432c-bcc6-467482a5ce00-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.056343 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:02:33.055312 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0265d1a-2edc-432c-bcc6-467482a5ce00-alertmanager-trusted-ca-bundle podName:c0265d1a-2edc-432c-bcc6-467482a5ce00 nodeName:}" failed. No retries permitted until 2026-06-03 08:02:33.555282943 +0000 UTC m=+194.534625835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/c0265d1a-2edc-432c-bcc6-467482a5ce00-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "c0265d1a-2edc-432c-bcc6-467482a5ce00") : configmap references non-existent config key: ca-bundle.crt Jun 03 08:02:33.056343 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:02:33.055769 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-main-tls podName:c0265d1a-2edc-432c-bcc6-467482a5ce00 nodeName:}" failed. No retries permitted until 2026-06-03 08:02:33.555749676 +0000 UTC m=+194.535092565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c0265d1a-2edc-432c-bcc6-467482a5ce00") : secret "alertmanager-main-tls" not found Jun 03 08:02:33.057905 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.057878 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.058564 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.058539 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0265d1a-2edc-432c-bcc6-467482a5ce00-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.059649 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.059605 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0265d1a-2edc-432c-bcc6-467482a5ce00-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.060100 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.060056 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0265d1a-2edc-432c-bcc6-467482a5ce00-config-out\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.060190 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.060160 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-web-config\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.060515 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.060389 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-config-volume\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.060836 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.060806 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.060836 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.060831 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.061580 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.061557 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.063585 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.063565 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twdw2\" (UniqueName: \"kubernetes.io/projected/c0265d1a-2edc-432c-bcc6-467482a5ce00-kube-api-access-twdw2\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.559898 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.559814 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.559898 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.559894 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0265d1a-2edc-432c-bcc6-467482a5ce00-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.560561 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.560543 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0265d1a-2edc-432c-bcc6-467482a5ce00-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.562182 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.562156 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.806878 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.806824 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:02:33.939229 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:33.939198 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 08:02:33.941788 ip-10-0-128-28 kubenswrapper[2575]: W0603 08:02:33.941758 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0265d1a_2edc_432c_bcc6_467482a5ce00.slice/crio-dc648189fb17d33eae8225596b8ac92f2e9d0d3be6fd97cbb803d60ab00914c0 WatchSource:0}: Error finding container dc648189fb17d33eae8225596b8ac92f2e9d0d3be6fd97cbb803d60ab00914c0: Status 404 returned error can't find the container with id dc648189fb17d33eae8225596b8ac92f2e9d0d3be6fd97cbb803d60ab00914c0 Jun 03 08:02:34.161530 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:34.161496 2575 generic.go:358] "Generic (PLEG): container finished" podID="0faea3c7-fcd3-4151-bb47-b33b58e8bad7" containerID="47fbfbf9fb17117619c1e98b140aec6395373c237c7c1f119d3e2bd90a82ec0d" exitCode=0 Jun 03 08:02:34.161834 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:34.161575 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6pcw" event={"ID":"0faea3c7-fcd3-4151-bb47-b33b58e8bad7","Type":"ContainerDied","Data":"47fbfbf9fb17117619c1e98b140aec6395373c237c7c1f119d3e2bd90a82ec0d"} Jun 03 08:02:34.162789 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:34.162762 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0265d1a-2edc-432c-bcc6-467482a5ce00","Type":"ContainerStarted","Data":"dc648189fb17d33eae8225596b8ac92f2e9d0d3be6fd97cbb803d60ab00914c0"} Jun 03 08:02:35.168179 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:35.168145 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6pcw" event={"ID":"0faea3c7-fcd3-4151-bb47-b33b58e8bad7","Type":"ContainerStarted","Data":"8c0fa41d773310a82a546b18d081e7f26f3035818a2bd98d6a46bd9823970c99"} Jun 03 08:02:35.168543 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:35.168188 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6pcw" event={"ID":"0faea3c7-fcd3-4151-bb47-b33b58e8bad7","Type":"ContainerStarted","Data":"48c2a230812957e29dfd90c0b064060694e27c2e88fcaa63f0baa24cc94326fd"} Jun 03 08:02:35.188169 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:35.188126 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d6pcw" podStartSLOduration=3.094117523 podStartE2EDuration="4.188112525s" podCreationTimestamp="2026-06-03 08:02:31 +0000 UTC" firstStartedPulling="2026-06-03 08:02:32.141006574 +0000 UTC m=+193.120349466" lastFinishedPulling="2026-06-03 08:02:33.235001578 +0000 UTC m=+194.214344468" observedRunningTime="2026-06-03 08:02:35.187241614 +0000 UTC m=+196.166584522" watchObservedRunningTime="2026-06-03 08:02:35.188112525 +0000 UTC m=+196.167455462" Jun 03 08:02:36.171802 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:36.171769 2575 generic.go:358] "Generic (PLEG): container finished" podID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerID="2287f91fabb350a95e4ade264c7874ae5dc1521aa0893edc534b7ed59d8df753" exitCode=0 Jun 03 08:02:36.172183 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:36.171856 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0265d1a-2edc-432c-bcc6-467482a5ce00","Type":"ContainerDied","Data":"2287f91fabb350a95e4ade264c7874ae5dc1521aa0893edc534b7ed59d8df753"} Jun 03 08:02:36.598911 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:36.598828 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-gdrzd"] Jun 03 08:02:36.602019 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:36.601997 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gdrzd" Jun 03 08:02:36.603996 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:36.603972 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 08:02:36.604121 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:36.604069 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-f5pfj\"" Jun 03 08:02:36.608785 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:36.608763 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-gdrzd"] Jun 03 08:02:36.686231 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:36.686198 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef33f9e7-f49a-4a22-9cb7-e3f484d04e34-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-gdrzd\" (UID: \"ef33f9e7-f49a-4a22-9cb7-e3f484d04e34\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gdrzd" Jun 03 08:02:36.787690 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:36.787648 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef33f9e7-f49a-4a22-9cb7-e3f484d04e34-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-gdrzd\" (UID: \"ef33f9e7-f49a-4a22-9cb7-e3f484d04e34\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gdrzd" Jun 03 08:02:36.790446 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:36.790409 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef33f9e7-f49a-4a22-9cb7-e3f484d04e34-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-gdrzd\" (UID: \"ef33f9e7-f49a-4a22-9cb7-e3f484d04e34\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gdrzd" Jun 03 08:02:36.910822 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:36.910787 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gdrzd" Jun 03 08:02:37.043016 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:37.042980 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-gdrzd"] Jun 03 08:02:37.046248 ip-10-0-128-28 kubenswrapper[2575]: W0603 08:02:37.046212 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef33f9e7_f49a_4a22_9cb7_e3f484d04e34.slice/crio-a3cf638c4fee67fd6a9c94f6df9aee80613c7b07e088feb1cf8d5e89ad900e4c WatchSource:0}: Error finding container a3cf638c4fee67fd6a9c94f6df9aee80613c7b07e088feb1cf8d5e89ad900e4c: Status 404 returned error can't find the container with id a3cf638c4fee67fd6a9c94f6df9aee80613c7b07e088feb1cf8d5e89ad900e4c Jun 03 08:02:37.180476 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:37.180374 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gdrzd" event={"ID":"ef33f9e7-f49a-4a22-9cb7-e3f484d04e34","Type":"ContainerStarted","Data":"a3cf638c4fee67fd6a9c94f6df9aee80613c7b07e088feb1cf8d5e89ad900e4c"} Jun 03 08:02:38.014042 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.014011 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:02:38.018036 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.018011 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.020455 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.020161 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 08:02:38.020455 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.020185 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 08:02:38.020455 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.020390 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 08:02:38.021236 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.021051 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 08:02:38.021236 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.021094 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 08:02:38.021236 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.021121 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 08:02:38.021850 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.021832 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 08:02:38.021947 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.021838 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 08:02:38.022019 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.022010 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 08:02:38.022069 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.022049 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 08:02:38.022124 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.022104 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-efo09lmp5ucak\"" Jun 03 08:02:38.022221 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.022180 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9gsv5\"" Jun 03 08:02:38.022362 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.022346 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 08:02:38.022972 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.022953 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 08:02:38.024266 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.024246 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 08:02:38.035119 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.035094 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:02:38.099799 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.099740 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.099967 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.099831 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.099967 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.099866 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.099967 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.099889 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8439808a-1e51-436a-96f9-fe87f1412a6d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.099967 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.099908 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8439808a-1e51-436a-96f9-fe87f1412a6d-config-out\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.099967 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.099925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.100128 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.099989 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.100128 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.100032 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.100128 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.100053 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.100128 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.100076 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.100248 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.100128 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9blbg\" (UniqueName: \"kubernetes.io/projected/8439808a-1e51-436a-96f9-fe87f1412a6d-kube-api-access-9blbg\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.100248 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.100149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-config\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.100248 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.100175 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.100248 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.100190 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-web-config\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.100248 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.100217 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.100248 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.100245 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.100423 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.100264 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.100423 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.100289 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.186035 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.185927 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0265d1a-2edc-432c-bcc6-467482a5ce00","Type":"ContainerStarted","Data":"55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0"} Jun 03 08:02:38.186035 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.185982 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0265d1a-2edc-432c-bcc6-467482a5ce00","Type":"ContainerStarted","Data":"4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a"} Jun 03 08:02:38.186035 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.185996 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0265d1a-2edc-432c-bcc6-467482a5ce00","Type":"ContainerStarted","Data":"fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591"} Jun 03 08:02:38.186035 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.186010 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0265d1a-2edc-432c-bcc6-467482a5ce00","Type":"ContainerStarted","Data":"a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3"} Jun 03 08:02:38.186035 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.186022 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0265d1a-2edc-432c-bcc6-467482a5ce00","Type":"ContainerStarted","Data":"52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677"} Jun 03 08:02:38.201246 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.201220 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8439808a-1e51-436a-96f9-fe87f1412a6d-config-out\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.201356 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.201252 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.201356 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.201281 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.201356 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.201299 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.201356 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.201321 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.201356 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.201350 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.201698 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.201388 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9blbg\" (UniqueName: \"kubernetes.io/projected/8439808a-1e51-436a-96f9-fe87f1412a6d-kube-api-access-9blbg\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.201698 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.201417 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-config\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.202167 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.202138 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.202489 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.202180 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-web-config\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.202489 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.202210 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.202489 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.202261 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.202489 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.202288 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.202489 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.202289 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.202489 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.202329 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.202489 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.202336 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.202489 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.202414 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.202945 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.202504 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.202945 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.202566 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.202945 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.202593 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.202945 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.202604 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8439808a-1e51-436a-96f9-fe87f1412a6d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.202945 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.202880 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.204141 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.204113 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.204849 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.204805 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8439808a-1e51-436a-96f9-fe87f1412a6d-config-out\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.205487 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.205416 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.205859 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.205838 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.205990 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.205964 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.206809 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.206470 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.206809 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.206566 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8439808a-1e51-436a-96f9-fe87f1412a6d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.206809 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.206763 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.207018 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.206812 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-config\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.207018 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.206896 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.207246 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.207221 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.207769 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.207751 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.207847 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.207789 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-web-config\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.208960 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.208938 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9blbg\" (UniqueName: \"kubernetes.io/projected/8439808a-1e51-436a-96f9-fe87f1412a6d-kube-api-access-9blbg\") pod \"prometheus-k8s-0\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.330699 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.330661 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:02:38.482517 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:38.482416 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:02:38.711720 ip-10-0-128-28 kubenswrapper[2575]: W0603 08:02:38.711686 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8439808a_1e51_436a_96f9_fe87f1412a6d.slice/crio-df359842a2954d871c9c8bd0c6c17aed4c772adedc0734ea3fde4cb610909f14 WatchSource:0}: Error finding container df359842a2954d871c9c8bd0c6c17aed4c772adedc0734ea3fde4cb610909f14: Status 404 returned error can't find the container with id df359842a2954d871c9c8bd0c6c17aed4c772adedc0734ea3fde4cb610909f14 Jun 03 08:02:39.190662 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:39.190556 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0265d1a-2edc-432c-bcc6-467482a5ce00","Type":"ContainerStarted","Data":"5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960"} Jun 03 08:02:39.191919 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:39.191887 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gdrzd" event={"ID":"ef33f9e7-f49a-4a22-9cb7-e3f484d04e34","Type":"ContainerStarted","Data":"646b186ff6396f2c5f28ff5cfcc3ea0cacdc9fc68e40259b7f91cde10792cb17"} Jun 03 08:02:39.192088 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:39.192075 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gdrzd" Jun 03 08:02:39.193276 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:39.193249 2575 generic.go:358] "Generic (PLEG): container finished" podID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerID="69b911eaa7254cc6e46d6673b03ab9bad7c8c5db6b449d0557015c95707875ec" exitCode=0 Jun 03 08:02:39.193379 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:39.193316 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8439808a-1e51-436a-96f9-fe87f1412a6d","Type":"ContainerDied","Data":"69b911eaa7254cc6e46d6673b03ab9bad7c8c5db6b449d0557015c95707875ec"} Jun 03 08:02:39.193379 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:39.193340 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8439808a-1e51-436a-96f9-fe87f1412a6d","Type":"ContainerStarted","Data":"df359842a2954d871c9c8bd0c6c17aed4c772adedc0734ea3fde4cb610909f14"} Jun 03 08:02:39.197495 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:39.197480 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gdrzd" Jun 03 08:02:39.212932 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:39.212895 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.272247345 podStartE2EDuration="7.212884426s" podCreationTimestamp="2026-06-03 08:02:32 +0000 UTC" firstStartedPulling="2026-06-03 08:02:33.943645885 +0000 UTC m=+194.922988775" lastFinishedPulling="2026-06-03 08:02:38.884282954 +0000 UTC m=+199.863625856" observedRunningTime="2026-06-03 08:02:39.212203576 +0000 UTC m=+200.191546488" watchObservedRunningTime="2026-06-03 08:02:39.212884426 +0000 UTC m=+200.192227336" Jun 03 08:02:39.277038 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:39.276988 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-gdrzd" podStartSLOduration=1.44193663 podStartE2EDuration="3.276973142s" podCreationTimestamp="2026-06-03 08:02:36 +0000 UTC" firstStartedPulling="2026-06-03 08:02:37.048468229 +0000 UTC m=+198.027811131" lastFinishedPulling="2026-06-03 08:02:38.883504735 +0000 UTC m=+199.862847643" observedRunningTime="2026-06-03 08:02:39.276900541 +0000 UTC m=+200.256243451" watchObservedRunningTime="2026-06-03 08:02:39.276973142 +0000 UTC m=+200.256316064" Jun 03 08:02:42.203860 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:42.203825 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8439808a-1e51-436a-96f9-fe87f1412a6d","Type":"ContainerStarted","Data":"413376e475f4bd4daffa33b8ef72df84c7d4fd4343add4dafed76e4ec4233a36"} Jun 03 08:02:42.203860 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:42.203861 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8439808a-1e51-436a-96f9-fe87f1412a6d","Type":"ContainerStarted","Data":"21d2b5edd3164778ac9fec5b122b8cdf242828b512566a8032a104da2c59d7f4"} Jun 03 08:02:44.212108 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:44.212074 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8439808a-1e51-436a-96f9-fe87f1412a6d","Type":"ContainerStarted","Data":"b94f1d189ec2f73aeb0f4948a77ac98ddc46c080205f416e3aa34f38caf21298"} Jun 03 08:02:44.212108 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:44.212110 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8439808a-1e51-436a-96f9-fe87f1412a6d","Type":"ContainerStarted","Data":"3924025200ac39eb04a022b272f9611c7c0a157ac0fa5946709f2f1f305f038f"} Jun 03 08:02:44.212108 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:44.212119 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8439808a-1e51-436a-96f9-fe87f1412a6d","Type":"ContainerStarted","Data":"175757ce50397b2458de1339edddfceb2eb5da2e75f1cc03745504350644cea6"} Jun 03 08:02:44.212562 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:44.212128 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8439808a-1e51-436a-96f9-fe87f1412a6d","Type":"ContainerStarted","Data":"e062800e17301b1c0330cade5d7a1158edec168625f7bd8054a652c12a6f1225"} Jun 03 08:02:44.237308 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:44.237245 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7544711790000003 podStartE2EDuration="7.23723213s" podCreationTimestamp="2026-06-03 08:02:37 +0000 UTC" firstStartedPulling="2026-06-03 08:02:39.194524482 +0000 UTC m=+200.173867374" lastFinishedPulling="2026-06-03 08:02:43.677285432 +0000 UTC m=+204.656628325" observedRunningTime="2026-06-03 08:02:44.235615954 +0000 UTC m=+205.214958866" watchObservedRunningTime="2026-06-03 08:02:44.23723213 +0000 UTC m=+205.216575042" Jun 03 08:02:48.331712 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:02:48.331681 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:08.278508 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:08.278476 2575 generic.go:358] "Generic (PLEG): container finished" podID="fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f" containerID="27a6b7896f1727de02d5b936064301d6319fa3aeee4839cbd1f0a2110f73393c" exitCode=0 Jun 03 08:03:08.278897 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:08.278548 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq" event={"ID":"fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f","Type":"ContainerDied","Data":"27a6b7896f1727de02d5b936064301d6319fa3aeee4839cbd1f0a2110f73393c"} Jun 03 08:03:08.278897 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:08.278822 2575 scope.go:117] "RemoveContainer" containerID="27a6b7896f1727de02d5b936064301d6319fa3aeee4839cbd1f0a2110f73393c" Jun 03 08:03:09.282766 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:09.282733 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-j8tcq" event={"ID":"fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f","Type":"ContainerStarted","Data":"da5fd3369b1d5114b3519eb842e46c7ff15e65eac53b9ef575b6000bb43a14b8"} Jun 03 08:03:29.243613 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:29.243582 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dgbmm_8e98347d-1bbd-4bf5-84fc-9d8a4386606c/dns-node-resolver/0.log" Jun 03 08:03:31.346707 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:31.346673 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs\") pod \"network-metrics-daemon-rqpqj\" (UID: \"d56b198a-8bb2-4f98-9300-d4dffff20c44\") " pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 08:03:31.348960 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:31.348940 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d56b198a-8bb2-4f98-9300-d4dffff20c44-metrics-certs\") pod \"network-metrics-daemon-rqpqj\" (UID: \"d56b198a-8bb2-4f98-9300-d4dffff20c44\") " pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 08:03:31.506635 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:31.506605 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ddh22\"" Jun 03 08:03:31.515084 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:31.515067 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqpqj" Jun 03 08:03:31.640695 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:31.640666 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rqpqj"] Jun 03 08:03:31.644054 ip-10-0-128-28 kubenswrapper[2575]: W0603 08:03:31.644027 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd56b198a_8bb2_4f98_9300_d4dffff20c44.slice/crio-927802be86a7a17da9f3353fc81cfed7c9e0ca3937a4b5748d97651ae9b01c0b WatchSource:0}: Error finding container 927802be86a7a17da9f3353fc81cfed7c9e0ca3937a4b5748d97651ae9b01c0b: Status 404 returned error can't find the container with id 927802be86a7a17da9f3353fc81cfed7c9e0ca3937a4b5748d97651ae9b01c0b Jun 03 08:03:32.347163 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:32.347130 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rqpqj" event={"ID":"d56b198a-8bb2-4f98-9300-d4dffff20c44","Type":"ContainerStarted","Data":"927802be86a7a17da9f3353fc81cfed7c9e0ca3937a4b5748d97651ae9b01c0b"} Jun 03 08:03:33.351949 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:33.351908 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rqpqj" event={"ID":"d56b198a-8bb2-4f98-9300-d4dffff20c44","Type":"ContainerStarted","Data":"3fe3d56a7cf1d37bf55273699588f6b27ca2efe7f0e33d25fc0eb4602fb4550e"} Jun 03 08:03:33.351949 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:33.351942 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rqpqj" event={"ID":"d56b198a-8bb2-4f98-9300-d4dffff20c44","Type":"ContainerStarted","Data":"d472bddb2b0a2018d4cac65d681bfeff9067b68dc34efda119bd7d6cacc648cc"} Jun 03 08:03:33.364554 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:33.364506 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rqpqj" podStartSLOduration=253.364539365 podStartE2EDuration="4m14.364493198s" podCreationTimestamp="2026-06-03 07:59:19 +0000 UTC" firstStartedPulling="2026-06-03 08:03:31.645775458 +0000 UTC m=+252.625118347" lastFinishedPulling="2026-06-03 08:03:32.645729291 +0000 UTC m=+253.625072180" observedRunningTime="2026-06-03 08:03:33.364083044 +0000 UTC m=+254.343425954" watchObservedRunningTime="2026-06-03 08:03:33.364493198 +0000 UTC m=+254.343836109" Jun 03 08:03:38.331555 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:38.331515 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:38.346956 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:38.346926 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:38.380840 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:38.380815 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:52.069645 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:52.069562 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 08:03:52.070106 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:52.069984 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="alertmanager" containerID="cri-o://52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677" gracePeriod=120 Jun 03 08:03:52.070106 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:52.070046 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="kube-rbac-proxy-metric" containerID="cri-o://55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0" gracePeriod=120 Jun 03 08:03:52.070239 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:52.070099 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="config-reloader" containerID="cri-o://a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3" gracePeriod=120 Jun 03 08:03:52.070239 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:52.070085 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="kube-rbac-proxy" containerID="cri-o://4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a" gracePeriod=120 Jun 03 08:03:52.070239 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:52.070080 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="kube-rbac-proxy-web" containerID="cri-o://fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591" gracePeriod=120 Jun 03 08:03:52.070239 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:52.070171 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="prom-label-proxy" containerID="cri-o://5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960" gracePeriod=120 Jun 03 08:03:52.412041 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:52.412012 2575 generic.go:358] "Generic (PLEG): container finished" podID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerID="5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960" exitCode=0 Jun 03 08:03:52.412041 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:52.412034 2575 generic.go:358] "Generic (PLEG): container finished" podID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerID="4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a" exitCode=0 Jun 03 08:03:52.412041 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:52.412040 2575 generic.go:358] "Generic (PLEG): container finished" podID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerID="a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3" exitCode=0 Jun 03 08:03:52.412041 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:52.412046 2575 generic.go:358] "Generic (PLEG): container finished" podID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerID="52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677" exitCode=0 Jun 03 08:03:52.412295 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:52.412085 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0265d1a-2edc-432c-bcc6-467482a5ce00","Type":"ContainerDied","Data":"5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960"} Jun 03 08:03:52.412295 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:52.412113 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0265d1a-2edc-432c-bcc6-467482a5ce00","Type":"ContainerDied","Data":"4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a"} Jun 03 08:03:52.412295 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:52.412123 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0265d1a-2edc-432c-bcc6-467482a5ce00","Type":"ContainerDied","Data":"a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3"} Jun 03 08:03:52.412295 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:52.412132 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0265d1a-2edc-432c-bcc6-467482a5ce00","Type":"ContainerDied","Data":"52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677"} Jun 03 08:03:53.308193 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.308172 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:03:53.417293 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.417219 2575 generic.go:358] "Generic (PLEG): container finished" podID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerID="55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0" exitCode=0 Jun 03 08:03:53.417293 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.417243 2575 generic.go:358] "Generic (PLEG): container finished" podID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerID="fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591" exitCode=0 Jun 03 08:03:53.417484 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.417303 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0265d1a-2edc-432c-bcc6-467482a5ce00","Type":"ContainerDied","Data":"55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0"} Jun 03 08:03:53.417484 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.417340 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 08:03:53.417484 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.417350 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0265d1a-2edc-432c-bcc6-467482a5ce00","Type":"ContainerDied","Data":"fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591"} Jun 03 08:03:53.417484 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.417365 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c0265d1a-2edc-432c-bcc6-467482a5ce00","Type":"ContainerDied","Data":"dc648189fb17d33eae8225596b8ac92f2e9d0d3be6fd97cbb803d60ab00914c0"} Jun 03 08:03:53.417484 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.417400 2575 scope.go:117] "RemoveContainer" containerID="5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960" Jun 03 08:03:53.424313 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.424296 2575 scope.go:117] "RemoveContainer" containerID="55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0" Jun 03 08:03:53.429227 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.429203 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c0265d1a-2edc-432c-bcc6-467482a5ce00-alertmanager-main-db\") pod \"c0265d1a-2edc-432c-bcc6-467482a5ce00\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " Jun 03 08:03:53.429331 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.429235 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0265d1a-2edc-432c-bcc6-467482a5ce00-alertmanager-trusted-ca-bundle\") pod \"c0265d1a-2edc-432c-bcc6-467482a5ce00\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " Jun 03 08:03:53.429331 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.429267 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-config-volume\") pod \"c0265d1a-2edc-432c-bcc6-467482a5ce00\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " Jun 03 08:03:53.429331 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.429292 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-web-config\") pod \"c0265d1a-2edc-432c-bcc6-467482a5ce00\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " Jun 03 08:03:53.429506 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.429329 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0265d1a-2edc-432c-bcc6-467482a5ce00-tls-assets\") pod \"c0265d1a-2edc-432c-bcc6-467482a5ce00\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " Jun 03 08:03:53.429506 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.429354 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-cluster-tls-config\") pod \"c0265d1a-2edc-432c-bcc6-467482a5ce00\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " Jun 03 08:03:53.429506 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.429408 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twdw2\" (UniqueName: \"kubernetes.io/projected/c0265d1a-2edc-432c-bcc6-467482a5ce00-kube-api-access-twdw2\") pod \"c0265d1a-2edc-432c-bcc6-467482a5ce00\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " Jun 03 08:03:53.429506 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.429463 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy-web\") pod \"c0265d1a-2edc-432c-bcc6-467482a5ce00\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " Jun 03 08:03:53.429699 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.429507 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0265d1a-2edc-432c-bcc6-467482a5ce00-config-out\") pod \"c0265d1a-2edc-432c-bcc6-467482a5ce00\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " Jun 03 08:03:53.429699 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.429531 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy\") pod \"c0265d1a-2edc-432c-bcc6-467482a5ce00\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " Jun 03 08:03:53.429699 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.429560 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-main-tls\") pod \"c0265d1a-2edc-432c-bcc6-467482a5ce00\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " Jun 03 08:03:53.429699 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.429597 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0265d1a-2edc-432c-bcc6-467482a5ce00-metrics-client-ca\") pod \"c0265d1a-2edc-432c-bcc6-467482a5ce00\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " Jun 03 08:03:53.429699 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.429644 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c0265d1a-2edc-432c-bcc6-467482a5ce00\" (UID: \"c0265d1a-2edc-432c-bcc6-467482a5ce00\") " Jun 03 08:03:53.430447 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.429635 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0265d1a-2edc-432c-bcc6-467482a5ce00-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c0265d1a-2edc-432c-bcc6-467482a5ce00" (UID: "c0265d1a-2edc-432c-bcc6-467482a5ce00"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:03:53.430545 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.429814 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0265d1a-2edc-432c-bcc6-467482a5ce00-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c0265d1a-2edc-432c-bcc6-467482a5ce00" (UID: "c0265d1a-2edc-432c-bcc6-467482a5ce00"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:03:53.430545 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.430066 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0265d1a-2edc-432c-bcc6-467482a5ce00-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c0265d1a-2edc-432c-bcc6-467482a5ce00" (UID: "c0265d1a-2edc-432c-bcc6-467482a5ce00"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:03:53.431574 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.431486 2575 scope.go:117] "RemoveContainer" containerID="4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a" Jun 03 08:03:53.432011 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.431959 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-config-volume" (OuterVolumeSpecName: "config-volume") pod "c0265d1a-2edc-432c-bcc6-467482a5ce00" (UID: "c0265d1a-2edc-432c-bcc6-467482a5ce00"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:03:53.432938 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.432900 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c0265d1a-2edc-432c-bcc6-467482a5ce00" (UID: "c0265d1a-2edc-432c-bcc6-467482a5ce00"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:03:53.433125 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.433097 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c0265d1a-2edc-432c-bcc6-467482a5ce00" (UID: "c0265d1a-2edc-432c-bcc6-467482a5ce00"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:03:53.433316 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.433292 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0265d1a-2edc-432c-bcc6-467482a5ce00-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c0265d1a-2edc-432c-bcc6-467482a5ce00" (UID: "c0265d1a-2edc-432c-bcc6-467482a5ce00"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:03:53.433715 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.433689 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c0265d1a-2edc-432c-bcc6-467482a5ce00" (UID: "c0265d1a-2edc-432c-bcc6-467482a5ce00"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:03:53.433800 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.433720 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c0265d1a-2edc-432c-bcc6-467482a5ce00" (UID: "c0265d1a-2edc-432c-bcc6-467482a5ce00"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:03:53.433945 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.433924 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0265d1a-2edc-432c-bcc6-467482a5ce00-kube-api-access-twdw2" (OuterVolumeSpecName: "kube-api-access-twdw2") pod "c0265d1a-2edc-432c-bcc6-467482a5ce00" (UID: "c0265d1a-2edc-432c-bcc6-467482a5ce00"). InnerVolumeSpecName "kube-api-access-twdw2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:03:53.434254 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.434231 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0265d1a-2edc-432c-bcc6-467482a5ce00-config-out" (OuterVolumeSpecName: "config-out") pod "c0265d1a-2edc-432c-bcc6-467482a5ce00" (UID: "c0265d1a-2edc-432c-bcc6-467482a5ce00"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:03:53.438150 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.438118 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c0265d1a-2edc-432c-bcc6-467482a5ce00" (UID: "c0265d1a-2edc-432c-bcc6-467482a5ce00"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:03:53.443256 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.443231 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-web-config" (OuterVolumeSpecName: "web-config") pod "c0265d1a-2edc-432c-bcc6-467482a5ce00" (UID: "c0265d1a-2edc-432c-bcc6-467482a5ce00"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:03:53.444794 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.444778 2575 scope.go:117] "RemoveContainer" containerID="fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591" Jun 03 08:03:53.450882 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.450864 2575 scope.go:117] "RemoveContainer" containerID="a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3" Jun 03 08:03:53.456686 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.456671 2575 scope.go:117] "RemoveContainer" containerID="52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677" Jun 03 08:03:53.462650 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.462636 2575 scope.go:117] "RemoveContainer" containerID="2287f91fabb350a95e4ade264c7874ae5dc1521aa0893edc534b7ed59d8df753" Jun 03 08:03:53.468447 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.468417 2575 scope.go:117] "RemoveContainer" containerID="5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960" Jun 03 08:03:53.468696 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:03:53.468680 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960\": container with ID starting with 5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960 not found: ID does not exist" containerID="5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960" Jun 03 08:03:53.468758 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.468705 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960"} err="failed to get container status \"5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960\": rpc error: code = NotFound desc = could not find container \"5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960\": container with ID starting with 5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960 not found: ID does not exist" Jun 03 08:03:53.468758 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.468737 2575 scope.go:117] "RemoveContainer" containerID="55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0" Jun 03 08:03:53.468975 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:03:53.468959 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0\": container with ID starting with 55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0 not found: ID does not exist" containerID="55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0" Jun 03 08:03:53.469014 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.468985 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0"} err="failed to get container status \"55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0\": rpc error: code = NotFound desc = could not find container \"55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0\": container with ID starting with 55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0 not found: ID does not exist" Jun 03 08:03:53.469014 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.469002 2575 scope.go:117] "RemoveContainer" containerID="4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a" Jun 03 08:03:53.469223 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:03:53.469210 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a\": container with ID starting with 4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a not found: ID does not exist" containerID="4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a" Jun 03 08:03:53.469267 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.469225 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a"} err="failed to get container status \"4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a\": rpc error: code = NotFound desc = could not find container \"4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a\": container with ID starting with 4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a not found: ID does not exist" Jun 03 08:03:53.469267 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.469237 2575 scope.go:117] "RemoveContainer" containerID="fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591" Jun 03 08:03:53.469462 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:03:53.469442 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591\": container with ID starting with fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591 not found: ID does not exist" containerID="fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591" Jun 03 08:03:53.469528 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.469470 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591"} err="failed to get container status \"fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591\": rpc error: code = NotFound desc = could not find container \"fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591\": container with ID starting with fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591 not found: ID does not exist" Jun 03 08:03:53.469528 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.469491 2575 scope.go:117] "RemoveContainer" containerID="a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3" Jun 03 08:03:53.469736 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:03:53.469721 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3\": container with ID starting with a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3 not found: ID does not exist" containerID="a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3" Jun 03 08:03:53.469783 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.469738 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3"} err="failed to get container status \"a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3\": rpc error: code = NotFound desc = could not find container \"a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3\": container with ID starting with a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3 not found: ID does not exist" Jun 03 08:03:53.469783 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.469751 2575 scope.go:117] "RemoveContainer" containerID="52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677" Jun 03 08:03:53.469963 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:03:53.469941 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677\": container with ID starting with 52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677 not found: ID does not exist" containerID="52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677" Jun 03 08:03:53.470010 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.469967 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677"} err="failed to get container status \"52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677\": rpc error: code = NotFound desc = could not find container \"52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677\": container with ID starting with 52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677 not found: ID does not exist" Jun 03 08:03:53.470010 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.469984 2575 scope.go:117] "RemoveContainer" containerID="2287f91fabb350a95e4ade264c7874ae5dc1521aa0893edc534b7ed59d8df753" Jun 03 08:03:53.470205 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:03:53.470190 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2287f91fabb350a95e4ade264c7874ae5dc1521aa0893edc534b7ed59d8df753\": container with ID starting with 2287f91fabb350a95e4ade264c7874ae5dc1521aa0893edc534b7ed59d8df753 not found: ID does not exist" containerID="2287f91fabb350a95e4ade264c7874ae5dc1521aa0893edc534b7ed59d8df753" Jun 03 08:03:53.470245 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.470208 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2287f91fabb350a95e4ade264c7874ae5dc1521aa0893edc534b7ed59d8df753"} err="failed to get container status \"2287f91fabb350a95e4ade264c7874ae5dc1521aa0893edc534b7ed59d8df753\": rpc error: code = NotFound desc = could not find container \"2287f91fabb350a95e4ade264c7874ae5dc1521aa0893edc534b7ed59d8df753\": container with ID starting with 2287f91fabb350a95e4ade264c7874ae5dc1521aa0893edc534b7ed59d8df753 not found: ID does not exist" Jun 03 08:03:53.470245 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.470228 2575 scope.go:117] "RemoveContainer" containerID="5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960" Jun 03 08:03:53.470450 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.470410 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960"} err="failed to get container status \"5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960\": rpc error: code = NotFound desc = could not find container \"5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960\": container with ID starting with 5fe4e492983957a76c04addedc26fb20a22b87b59f14b9d35d75b21f1c16b960 not found: ID does not exist" Jun 03 08:03:53.470524 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.470452 2575 scope.go:117] "RemoveContainer" containerID="55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0" Jun 03 08:03:53.470668 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.470648 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0"} err="failed to get container status \"55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0\": rpc error: code = NotFound desc = could not find container \"55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0\": container with ID starting with 55e486f9d920452825fd6861337c36f5c13507bb03ec1b81ce1b5afff67b96c0 not found: ID does not exist" Jun 03 08:03:53.470714 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.470668 2575 scope.go:117] "RemoveContainer" containerID="4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a" Jun 03 08:03:53.470895 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.470879 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a"} err="failed to get container status \"4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a\": rpc error: code = NotFound desc = could not find container \"4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a\": container with ID starting with 4c04a3ca5c1f4c812310827748d3c1a2220c8333bdea468ca3f9e3867460582a not found: ID does not exist" Jun 03 08:03:53.470941 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.470895 2575 scope.go:117] "RemoveContainer" containerID="fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591" Jun 03 08:03:53.471104 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.471082 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591"} err="failed to get container status \"fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591\": rpc error: code = NotFound desc = could not find container \"fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591\": container with ID starting with fa5ffbd0b1a8b46b14bd8483d6d74b786b1b358d898987b0c9428a04eb419591 not found: ID does not exist" Jun 03 08:03:53.471171 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.471105 2575 scope.go:117] "RemoveContainer" containerID="a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3" Jun 03 08:03:53.471309 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.471292 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3"} err="failed to get container status \"a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3\": rpc error: code = NotFound desc = could not find container \"a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3\": container with ID starting with a14773738ab7f2b180f83ef23ac69e06b776431a37a1f5d80a786a8be8bd55c3 not found: ID does not exist" Jun 03 08:03:53.471355 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.471310 2575 scope.go:117] "RemoveContainer" containerID="52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677" Jun 03 08:03:53.471523 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.471506 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677"} err="failed to get container status \"52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677\": rpc error: code = NotFound desc = could not find container \"52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677\": container with ID starting with 52b11879fc5ed57f3e5494656dfa473e2976e29eb96eacd494c7848aaef62677 not found: ID does not exist" Jun 03 08:03:53.471594 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.471525 2575 scope.go:117] "RemoveContainer" containerID="2287f91fabb350a95e4ade264c7874ae5dc1521aa0893edc534b7ed59d8df753" Jun 03 08:03:53.471732 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.471716 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2287f91fabb350a95e4ade264c7874ae5dc1521aa0893edc534b7ed59d8df753"} err="failed to get container status \"2287f91fabb350a95e4ade264c7874ae5dc1521aa0893edc534b7ed59d8df753\": rpc error: code = NotFound desc = could not find container \"2287f91fabb350a95e4ade264c7874ae5dc1521aa0893edc534b7ed59d8df753\": container with ID starting with 2287f91fabb350a95e4ade264c7874ae5dc1521aa0893edc534b7ed59d8df753 not found: ID does not exist" Jun 03 08:03:53.531148 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.531121 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twdw2\" (UniqueName: \"kubernetes.io/projected/c0265d1a-2edc-432c-bcc6-467482a5ce00-kube-api-access-twdw2\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:53.531148 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.531144 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:53.531275 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.531155 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0265d1a-2edc-432c-bcc6-467482a5ce00-config-out\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:53.531275 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.531164 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:53.531275 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.531174 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-main-tls\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:53.531275 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.531182 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0265d1a-2edc-432c-bcc6-467482a5ce00-metrics-client-ca\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:53.531275 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.531191 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:53.531275 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.531202 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c0265d1a-2edc-432c-bcc6-467482a5ce00-alertmanager-main-db\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:53.531275 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.531211 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0265d1a-2edc-432c-bcc6-467482a5ce00-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:53.531275 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.531220 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-config-volume\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:53.531275 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.531230 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-web-config\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:53.531275 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.531237 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0265d1a-2edc-432c-bcc6-467482a5ce00-tls-assets\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:53.531275 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.531245 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c0265d1a-2edc-432c-bcc6-467482a5ce00-cluster-tls-config\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:53.734195 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.733974 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 08:03:53.737221 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:53.737197 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 08:03:55.607700 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:55.607667 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" path="/var/lib/kubelet/pods/c0265d1a-2edc-432c-bcc6-467482a5ce00/volumes" Jun 03 08:03:56.391054 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:56.391023 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:03:56.391601 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:56.391492 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="prometheus" containerID="cri-o://21d2b5edd3164778ac9fec5b122b8cdf242828b512566a8032a104da2c59d7f4" gracePeriod=600 Jun 03 08:03:56.391601 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:56.391530 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b94f1d189ec2f73aeb0f4948a77ac98ddc46c080205f416e3aa34f38caf21298" gracePeriod=600 Jun 03 08:03:56.391601 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:56.391572 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="config-reloader" containerID="cri-o://413376e475f4bd4daffa33b8ef72df84c7d4fd4343add4dafed76e4ec4233a36" gracePeriod=600 Jun 03 08:03:56.391601 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:56.391510 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="thanos-sidecar" containerID="cri-o://e062800e17301b1c0330cade5d7a1158edec168625f7bd8054a652c12a6f1225" gracePeriod=600 Jun 03 08:03:56.391601 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:56.391527 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="kube-rbac-proxy" containerID="cri-o://3924025200ac39eb04a022b272f9611c7c0a157ac0fa5946709f2f1f305f038f" gracePeriod=600 Jun 03 08:03:56.391986 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:56.391549 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="kube-rbac-proxy-web" containerID="cri-o://175757ce50397b2458de1339edddfceb2eb5da2e75f1cc03745504350644cea6" gracePeriod=600 Jun 03 08:03:57.430652 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.430621 2575 generic.go:358] "Generic (PLEG): container finished" podID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerID="b94f1d189ec2f73aeb0f4948a77ac98ddc46c080205f416e3aa34f38caf21298" exitCode=0 Jun 03 08:03:57.430652 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.430646 2575 generic.go:358] "Generic (PLEG): container finished" podID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerID="3924025200ac39eb04a022b272f9611c7c0a157ac0fa5946709f2f1f305f038f" exitCode=0 Jun 03 08:03:57.430652 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.430654 2575 generic.go:358] "Generic (PLEG): container finished" podID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerID="e062800e17301b1c0330cade5d7a1158edec168625f7bd8054a652c12a6f1225" exitCode=0 Jun 03 08:03:57.430652 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.430662 2575 generic.go:358] "Generic (PLEG): container finished" podID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerID="413376e475f4bd4daffa33b8ef72df84c7d4fd4343add4dafed76e4ec4233a36" exitCode=0 Jun 03 08:03:57.430652 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.430668 2575 generic.go:358] "Generic (PLEG): container finished" podID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerID="21d2b5edd3164778ac9fec5b122b8cdf242828b512566a8032a104da2c59d7f4" exitCode=0 Jun 03 08:03:57.431229 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.430686 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8439808a-1e51-436a-96f9-fe87f1412a6d","Type":"ContainerDied","Data":"b94f1d189ec2f73aeb0f4948a77ac98ddc46c080205f416e3aa34f38caf21298"} Jun 03 08:03:57.431229 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.430706 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8439808a-1e51-436a-96f9-fe87f1412a6d","Type":"ContainerDied","Data":"3924025200ac39eb04a022b272f9611c7c0a157ac0fa5946709f2f1f305f038f"} Jun 03 08:03:57.431229 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.430717 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8439808a-1e51-436a-96f9-fe87f1412a6d","Type":"ContainerDied","Data":"e062800e17301b1c0330cade5d7a1158edec168625f7bd8054a652c12a6f1225"} Jun 03 08:03:57.431229 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.430725 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8439808a-1e51-436a-96f9-fe87f1412a6d","Type":"ContainerDied","Data":"413376e475f4bd4daffa33b8ef72df84c7d4fd4343add4dafed76e4ec4233a36"} Jun 03 08:03:57.431229 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.430735 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8439808a-1e51-436a-96f9-fe87f1412a6d","Type":"ContainerDied","Data":"21d2b5edd3164778ac9fec5b122b8cdf242828b512566a8032a104da2c59d7f4"} Jun 03 08:03:57.621713 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.621692 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:57.767306 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767219 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-config\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767306 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767262 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-grpc-tls\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767306 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767291 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767579 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767314 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-web-config\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767579 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767347 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-serving-certs-ca-bundle\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767579 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767374 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-kubelet-serving-ca-bundle\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767579 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767409 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-metrics-client-ca\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767579 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767463 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-thanos-prometheus-http-client-file\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767579 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767500 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-tls\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767579 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767530 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9blbg\" (UniqueName: \"kubernetes.io/projected/8439808a-1e51-436a-96f9-fe87f1412a6d-kube-api-access-9blbg\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767579 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767567 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-metrics-client-certs\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767962 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767593 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8439808a-1e51-436a-96f9-fe87f1412a6d-tls-assets\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767962 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767615 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-kube-rbac-proxy\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767962 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767642 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-k8s-rulefiles-0\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767962 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767687 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8439808a-1e51-436a-96f9-fe87f1412a6d-config-out\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767962 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767714 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767962 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767742 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-trusted-ca-bundle\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767962 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767797 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-k8s-db\") pod \"8439808a-1e51-436a-96f9-fe87f1412a6d\" (UID: \"8439808a-1e51-436a-96f9-fe87f1412a6d\") " Jun 03 08:03:57.767962 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.767891 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:03:57.768652 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.768369 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:03:57.768652 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.768391 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:57.769182 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.769153 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:03:57.769970 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.769937 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-config" (OuterVolumeSpecName: "config") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:03:57.770091 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.770026 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:03:57.770671 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.770391 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:03:57.770671 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.770639 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:03:57.770941 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.770763 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:03:57.770941 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.770889 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:03:57.771058 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.770986 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:03:57.771747 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.771592 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:03:57.772020 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.771997 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:03:57.772117 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.772099 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8439808a-1e51-436a-96f9-fe87f1412a6d-config-out" (OuterVolumeSpecName: "config-out") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:03:57.772576 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.772547 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8439808a-1e51-436a-96f9-fe87f1412a6d-kube-api-access-9blbg" (OuterVolumeSpecName: "kube-api-access-9blbg") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "kube-api-access-9blbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:03:57.772672 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.772642 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:03:57.772830 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.772807 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8439808a-1e51-436a-96f9-fe87f1412a6d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:03:57.773334 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.773312 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:03:57.780538 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.780514 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-web-config" (OuterVolumeSpecName: "web-config") pod "8439808a-1e51-436a-96f9-fe87f1412a6d" (UID: "8439808a-1e51-436a-96f9-fe87f1412a6d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:03:57.869077 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.869034 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:57.869077 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.869074 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-configmap-metrics-client-ca\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:57.869077 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.869085 2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:57.869288 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.869094 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:57.869288 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.869103 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9blbg\" (UniqueName: \"kubernetes.io/projected/8439808a-1e51-436a-96f9-fe87f1412a6d-kube-api-access-9blbg\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:57.869288 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.869112 2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-metrics-client-certs\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:57.869288 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.869122 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8439808a-1e51-436a-96f9-fe87f1412a6d-tls-assets\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:57.869288 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.869131 2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-kube-rbac-proxy\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:57.869288 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.869140 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:57.869288 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.869149 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8439808a-1e51-436a-96f9-fe87f1412a6d-config-out\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:57.869288 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.869157 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:57.869288 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.869167 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:57.869288 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.869176 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8439808a-1e51-436a-96f9-fe87f1412a6d-prometheus-k8s-db\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:57.869288 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.869186 2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-config\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:57.869288 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.869196 2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-grpc-tls\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:57.869288 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.869205 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:57.869288 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:57.869213 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8439808a-1e51-436a-96f9-fe87f1412a6d-web-config\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\"" Jun 03 08:03:58.435856 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.435819 2575 generic.go:358] "Generic (PLEG): container finished" podID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerID="175757ce50397b2458de1339edddfceb2eb5da2e75f1cc03745504350644cea6" exitCode=0 Jun 03 08:03:58.436224 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.435906 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8439808a-1e51-436a-96f9-fe87f1412a6d","Type":"ContainerDied","Data":"175757ce50397b2458de1339edddfceb2eb5da2e75f1cc03745504350644cea6"} Jun 03 08:03:58.436224 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.435937 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8439808a-1e51-436a-96f9-fe87f1412a6d","Type":"ContainerDied","Data":"df359842a2954d871c9c8bd0c6c17aed4c772adedc0734ea3fde4cb610909f14"} Jun 03 08:03:58.436224 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.435941 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.436224 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.435953 2575 scope.go:117] "RemoveContainer" containerID="b94f1d189ec2f73aeb0f4948a77ac98ddc46c080205f416e3aa34f38caf21298" Jun 03 08:03:58.443753 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.443416 2575 scope.go:117] "RemoveContainer" containerID="3924025200ac39eb04a022b272f9611c7c0a157ac0fa5946709f2f1f305f038f" Jun 03 08:03:58.450172 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.450156 2575 scope.go:117] "RemoveContainer" containerID="175757ce50397b2458de1339edddfceb2eb5da2e75f1cc03745504350644cea6" Jun 03 08:03:58.456627 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.456607 2575 scope.go:117] "RemoveContainer" containerID="e062800e17301b1c0330cade5d7a1158edec168625f7bd8054a652c12a6f1225" Jun 03 08:03:58.457042 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.457022 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:03:58.460808 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.460789 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:03:58.464314 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.464299 2575 scope.go:117] "RemoveContainer" containerID="413376e475f4bd4daffa33b8ef72df84c7d4fd4343add4dafed76e4ec4233a36" Jun 03 08:03:58.470329 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.470312 2575 scope.go:117] "RemoveContainer" containerID="21d2b5edd3164778ac9fec5b122b8cdf242828b512566a8032a104da2c59d7f4" Jun 03 08:03:58.476558 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.476541 2575 scope.go:117] "RemoveContainer" containerID="69b911eaa7254cc6e46d6673b03ab9bad7c8c5db6b449d0557015c95707875ec" Jun 03 08:03:58.482237 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.482223 2575 scope.go:117] "RemoveContainer" containerID="b94f1d189ec2f73aeb0f4948a77ac98ddc46c080205f416e3aa34f38caf21298" Jun 03 08:03:58.482486 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:03:58.482464 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b94f1d189ec2f73aeb0f4948a77ac98ddc46c080205f416e3aa34f38caf21298\": container with ID starting with b94f1d189ec2f73aeb0f4948a77ac98ddc46c080205f416e3aa34f38caf21298 not found: ID does not exist" containerID="b94f1d189ec2f73aeb0f4948a77ac98ddc46c080205f416e3aa34f38caf21298" Jun 03 08:03:58.482549 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.482491 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b94f1d189ec2f73aeb0f4948a77ac98ddc46c080205f416e3aa34f38caf21298"} err="failed to get container status \"b94f1d189ec2f73aeb0f4948a77ac98ddc46c080205f416e3aa34f38caf21298\": rpc error: code = NotFound desc = could not find container \"b94f1d189ec2f73aeb0f4948a77ac98ddc46c080205f416e3aa34f38caf21298\": container with ID starting with b94f1d189ec2f73aeb0f4948a77ac98ddc46c080205f416e3aa34f38caf21298 not found: ID does not exist" Jun 03 08:03:58.482549 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.482508 2575 scope.go:117] "RemoveContainer" containerID="3924025200ac39eb04a022b272f9611c7c0a157ac0fa5946709f2f1f305f038f" Jun 03 08:03:58.482721 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:03:58.482707 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3924025200ac39eb04a022b272f9611c7c0a157ac0fa5946709f2f1f305f038f\": container with ID starting with 3924025200ac39eb04a022b272f9611c7c0a157ac0fa5946709f2f1f305f038f not found: ID does not exist" containerID="3924025200ac39eb04a022b272f9611c7c0a157ac0fa5946709f2f1f305f038f" Jun 03 08:03:58.482758 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.482725 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3924025200ac39eb04a022b272f9611c7c0a157ac0fa5946709f2f1f305f038f"} err="failed to get container status \"3924025200ac39eb04a022b272f9611c7c0a157ac0fa5946709f2f1f305f038f\": rpc error: code = NotFound desc = could not find container \"3924025200ac39eb04a022b272f9611c7c0a157ac0fa5946709f2f1f305f038f\": container with ID starting with 3924025200ac39eb04a022b272f9611c7c0a157ac0fa5946709f2f1f305f038f not found: ID does not exist" Jun 03 08:03:58.482758 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.482738 2575 scope.go:117] "RemoveContainer" containerID="175757ce50397b2458de1339edddfceb2eb5da2e75f1cc03745504350644cea6" Jun 03 08:03:58.482963 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:03:58.482950 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"175757ce50397b2458de1339edddfceb2eb5da2e75f1cc03745504350644cea6\": container with ID starting with 175757ce50397b2458de1339edddfceb2eb5da2e75f1cc03745504350644cea6 not found: ID does not exist" containerID="175757ce50397b2458de1339edddfceb2eb5da2e75f1cc03745504350644cea6" Jun 03 08:03:58.482999 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.482966 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"175757ce50397b2458de1339edddfceb2eb5da2e75f1cc03745504350644cea6"} err="failed to get container status \"175757ce50397b2458de1339edddfceb2eb5da2e75f1cc03745504350644cea6\": rpc error: code = NotFound desc = could not find container \"175757ce50397b2458de1339edddfceb2eb5da2e75f1cc03745504350644cea6\": container with ID starting with 175757ce50397b2458de1339edddfceb2eb5da2e75f1cc03745504350644cea6 not found: ID does not exist" Jun 03 08:03:58.482999 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.482978 2575 scope.go:117] "RemoveContainer" containerID="e062800e17301b1c0330cade5d7a1158edec168625f7bd8054a652c12a6f1225" Jun 03 08:03:58.483202 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:03:58.483187 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e062800e17301b1c0330cade5d7a1158edec168625f7bd8054a652c12a6f1225\": container with ID starting with e062800e17301b1c0330cade5d7a1158edec168625f7bd8054a652c12a6f1225 not found: ID does not exist" containerID="e062800e17301b1c0330cade5d7a1158edec168625f7bd8054a652c12a6f1225" Jun 03 08:03:58.483253 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.483204 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e062800e17301b1c0330cade5d7a1158edec168625f7bd8054a652c12a6f1225"} err="failed to get container status \"e062800e17301b1c0330cade5d7a1158edec168625f7bd8054a652c12a6f1225\": rpc error: code = NotFound desc = could not find container \"e062800e17301b1c0330cade5d7a1158edec168625f7bd8054a652c12a6f1225\": container with ID starting with e062800e17301b1c0330cade5d7a1158edec168625f7bd8054a652c12a6f1225 not found: ID does not exist" Jun 03 08:03:58.483253 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.483214 2575 scope.go:117] "RemoveContainer" containerID="413376e475f4bd4daffa33b8ef72df84c7d4fd4343add4dafed76e4ec4233a36" Jun 03 08:03:58.483413 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:03:58.483395 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"413376e475f4bd4daffa33b8ef72df84c7d4fd4343add4dafed76e4ec4233a36\": container with ID starting with 413376e475f4bd4daffa33b8ef72df84c7d4fd4343add4dafed76e4ec4233a36 not found: ID does not exist" containerID="413376e475f4bd4daffa33b8ef72df84c7d4fd4343add4dafed76e4ec4233a36" Jun 03 08:03:58.483497 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.483415 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"413376e475f4bd4daffa33b8ef72df84c7d4fd4343add4dafed76e4ec4233a36"} err="failed to get container status \"413376e475f4bd4daffa33b8ef72df84c7d4fd4343add4dafed76e4ec4233a36\": rpc error: code = NotFound desc = could not find container \"413376e475f4bd4daffa33b8ef72df84c7d4fd4343add4dafed76e4ec4233a36\": container with ID starting with 413376e475f4bd4daffa33b8ef72df84c7d4fd4343add4dafed76e4ec4233a36 not found: ID does not exist" Jun 03 08:03:58.483497 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.483425 2575 scope.go:117] "RemoveContainer" containerID="21d2b5edd3164778ac9fec5b122b8cdf242828b512566a8032a104da2c59d7f4" Jun 03 08:03:58.483665 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:03:58.483649 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21d2b5edd3164778ac9fec5b122b8cdf242828b512566a8032a104da2c59d7f4\": container with ID starting with 21d2b5edd3164778ac9fec5b122b8cdf242828b512566a8032a104da2c59d7f4 not found: ID does not exist" containerID="21d2b5edd3164778ac9fec5b122b8cdf242828b512566a8032a104da2c59d7f4" Jun 03 08:03:58.483718 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.483677 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21d2b5edd3164778ac9fec5b122b8cdf242828b512566a8032a104da2c59d7f4"} err="failed to get container status \"21d2b5edd3164778ac9fec5b122b8cdf242828b512566a8032a104da2c59d7f4\": rpc error: code = NotFound desc = could not find container \"21d2b5edd3164778ac9fec5b122b8cdf242828b512566a8032a104da2c59d7f4\": container with ID starting with 21d2b5edd3164778ac9fec5b122b8cdf242828b512566a8032a104da2c59d7f4 not found: ID does not exist" Jun 03 08:03:58.483718 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.483690 2575 scope.go:117] "RemoveContainer" containerID="69b911eaa7254cc6e46d6673b03ab9bad7c8c5db6b449d0557015c95707875ec" Jun 03 08:03:58.483917 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:03:58.483903 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69b911eaa7254cc6e46d6673b03ab9bad7c8c5db6b449d0557015c95707875ec\": container with ID starting with 69b911eaa7254cc6e46d6673b03ab9bad7c8c5db6b449d0557015c95707875ec not found: ID does not exist" containerID="69b911eaa7254cc6e46d6673b03ab9bad7c8c5db6b449d0557015c95707875ec" Jun 03 08:03:58.483954 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.483919 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69b911eaa7254cc6e46d6673b03ab9bad7c8c5db6b449d0557015c95707875ec"} err="failed to get container status \"69b911eaa7254cc6e46d6673b03ab9bad7c8c5db6b449d0557015c95707875ec\": rpc error: code = NotFound desc = could not find container \"69b911eaa7254cc6e46d6673b03ab9bad7c8c5db6b449d0557015c95707875ec\": container with ID starting with 69b911eaa7254cc6e46d6673b03ab9bad7c8c5db6b449d0557015c95707875ec not found: ID does not exist" Jun 03 08:03:58.488629 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488609 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:03:58.488872 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488860 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="init-config-reloader" Jun 03 08:03:58.488917 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488874 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="init-config-reloader" Jun 03 08:03:58.488917 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488882 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="kube-rbac-proxy" Jun 03 08:03:58.488917 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488888 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="kube-rbac-proxy" Jun 03 08:03:58.488917 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488897 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="thanos-sidecar" Jun 03 08:03:58.488917 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488902 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="thanos-sidecar" Jun 03 08:03:58.488917 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488908 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="init-config-reloader" Jun 03 08:03:58.488917 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488913 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="init-config-reloader" Jun 03 08:03:58.488917 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488918 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="prom-label-proxy" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488925 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="prom-label-proxy" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488931 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="kube-rbac-proxy-metric" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488936 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="kube-rbac-proxy-metric" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488944 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="alertmanager" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488949 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="alertmanager" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488954 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="config-reloader" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488959 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="config-reloader" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488964 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="kube-rbac-proxy-web" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488969 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="kube-rbac-proxy-web" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488974 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="prometheus" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488978 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="prometheus" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488985 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="kube-rbac-proxy" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488989 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="kube-rbac-proxy" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.488995 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="kube-rbac-proxy-web" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.489000 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="kube-rbac-proxy-web" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.489005 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="kube-rbac-proxy-thanos" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.489010 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="kube-rbac-proxy-thanos" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.489015 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="config-reloader" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.489020 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="config-reloader" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.489057 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="kube-rbac-proxy-thanos" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.489064 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="kube-rbac-proxy-web" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.489070 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="kube-rbac-proxy" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.489076 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="alertmanager" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.489083 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="config-reloader" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.489093 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="kube-rbac-proxy" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.489101 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="prometheus" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.489109 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="config-reloader" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.489117 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="kube-rbac-proxy-web" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.489122 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" containerName="thanos-sidecar" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.489128 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="kube-rbac-proxy-metric" Jun 03 08:03:58.489175 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.489133 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0265d1a-2edc-432c-bcc6-467482a5ce00" containerName="prom-label-proxy" Jun 03 08:03:58.493955 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.493938 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.496411 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.496225 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 08:03:58.496411 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.496251 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 08:03:58.496411 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.496259 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-efo09lmp5ucak\"" Jun 03 08:03:58.496411 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.496285 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 08:03:58.496411 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.496251 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 08:03:58.496411 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.496299 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 08:03:58.496411 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.496314 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 08:03:58.496411 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.496257 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9gsv5\"" Jun 03 08:03:58.496815 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.496595 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 08:03:58.496815 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.496608 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 08:03:58.496902 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.496886 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 08:03:58.496942 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.496916 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 08:03:58.497075 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.497058 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 08:03:58.499792 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.499775 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 08:03:58.500539 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.500521 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 08:03:58.503345 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.503323 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:03:58.573796 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.573771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72e70e25-4617-45c7-add5-0626c5add00b-config-out\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.573921 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.573801 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.573921 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.573827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-config\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.573921 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.573854 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.573921 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.573875 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72e70e25-4617-45c7-add5-0626c5add00b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.573921 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.573918 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72e70e25-4617-45c7-add5-0626c5add00b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.574163 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.573937 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-web-config\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.574163 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.573960 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72e70e25-4617-45c7-add5-0626c5add00b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.574163 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.573987 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.574163 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.574016 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.574163 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.574036 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/72e70e25-4617-45c7-add5-0626c5add00b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.574163 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.574057 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.574163 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.574099 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72e70e25-4617-45c7-add5-0626c5add00b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.574399 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.574167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72e70e25-4617-45c7-add5-0626c5add00b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.574399 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.574190 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7whz\" (UniqueName: \"kubernetes.io/projected/72e70e25-4617-45c7-add5-0626c5add00b-kube-api-access-q7whz\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.574399 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.574217 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/72e70e25-4617-45c7-add5-0626c5add00b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.574399 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.574261 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.574399 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.574281 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.674585 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.674560 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/72e70e25-4617-45c7-add5-0626c5add00b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.674721 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.674591 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.674721 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.674609 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.674721 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.674626 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72e70e25-4617-45c7-add5-0626c5add00b-config-out\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.674721 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.674645 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.674721 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.674682 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-config\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.675593 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.674741 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.675593 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.674777 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72e70e25-4617-45c7-add5-0626c5add00b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.675593 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.674812 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72e70e25-4617-45c7-add5-0626c5add00b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.675593 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.674848 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-web-config\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.675593 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.674886 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72e70e25-4617-45c7-add5-0626c5add00b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.675593 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.674909 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.675593 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.674943 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.675593 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.674969 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/72e70e25-4617-45c7-add5-0626c5add00b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.675593 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.674999 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.675593 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.675024 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72e70e25-4617-45c7-add5-0626c5add00b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.675593 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.675058 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72e70e25-4617-45c7-add5-0626c5add00b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.675593 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.675084 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7whz\" (UniqueName: \"kubernetes.io/projected/72e70e25-4617-45c7-add5-0626c5add00b-kube-api-access-q7whz\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.675593 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.675563 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72e70e25-4617-45c7-add5-0626c5add00b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.678693 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.677449 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72e70e25-4617-45c7-add5-0626c5add00b-config-out\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.678693 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.677757 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.678693 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.677895 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.678693 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.677940 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72e70e25-4617-45c7-add5-0626c5add00b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.678693 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.677940 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-config\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.678693 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.678151 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/72e70e25-4617-45c7-add5-0626c5add00b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.678693 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.678636 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72e70e25-4617-45c7-add5-0626c5add00b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.678693 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.678656 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72e70e25-4617-45c7-add5-0626c5add00b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.679169 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.678857 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/72e70e25-4617-45c7-add5-0626c5add00b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.679169 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.679012 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72e70e25-4617-45c7-add5-0626c5add00b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.679540 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.679515 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.679670 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.679645 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.679947 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.679927 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.680120 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.680090 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.681061 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.681039 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.681161 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.681141 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72e70e25-4617-45c7-add5-0626c5add00b-web-config\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.681968 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.681947 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7whz\" (UniqueName: \"kubernetes.io/projected/72e70e25-4617-45c7-add5-0626c5add00b-kube-api-access-q7whz\") pod \"prometheus-k8s-0\" (UID: \"72e70e25-4617-45c7-add5-0626c5add00b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.805370 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.805292 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:03:58.932683 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:58.932563 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 08:03:58.935646 ip-10-0-128-28 kubenswrapper[2575]: W0603 08:03:58.935620 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72e70e25_4617_45c7_add5_0626c5add00b.slice/crio-65ae3b34d51efcfb01ff14c86fc1cb242f5d2b028c8db786ee53375617735ba4 WatchSource:0}: Error finding container 65ae3b34d51efcfb01ff14c86fc1cb242f5d2b028c8db786ee53375617735ba4: Status 404 returned error can't find the container with id 65ae3b34d51efcfb01ff14c86fc1cb242f5d2b028c8db786ee53375617735ba4 Jun 03 08:03:59.440481 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:59.440427 2575 generic.go:358] "Generic (PLEG): container finished" podID="72e70e25-4617-45c7-add5-0626c5add00b" containerID="f02cb9e2073a75f0e32aec71151ab7ccba5cc9216c534c97c9eca29db80e9da3" exitCode=0 Jun 03 08:03:59.440896 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:59.440492 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"72e70e25-4617-45c7-add5-0626c5add00b","Type":"ContainerDied","Data":"f02cb9e2073a75f0e32aec71151ab7ccba5cc9216c534c97c9eca29db80e9da3"} Jun 03 08:03:59.440896 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:59.440516 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"72e70e25-4617-45c7-add5-0626c5add00b","Type":"ContainerStarted","Data":"65ae3b34d51efcfb01ff14c86fc1cb242f5d2b028c8db786ee53375617735ba4"} Jun 03 08:03:59.612060 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:03:59.612022 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8439808a-1e51-436a-96f9-fe87f1412a6d" path="/var/lib/kubelet/pods/8439808a-1e51-436a-96f9-fe87f1412a6d/volumes" Jun 03 08:04:00.056144 ip-10-0-128-28 kubenswrapper[2575]: E0603 08:04:00.056050 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5rxfl" podUID="fe74542c-965c-4cec-886b-0c09af3fb49e" Jun 03 08:04:00.448378 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:00.448338 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"72e70e25-4617-45c7-add5-0626c5add00b","Type":"ContainerStarted","Data":"d99fe72222bc80cf215ecebcaa93e6c46b94a0a4b4270625ba0e53fadadfd1af"} Jun 03 08:04:00.448378 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:00.448369 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5rxfl" Jun 03 08:04:00.448378 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:00.448380 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"72e70e25-4617-45c7-add5-0626c5add00b","Type":"ContainerStarted","Data":"487ac01443936d30474f723bebe4b4715a1fe462318f66509ae9291a26d9d4b6"} Jun 03 08:04:00.448847 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:00.448393 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"72e70e25-4617-45c7-add5-0626c5add00b","Type":"ContainerStarted","Data":"cd8258b8961836bb564df9f3bb7b0f96d05d8e76567e2e170f8deba519fe35ce"} Jun 03 08:04:00.448847 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:00.448406 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"72e70e25-4617-45c7-add5-0626c5add00b","Type":"ContainerStarted","Data":"79e5af79de919c97636440463e49d7080074623a7b77f86a93e1eca698157802"} Jun 03 08:04:00.448847 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:00.448419 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"72e70e25-4617-45c7-add5-0626c5add00b","Type":"ContainerStarted","Data":"222c27e4caed79f3b16f756efe2cd72c8a20350f5fd69a1f3d91fa6c33f69bc8"} Jun 03 08:04:00.448847 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:00.448449 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"72e70e25-4617-45c7-add5-0626c5add00b","Type":"ContainerStarted","Data":"65c89627b3284d77e09258aea0f39e2e37ffefd13e1f38e467d9b7128a126574"} Jun 03 08:04:00.475852 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:00.475806 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.475787574 podStartE2EDuration="2.475787574s" podCreationTimestamp="2026-06-03 08:03:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:04:00.475261292 +0000 UTC m=+281.454604223" watchObservedRunningTime="2026-06-03 08:04:00.475787574 +0000 UTC m=+281.455130486" Jun 03 08:04:03.415878 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:03.415841 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 08:04:03.415878 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:03.415890 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert\") pod \"ingress-canary-rz58k\" (UID: \"18c59173-7593-42ad-9c17-2c8580e0a1da\") " pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 08:04:03.418232 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:03.418204 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe74542c-965c-4cec-886b-0c09af3fb49e-metrics-tls\") pod \"dns-default-5rxfl\" (UID: \"fe74542c-965c-4cec-886b-0c09af3fb49e\") " pod="openshift-dns/dns-default-5rxfl" Jun 03 08:04:03.418341 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:03.418254 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18c59173-7593-42ad-9c17-2c8580e0a1da-cert\") pod \"ingress-canary-rz58k\" (UID: \"18c59173-7593-42ad-9c17-2c8580e0a1da\") " pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 08:04:03.451894 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:03.451872 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hgsv2\"" Jun 03 08:04:03.459934 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:03.459909 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5rxfl" Jun 03 08:04:03.505872 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:03.505844 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9qc5s\"" Jun 03 08:04:03.514472 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:03.514393 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rz58k" Jun 03 08:04:03.586540 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:03.586507 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5rxfl"] Jun 03 08:04:03.589332 ip-10-0-128-28 kubenswrapper[2575]: W0603 08:04:03.589302 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe74542c_965c_4cec_886b_0c09af3fb49e.slice/crio-3ac4ec41733ad01dd4c6e48ae4e062b73e6cc7cd9ff5c816922ad3e9e5cfa246 WatchSource:0}: Error finding container 3ac4ec41733ad01dd4c6e48ae4e062b73e6cc7cd9ff5c816922ad3e9e5cfa246: Status 404 returned error can't find the container with id 3ac4ec41733ad01dd4c6e48ae4e062b73e6cc7cd9ff5c816922ad3e9e5cfa246 Jun 03 08:04:03.637278 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:03.637224 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rz58k"] Jun 03 08:04:03.641559 ip-10-0-128-28 kubenswrapper[2575]: W0603 08:04:03.641533 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c59173_7593_42ad_9c17_2c8580e0a1da.slice/crio-e0f40b543a890c5992e840b1baaba9fc5d267dd875025576f6a9bd27a8ed6688 WatchSource:0}: Error finding container e0f40b543a890c5992e840b1baaba9fc5d267dd875025576f6a9bd27a8ed6688: Status 404 returned error can't find the container with id e0f40b543a890c5992e840b1baaba9fc5d267dd875025576f6a9bd27a8ed6688 Jun 03 08:04:03.806187 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:03.806100 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:04:04.461969 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:04.461909 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rz58k" event={"ID":"18c59173-7593-42ad-9c17-2c8580e0a1da","Type":"ContainerStarted","Data":"e0f40b543a890c5992e840b1baaba9fc5d267dd875025576f6a9bd27a8ed6688"} Jun 03 08:04:04.463191 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:04.463162 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5rxfl" event={"ID":"fe74542c-965c-4cec-886b-0c09af3fb49e","Type":"ContainerStarted","Data":"3ac4ec41733ad01dd4c6e48ae4e062b73e6cc7cd9ff5c816922ad3e9e5cfa246"} Jun 03 08:04:06.470231 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:06.470195 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rz58k" event={"ID":"18c59173-7593-42ad-9c17-2c8580e0a1da","Type":"ContainerStarted","Data":"cb72fb4ee77cf77c0d6099990f42eee663ff6069df5091a2236768d414129df1"} Jun 03 08:04:06.471790 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:06.471766 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5rxfl" event={"ID":"fe74542c-965c-4cec-886b-0c09af3fb49e","Type":"ContainerStarted","Data":"19d21ce4fdd6e3cb6a82ab2749cdfc2e62024a48555c0f3bbe5c63f5bc8ac2e9"} Jun 03 08:04:06.471929 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:06.471794 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5rxfl" event={"ID":"fe74542c-965c-4cec-886b-0c09af3fb49e","Type":"ContainerStarted","Data":"d14a9894cc9b2b40ec2eaae91b59513a65b9241a08ea927d8acfbe1e3e5803d3"} Jun 03 08:04:06.471929 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:06.471898 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5rxfl" Jun 03 08:04:06.485611 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:06.485541 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rz58k" podStartSLOduration=251.718092378 podStartE2EDuration="4m13.485525132s" podCreationTimestamp="2026-06-03 07:59:53 +0000 UTC" firstStartedPulling="2026-06-03 08:04:03.64330749 +0000 UTC m=+284.622650379" lastFinishedPulling="2026-06-03 08:04:05.410740231 +0000 UTC m=+286.390083133" observedRunningTime="2026-06-03 08:04:06.484344938 +0000 UTC m=+287.463687849" watchObservedRunningTime="2026-06-03 08:04:06.485525132 +0000 UTC m=+287.464868043" Jun 03 08:04:06.498483 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:06.498405 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-5rxfl" podStartSLOduration=251.682128765 podStartE2EDuration="4m13.498386906s" podCreationTimestamp="2026-06-03 07:59:53 +0000 UTC" firstStartedPulling="2026-06-03 08:04:03.591411196 +0000 UTC m=+284.570754099" lastFinishedPulling="2026-06-03 08:04:05.407669338 +0000 UTC m=+286.387012240" observedRunningTime="2026-06-03 08:04:06.497633238 +0000 UTC m=+287.476976150" watchObservedRunningTime="2026-06-03 08:04:06.498386906 +0000 UTC m=+287.477729819" Jun 03 08:04:16.477722 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:16.477693 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5rxfl" Jun 03 08:04:19.487972 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:19.487418 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n47h8_39d791cc-5930-4e19-a8db-498ce4237bf2/ovn-acl-logging/0.log" Jun 03 08:04:19.488296 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:19.488200 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n47h8_39d791cc-5930-4e19-a8db-498ce4237bf2/ovn-acl-logging/0.log" Jun 03 08:04:19.494047 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:19.494030 2575 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 08:04:58.806226 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:58.806194 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:04:58.821185 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:58.821161 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:04:59.629899 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:04:59.629874 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 08:06:24.231473 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:24.231423 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j5mgp_4d7b0246-ed7e-47be-89de-5061a041b35e/global-pull-secret-syncer/0.log" Jun 03 08:06:24.338643 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:24.338615 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l5qvl_5433f7ef-1518-4ece-8406-614de4489441/konnectivity-agent/0.log" Jun 03 08:06:24.379242 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:24.379218 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-28.ec2.internal_23d8c441f7d9cf4fc58ff38513145034/haproxy/0.log" Jun 03 08:06:27.755481 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:27.755455 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-2gmnt_88e128a3-4f38-4e7d-8358-1ca2b0fdbada/cluster-monitoring-operator/0.log" Jun 03 08:06:27.868374 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:27.868343 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-gdrzd_ef33f9e7-f49a-4a22-9cb7-e3f484d04e34/monitoring-plugin/0.log" Jun 03 08:06:28.033722 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:28.033641 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d6pcw_0faea3c7-fcd3-4151-bb47-b33b58e8bad7/node-exporter/0.log" Jun 03 08:06:28.055876 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:28.055854 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d6pcw_0faea3c7-fcd3-4151-bb47-b33b58e8bad7/kube-rbac-proxy/0.log" Jun 03 08:06:28.077545 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:28.077526 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d6pcw_0faea3c7-fcd3-4151-bb47-b33b58e8bad7/init-textfile/0.log" Jun 03 08:06:28.177468 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:28.177425 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_72e70e25-4617-45c7-add5-0626c5add00b/prometheus/0.log" Jun 03 08:06:28.199073 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:28.199051 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_72e70e25-4617-45c7-add5-0626c5add00b/config-reloader/0.log" Jun 03 08:06:28.218693 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:28.218671 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_72e70e25-4617-45c7-add5-0626c5add00b/thanos-sidecar/0.log" Jun 03 08:06:28.237502 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:28.237478 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_72e70e25-4617-45c7-add5-0626c5add00b/kube-rbac-proxy-web/0.log" Jun 03 08:06:28.255376 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:28.255357 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_72e70e25-4617-45c7-add5-0626c5add00b/kube-rbac-proxy/0.log" Jun 03 08:06:28.273321 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:28.273294 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_72e70e25-4617-45c7-add5-0626c5add00b/kube-rbac-proxy-thanos/0.log" Jun 03 08:06:28.294207 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:28.294152 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_72e70e25-4617-45c7-add5-0626c5add00b/init-config-reloader/0.log" Jun 03 08:06:30.771853 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.771821 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n"] Jun 03 08:06:30.774986 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.774968 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:30.777354 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.777328 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7hcpb\"/\"openshift-service-ca.crt\"" Jun 03 08:06:30.777953 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.777935 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7hcpb\"/\"default-dockercfg-8xfp9\"" Jun 03 08:06:30.778046 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.777982 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7hcpb\"/\"kube-root-ca.crt\"" Jun 03 08:06:30.791720 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.791699 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n"] Jun 03 08:06:30.866382 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.866357 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kwwc\" (UniqueName: \"kubernetes.io/projected/5022968b-c96c-43cd-bfde-36d5caa41c70-kube-api-access-2kwwc\") pod \"perf-node-gather-daemonset-lfd4n\" (UID: \"5022968b-c96c-43cd-bfde-36d5caa41c70\") " pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:30.866525 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.866390 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5022968b-c96c-43cd-bfde-36d5caa41c70-sys\") pod \"perf-node-gather-daemonset-lfd4n\" (UID: \"5022968b-c96c-43cd-bfde-36d5caa41c70\") " pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:30.866525 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.866415 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5022968b-c96c-43cd-bfde-36d5caa41c70-lib-modules\") pod \"perf-node-gather-daemonset-lfd4n\" (UID: \"5022968b-c96c-43cd-bfde-36d5caa41c70\") " pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:30.866648 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.866539 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5022968b-c96c-43cd-bfde-36d5caa41c70-podres\") pod \"perf-node-gather-daemonset-lfd4n\" (UID: \"5022968b-c96c-43cd-bfde-36d5caa41c70\") " pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:30.866648 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.866582 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5022968b-c96c-43cd-bfde-36d5caa41c70-proc\") pod \"perf-node-gather-daemonset-lfd4n\" (UID: \"5022968b-c96c-43cd-bfde-36d5caa41c70\") " pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:30.967407 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.967383 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5022968b-c96c-43cd-bfde-36d5caa41c70-podres\") pod \"perf-node-gather-daemonset-lfd4n\" (UID: \"5022968b-c96c-43cd-bfde-36d5caa41c70\") " pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:30.967546 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.967417 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5022968b-c96c-43cd-bfde-36d5caa41c70-proc\") pod \"perf-node-gather-daemonset-lfd4n\" (UID: \"5022968b-c96c-43cd-bfde-36d5caa41c70\") " pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:30.967546 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.967483 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kwwc\" (UniqueName: \"kubernetes.io/projected/5022968b-c96c-43cd-bfde-36d5caa41c70-kube-api-access-2kwwc\") pod \"perf-node-gather-daemonset-lfd4n\" (UID: \"5022968b-c96c-43cd-bfde-36d5caa41c70\") " pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:30.967546 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.967510 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5022968b-c96c-43cd-bfde-36d5caa41c70-sys\") pod \"perf-node-gather-daemonset-lfd4n\" (UID: \"5022968b-c96c-43cd-bfde-36d5caa41c70\") " pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:30.967546 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.967528 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5022968b-c96c-43cd-bfde-36d5caa41c70-lib-modules\") pod \"perf-node-gather-daemonset-lfd4n\" (UID: \"5022968b-c96c-43cd-bfde-36d5caa41c70\") " pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:30.967705 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.967568 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5022968b-c96c-43cd-bfde-36d5caa41c70-podres\") pod \"perf-node-gather-daemonset-lfd4n\" (UID: \"5022968b-c96c-43cd-bfde-36d5caa41c70\") " pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:30.967705 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.967585 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5022968b-c96c-43cd-bfde-36d5caa41c70-proc\") pod \"perf-node-gather-daemonset-lfd4n\" (UID: \"5022968b-c96c-43cd-bfde-36d5caa41c70\") " pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:30.967705 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.967606 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5022968b-c96c-43cd-bfde-36d5caa41c70-sys\") pod \"perf-node-gather-daemonset-lfd4n\" (UID: \"5022968b-c96c-43cd-bfde-36d5caa41c70\") " pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:30.967705 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.967655 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5022968b-c96c-43cd-bfde-36d5caa41c70-lib-modules\") pod \"perf-node-gather-daemonset-lfd4n\" (UID: \"5022968b-c96c-43cd-bfde-36d5caa41c70\") " pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:30.973780 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:30.973764 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kwwc\" (UniqueName: \"kubernetes.io/projected/5022968b-c96c-43cd-bfde-36d5caa41c70-kube-api-access-2kwwc\") pod \"perf-node-gather-daemonset-lfd4n\" (UID: \"5022968b-c96c-43cd-bfde-36d5caa41c70\") " pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:31.084539 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:31.084460 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:31.207325 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:31.207166 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n"] Jun 03 08:06:31.209950 ip-10-0-128-28 kubenswrapper[2575]: W0603 08:06:31.209923 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5022968b_c96c_43cd_bfde_36d5caa41c70.slice/crio-e9a960873c2a7bef9ba96a340992c8832dd1e00d101ddfb54feff5844373a8c2 WatchSource:0}: Error finding container e9a960873c2a7bef9ba96a340992c8832dd1e00d101ddfb54feff5844373a8c2: Status 404 returned error can't find the container with id e9a960873c2a7bef9ba96a340992c8832dd1e00d101ddfb54feff5844373a8c2 Jun 03 08:06:31.211843 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:31.211827 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 08:06:31.424321 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:31.424299 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5rxfl_fe74542c-965c-4cec-886b-0c09af3fb49e/dns/0.log" Jun 03 08:06:31.444536 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:31.444510 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5rxfl_fe74542c-965c-4cec-886b-0c09af3fb49e/kube-rbac-proxy/0.log" Jun 03 08:06:31.567858 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:31.567835 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dgbmm_8e98347d-1bbd-4bf5-84fc-9d8a4386606c/dns-node-resolver/0.log" Jun 03 08:06:31.851260 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:31.851174 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" event={"ID":"5022968b-c96c-43cd-bfde-36d5caa41c70","Type":"ContainerStarted","Data":"f177c0281d1941ce9492f40d94635c5f7a1a24ad23e7070bf91b037e83bcf9e8"} Jun 03 08:06:31.851260 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:31.851209 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" event={"ID":"5022968b-c96c-43cd-bfde-36d5caa41c70","Type":"ContainerStarted","Data":"e9a960873c2a7bef9ba96a340992c8832dd1e00d101ddfb54feff5844373a8c2"} Jun 03 08:06:31.851712 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:31.851296 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:31.864659 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:31.864617 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" podStartSLOduration=1.864604902 podStartE2EDuration="1.864604902s" podCreationTimestamp="2026-06-03 08:06:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:06:31.863645555 +0000 UTC m=+432.842988489" watchObservedRunningTime="2026-06-03 08:06:31.864604902 +0000 UTC m=+432.843947809" Jun 03 08:06:32.001015 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:32.000980 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wpg8p_6f2cf176-8955-4aeb-a63e-5c75c3c73886/node-ca/0.log" Jun 03 08:06:32.636558 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:32.636526 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-845898d757-kxct6_1b9a0f50-6201-4143-9517-5617425c02bc/router/0.log" Jun 03 08:06:32.953281 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:32.953172 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rz58k_18c59173-7593-42ad-9c17-2c8580e0a1da/serve-healthcheck-canary/0.log" Jun 03 08:06:33.414523 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:33.414490 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8qpwh_ff006ff4-7222-4264-80e2-090c651c1205/kube-rbac-proxy/0.log" Jun 03 08:06:33.431692 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:33.431671 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8qpwh_ff006ff4-7222-4264-80e2-090c651c1205/exporter/0.log" Jun 03 08:06:33.449831 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:33.449803 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8qpwh_ff006ff4-7222-4264-80e2-090c651c1205/extractor/0.log" Jun 03 08:06:36.946577 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:36.946549 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-jlhff_bbd74c2c-7712-4673-96ba-61b458ae9f8c/migrator/0.log" Jun 03 08:06:36.963861 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:36.963840 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-jlhff_bbd74c2c-7712-4673-96ba-61b458ae9f8c/graceful-termination/0.log" Jun 03 08:06:37.862376 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:37.862346 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7hcpb/perf-node-gather-daemonset-lfd4n" Jun 03 08:06:38.214971 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:38.214898 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8llk_f787947a-a855-4f90-ac17-9d832a9748aa/kube-multus-additional-cni-plugins/0.log" Jun 03 08:06:38.233350 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:38.233329 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8llk_f787947a-a855-4f90-ac17-9d832a9748aa/egress-router-binary-copy/0.log" Jun 03 08:06:38.251884 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:38.251869 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8llk_f787947a-a855-4f90-ac17-9d832a9748aa/cni-plugins/0.log" Jun 03 08:06:38.269934 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:38.269915 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8llk_f787947a-a855-4f90-ac17-9d832a9748aa/bond-cni-plugin/0.log" Jun 03 08:06:38.288284 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:38.288264 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8llk_f787947a-a855-4f90-ac17-9d832a9748aa/routeoverride-cni/0.log" Jun 03 08:06:38.306759 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:38.306737 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8llk_f787947a-a855-4f90-ac17-9d832a9748aa/whereabouts-cni-bincopy/0.log" Jun 03 08:06:38.324066 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:38.324046 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8llk_f787947a-a855-4f90-ac17-9d832a9748aa/whereabouts-cni/0.log" Jun 03 08:06:38.351014 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:38.350995 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dxqvm_efd627d9-3a4c-4826-814c-08197e84cfb2/kube-multus/0.log" Jun 03 08:06:38.497314 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:38.497255 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rqpqj_d56b198a-8bb2-4f98-9300-d4dffff20c44/network-metrics-daemon/0.log" Jun 03 08:06:38.513569 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:38.513552 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rqpqj_d56b198a-8bb2-4f98-9300-d4dffff20c44/kube-rbac-proxy/0.log" Jun 03 08:06:39.544303 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:39.544276 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n47h8_39d791cc-5930-4e19-a8db-498ce4237bf2/ovn-controller/0.log" Jun 03 08:06:39.560315 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:39.560287 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n47h8_39d791cc-5930-4e19-a8db-498ce4237bf2/ovn-acl-logging/0.log" Jun 03 08:06:39.565078 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:39.565062 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n47h8_39d791cc-5930-4e19-a8db-498ce4237bf2/ovn-acl-logging/1.log" Jun 03 08:06:39.587131 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:39.587106 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n47h8_39d791cc-5930-4e19-a8db-498ce4237bf2/kube-rbac-proxy-node/0.log" Jun 03 08:06:39.617598 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:39.617566 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n47h8_39d791cc-5930-4e19-a8db-498ce4237bf2/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 08:06:39.636724 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:39.636704 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n47h8_39d791cc-5930-4e19-a8db-498ce4237bf2/northd/0.log" Jun 03 08:06:39.656593 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:39.656574 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n47h8_39d791cc-5930-4e19-a8db-498ce4237bf2/nbdb/0.log" Jun 03 08:06:39.675826 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:39.675807 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n47h8_39d791cc-5930-4e19-a8db-498ce4237bf2/sbdb/0.log" Jun 03 08:06:39.841786 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:39.841760 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n47h8_39d791cc-5930-4e19-a8db-498ce4237bf2/ovnkube-controller/0.log" Jun 03 08:06:40.981116 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:40.981086 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56d84b9f44-rzm6d_06e4f150-44cb-4e82-90a4-eded2af66af3/check-endpoints/0.log" Jun 03 08:06:41.002059 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:41.002038 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-dd4vj_0dbef335-62ed-405a-a0d5-74cc429ec15e/network-check-target-container/0.log" Jun 03 08:06:41.937714 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:41.937644 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-9bgfk_f90b753a-1b54-478c-812a-e8d590c0ab53/iptables-alerter/0.log" Jun 03 08:06:42.543992 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:42.543968 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-r2hph_050f3ecb-7b61-4926-b709-60dfcc68e7a3/tuned/0.log" Jun 03 08:06:44.052825 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:44.052799 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-755bbf9bfb-4gvnl_da0a23f7-d439-4793-939c-4b680c73b53d/cluster-samples-operator/0.log" Jun 03 08:06:44.068060 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:44.068034 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-755bbf9bfb-4gvnl_da0a23f7-d439-4793-939c-4b680c73b53d/cluster-samples-operator-watch/0.log" Jun 03 08:06:44.950569 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:44.950533 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-69877444c-j8tcq_fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f/service-ca-operator/1.log" Jun 03 08:06:44.951976 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:44.951956 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-69877444c-j8tcq_fb83f0e7-3e5c-49a5-9e8c-ffc3e778d02f/service-ca-operator/0.log" Jun 03 08:06:45.540597 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:45.540574 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-7gnrx_1cfa20b7-84b5-4070-aa99-5b03fc3cb859/csi-driver/0.log" Jun 03 08:06:45.557995 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:45.557967 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-7gnrx_1cfa20b7-84b5-4070-aa99-5b03fc3cb859/csi-node-driver-registrar/0.log" Jun 03 08:06:45.574972 ip-10-0-128-28 kubenswrapper[2575]: I0603 08:06:45.574953 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-7gnrx_1cfa20b7-84b5-4070-aa99-5b03fc3cb859/csi-liveness-probe/0.log"