Jun 03 20:40:45.668079 ip-10-0-128-196 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 20:40:45.668091 ip-10-0-128-196 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 20:40:45.668100 ip-10-0-128-196 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 20:40:45.668418 ip-10-0-128-196 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 20:40:55.561378 ip-10-0-128-196 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 03 20:40:55.561395 ip-10-0-128-196 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c5cf49458b0c413cb21b63b3aa6222e3 -- Jun 03 20:43:17.261646 ip-10-0-128-196 systemd[1]: Starting Kubernetes Kubelet... Jun 03 20:43:17.737045 ip-10-0-128-196 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 20:43:17.737045 ip-10-0-128-196 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 20:43:17.737045 ip-10-0-128-196 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 20:43:17.737045 ip-10-0-128-196 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 20:43:17.737045 ip-10-0-128-196 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 20:43:17.737750 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.737134 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 20:43:17.746270 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746239 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:17.746270 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746265 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:17.746270 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746269 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:17.746270 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746273 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:17.746270 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746277 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746283 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746287 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746291 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746296 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746300 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746304 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746308 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746312 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746316 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746319 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746323 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746327 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746331 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746335 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746357 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746362 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746366 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746370 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746374 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:17.746636 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746378 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746381 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746385 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746389 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746392 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746396 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746400 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746406 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746410 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746414 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746418 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746423 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746426 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746431 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746434 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746439 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746442 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746446 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746450 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746454 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:17.747532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746458 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746465 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746471 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746476 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746483 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746489 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746494 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746499 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746503 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746509 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746513 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746517 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746522 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746527 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746531 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746536 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746540 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746545 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746550 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:17.748414 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746555 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746561 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746569 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746573 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746578 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746582 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746587 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746591 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746595 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746599 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746603 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746608 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746612 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746616 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746620 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746625 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746629 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746633 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746637 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:17.749183 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746640 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746655 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746660 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746664 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746668 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746672 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746676 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746681 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746685 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746689 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746694 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746698 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746703 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746707 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746712 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.746716 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.747983 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.747995 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748000 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748004 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:17.750022 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748008 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748013 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748017 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748022 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748026 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748030 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748034 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748039 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748043 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748047 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748052 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748056 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748060 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748067 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748081 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748087 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748092 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748096 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748100 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748105 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:17.750883 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748109 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748113 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748118 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748122 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748127 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748133 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748137 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748144 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748150 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748155 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748159 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748165 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748169 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748173 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748177 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748181 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748186 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748190 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748194 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:17.751610 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748199 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748203 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748207 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748212 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748216 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748220 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748225 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748229 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748243 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748247 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748252 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748256 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748260 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748265 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748269 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748274 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748278 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748282 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748287 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748291 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:17.752084 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748296 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748300 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748304 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748310 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748315 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748320 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748325 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748329 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748333 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748337 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748362 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748367 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748371 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748377 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748381 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748385 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748390 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748394 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748399 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748403 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:17.752685 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748407 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748419 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748424 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748428 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748432 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748436 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748440 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748445 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748449 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748453 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748458 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748462 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748467 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748471 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.748475 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749229 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749238 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749244 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749248 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749252 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:17.753334 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749257 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749261 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749265 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749273 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749279 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749285 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749289 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749294 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749298 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749303 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749307 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749312 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749316 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749321 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749326 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749330 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749334 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749358 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749363 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:17.754047 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749368 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749372 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749376 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749381 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749385 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749390 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749394 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749399 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749405 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749410 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749415 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749419 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749424 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749428 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749432 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749437 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749441 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749446 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749450 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749454 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:17.754544 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749458 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749463 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749467 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749471 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749476 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749480 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749484 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749490 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749494 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749498 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749502 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749507 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749517 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749521 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749525 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749530 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749534 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749538 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749544 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749548 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:17.755162 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749552 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749556 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749563 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749569 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749574 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749579 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749583 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749587 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749592 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749596 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749603 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749607 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749611 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749616 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749620 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749624 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749628 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749632 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749637 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749641 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:17.755692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749647 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749651 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749656 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749660 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749666 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749670 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749674 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749679 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749683 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749687 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749692 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749696 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749701 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.749705 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749811 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749823 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749834 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749841 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749848 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749853 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749860 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 20:43:17.756203 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749867 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749873 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749878 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749883 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749889 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749894 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749898 2577 flags.go:64] FLAG: --cgroup-root="" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749903 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749908 2577 flags.go:64] FLAG: --client-ca-file="" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749913 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749918 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749925 2577 flags.go:64] FLAG: --cluster-domain="" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749931 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749936 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749941 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749949 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749955 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749970 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749976 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749981 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749986 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749991 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.749996 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750004 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 20:43:17.756736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750009 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750016 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750021 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750026 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750030 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750035 2577 flags.go:64] FLAG: --enable-server="true" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750039 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750049 2577 flags.go:64] FLAG: --event-burst="100" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750054 2577 flags.go:64] FLAG: --event-qps="50" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750058 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750063 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750069 2577 flags.go:64] FLAG: --eviction-hard="" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750075 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750081 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750086 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750091 2577 flags.go:64] FLAG: --eviction-soft="" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750095 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750100 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750105 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750110 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750115 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750121 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750126 2577 flags.go:64] FLAG: --feature-gates="" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750132 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750137 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 20:43:17.757930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750142 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750147 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750152 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750157 2577 flags.go:64] FLAG: --help="false" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750162 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-128-196.ec2.internal" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750167 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750174 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750179 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750184 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750190 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750194 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750199 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750204 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750208 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750213 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750218 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750223 2577 flags.go:64] FLAG: --kube-reserved="" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750228 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750233 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750238 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750242 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750247 2577 flags.go:64] FLAG: --lock-file="" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750252 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750257 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 20:43:17.758633 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750262 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750270 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750275 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750280 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750285 2577 flags.go:64] FLAG: --logging-format="text" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750290 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750296 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750301 2577 flags.go:64] FLAG: --manifest-url="" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750305 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750312 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750317 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750324 2577 flags.go:64] FLAG: --max-pods="110" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750329 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750334 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750358 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750363 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750368 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750373 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750378 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750391 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750396 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750401 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750406 2577 flags.go:64] FLAG: --pod-cidr="" Jun 03 20:43:17.759229 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750411 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750420 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750424 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750430 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750434 2577 flags.go:64] FLAG: --port="10250" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750440 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750444 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-098daa32f230947db" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750450 2577 flags.go:64] FLAG: --qos-reserved="" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750454 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750459 2577 flags.go:64] FLAG: --register-node="true" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750465 2577 flags.go:64] FLAG: --register-with-taints="" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750471 2577 flags.go:64] FLAG: --registry-burst="10" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750476 2577 flags.go:64] FLAG: --registry-qps="5" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750480 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750485 2577 flags.go:64] FLAG: --reserved-memory="" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750492 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750498 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750503 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750508 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750513 2577 flags.go:64] FLAG: --runonce="false" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750518 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750523 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750527 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750538 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750543 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750549 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 20:43:17.759861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750554 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750559 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750564 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750568 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750573 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750577 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750583 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750588 2577 flags.go:64] FLAG: --system-cgroups="" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750593 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750602 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750607 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750611 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750618 2577 flags.go:64] FLAG: --tls-min-version="" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750622 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750627 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750632 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750637 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750642 2577 flags.go:64] FLAG: --v="2" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750649 2577 flags.go:64] FLAG: --version="false" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750655 2577 flags.go:64] FLAG: --vmodule="" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750662 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.750668 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750865 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750873 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:17.760521 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750878 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750884 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750890 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750895 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750900 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750907 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750912 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750916 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750920 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750925 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750929 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750934 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750940 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750946 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750950 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750955 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750959 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750964 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750968 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:17.761121 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750973 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750978 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750982 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750987 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750993 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.750998 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751002 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751006 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751010 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751015 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751019 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751023 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751029 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751033 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751038 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751042 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751047 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751051 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751057 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751063 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:17.761745 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751069 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751073 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751078 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751082 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751087 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751092 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751096 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751100 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751105 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751109 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751114 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751118 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751122 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751126 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751130 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751135 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751141 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751145 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751149 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751154 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:17.762255 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751158 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751162 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751166 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751170 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751174 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751180 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751184 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751188 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751192 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751196 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751202 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751206 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751211 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751215 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751219 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751224 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751228 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751233 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751237 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751241 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:17.762763 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751246 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:17.763252 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751250 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:17.763252 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751254 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:17.763252 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751259 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:17.763252 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751263 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:17.763252 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751268 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:17.763252 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751272 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:17.763252 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751277 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:17.763252 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751283 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:17.763252 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751287 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:17.763252 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751291 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:17.763252 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751296 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:17.763252 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751300 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:17.763252 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751304 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:17.763252 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751308 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:17.763252 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751313 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:17.763252 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.751317 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:17.763672 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.752243 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 20:43:17.763672 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.759501 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 20:43:17.763672 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.759628 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 20:43:17.763672 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.759652 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 20:43:17.763672 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.759657 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 20:43:17.763672 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759716 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:17.763672 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759721 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:17.763672 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759725 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:17.763672 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759728 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:17.763672 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759731 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:17.763672 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759733 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:17.763672 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759736 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:17.763672 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759739 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:17.763672 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759742 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:17.763672 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759744 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759747 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759750 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759753 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759755 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759758 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759761 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759764 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759766 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759769 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759772 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759775 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759777 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759780 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759782 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759785 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759787 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759790 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759792 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759796 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:17.764049 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759799 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759802 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759805 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759807 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759810 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759812 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759815 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759818 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759820 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759822 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759825 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759828 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759831 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759833 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759836 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759838 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759841 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759844 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759848 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:17.764566 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759852 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759855 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759857 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759860 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759863 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759866 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759869 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759872 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759875 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759878 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759880 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759883 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759886 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759894 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759897 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759900 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759903 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759906 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759908 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759911 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:17.765042 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759913 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759917 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759921 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759924 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759927 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759929 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759932 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759934 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759937 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759939 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759942 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759944 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759947 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759950 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759952 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759954 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759957 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759961 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759964 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759967 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:17.765556 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759970 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:17.766064 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759972 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:17.766064 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759975 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:17.766064 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759979 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:17.766064 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759983 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:17.766064 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759986 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:17.766064 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759989 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:17.766064 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759992 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:17.766064 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759995 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:17.766064 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.759998 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:17.766064 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.760003 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 20:43:17.766064 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760118 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 20:43:17.766064 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760122 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 20:43:17.766064 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760126 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 20:43:17.766064 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760129 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 20:43:17.766064 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760132 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760135 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760138 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760141 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760144 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760147 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760149 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760152 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760155 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760158 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760160 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760163 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760165 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760168 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760171 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760173 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760176 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760178 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760181 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 20:43:17.766549 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760185 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760188 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760191 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760194 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760197 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760201 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760204 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760207 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760209 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760212 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760215 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760217 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760220 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760223 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760225 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760228 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760231 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760233 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760236 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 20:43:17.767046 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760239 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760241 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760244 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760246 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760249 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760251 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760254 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760256 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760259 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760261 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760264 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760268 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760271 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760274 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760277 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760280 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760283 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760286 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760288 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 20:43:17.767532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760291 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760294 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760297 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760300 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760303 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760307 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760309 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760312 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760314 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760317 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760320 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760323 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760325 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760328 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760331 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760334 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760336 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760354 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760359 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760363 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 20:43:17.767997 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760367 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 20:43:17.768519 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760371 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 20:43:17.768519 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760375 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 20:43:17.768519 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760378 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 20:43:17.768519 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760381 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 20:43:17.768519 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760384 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 20:43:17.768519 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760386 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 20:43:17.768519 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760389 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 20:43:17.768519 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760392 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 20:43:17.768519 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760394 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 20:43:17.768519 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760397 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 20:43:17.768519 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760400 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 20:43:17.768519 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760402 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 20:43:17.768519 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760406 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 20:43:17.768519 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760409 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 20:43:17.768519 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760411 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 20:43:17.768519 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:17.760414 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 20:43:17.768911 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.760419 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 20:43:17.768911 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.760540 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 20:43:17.768911 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.763621 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 20:43:17.768911 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.765138 2577 server.go:1019] "Starting client certificate rotation" Jun 03 20:43:17.768911 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.765237 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 20:43:17.768911 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.765268 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 20:43:17.768911 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.768405 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 20:43:17.769570 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.769545 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 20:43:17.781323 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.781301 2577 log.go:25] "Validated CRI v1 runtime API" Jun 03 20:43:17.784326 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.784301 2577 log.go:25] "Validated CRI v1 image API" Jun 03 20:43:17.785147 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.785133 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 20:43:17.787781 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.787763 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 aaae1dbe-1fd2-4bd9-9efc-65676097bdc4:/dev/nvme0n1p3 ccf33898-545b-4d0f-a7be-db099d4f9b87:/dev/nvme0n1p4] Jun 03 20:43:17.787844 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.787781 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 20:43:17.793009 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.792897 2577 manager.go:216] Machine: {Timestamp:2026-06-03 20:43:17.791561531 +0000 UTC m=+0.392788504 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3118922 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec200068580ce3856af6dba17e01f32f SystemUUID:ec200068-580c-e385-6af6-dba17e01f32f BootID:c5cf4945-8b0c-413c-b21b-63b3aa6222e3 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0b:89:65:47:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0b:89:65:47:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:c1:f3:8a:c4:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 20:43:17.793009 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.793007 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 20:43:17.793147 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.793136 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 20:43:17.796559 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.796535 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 20:43:17.796718 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.796565 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-196.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 20:43:17.797305 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.797290 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 20:43:17.797802 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.797790 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 20:43:17.797843 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.797807 2577 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 20:43:17.797843 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.797815 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 20:43:17.797843 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.797827 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 20:43:17.798756 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.798745 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 20:43:17.801750 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.801738 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 03 20:43:17.801868 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.801859 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 20:43:17.801899 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.801890 2577 kubelet.go:486] "Attempting to sync node with API server" Jun 03 20:43:17.801929 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.801900 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 20:43:17.801929 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.801914 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 20:43:17.801929 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.801924 2577 kubelet.go:398] "Adding apiserver pod source" Jun 03 20:43:17.802044 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.801934 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 20:43:17.802306 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.802292 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 20:43:17.802397 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.802310 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 20:43:17.804842 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.804824 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 20:43:17.807002 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.806989 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 20:43:17.807046 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.807019 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 20:43:17.808443 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.808431 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 20:43:17.808488 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.808448 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 20:43:17.808488 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.808454 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 20:43:17.808488 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.808459 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 20:43:17.808488 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.808469 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 20:43:17.808488 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.808474 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 20:43:17.808488 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.808483 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 20:43:17.808488 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.808488 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 20:43:17.808662 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.808501 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 20:43:17.808662 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.808507 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 20:43:17.808662 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.808521 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 20:43:17.808662 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.808527 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 20:43:17.809456 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.809447 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 20:43:17.809456 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.809456 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 20:43:17.812678 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.812651 2577 server.go:1268] "Started kubelet" Jun 03 20:43:17.812770 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.812706 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 20:43:17.813257 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.813190 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 20:43:17.813320 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.813280 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 20:43:17.814039 ip-10-0-128-196 systemd[1]: Started Kubernetes Kubelet. Jun 03 20:43:17.814772 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.814705 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-196.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 20:43:17.814854 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.814783 2577 server.go:310] "Adding debug handlers to kubelet server" Jun 03 20:43:17.817367 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.817287 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 20:43:17.817841 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:17.817808 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 20:43:17.817841 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:17.817809 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-196.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 20:43:17.820685 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:17.820663 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 20:43:17.822396 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.822375 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 20:43:17.822500 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.822400 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 20:43:17.822500 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:17.822468 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-196.ec2.internal\" not found" Jun 03 20:43:17.823070 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.823051 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 20:43:17.823070 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.823072 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 20:43:17.823218 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.823054 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 20:43:17.823218 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.823216 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 03 20:43:17.823319 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.823224 2577 reconciler.go:29] "Reconciler: start to sync state" Jun 03 20:43:17.823477 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.823460 2577 factory.go:153] Registering CRI-O factory Jun 03 20:43:17.823550 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.823481 2577 factory.go:223] Registration of the crio container factory successfully Jun 03 20:43:17.823550 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.823533 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 20:43:17.823550 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.823542 2577 factory.go:55] Registering systemd factory Jun 03 20:43:17.823550 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.823549 2577 factory.go:223] Registration of the systemd container factory successfully Jun 03 20:43:17.823741 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.823571 2577 factory.go:103] Registering Raw factory Jun 03 20:43:17.823741 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.823585 2577 manager.go:1196] Started watching for new ooms in manager Jun 03 20:43:17.824511 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.824493 2577 manager.go:349] Starting recovery of all containers Jun 03 20:43:17.824843 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:17.823613 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-196.ec2.internal.18b5acf56e506408 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-196.ec2.internal,UID:ip-10-0-128-196.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-196.ec2.internal,},FirstTimestamp:2026-06-03 20:43:17.81262644 +0000 UTC m=+0.413853598,LastTimestamp:2026-06-03 20:43:17.81262644 +0000 UTC m=+0.413853598,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-196.ec2.internal,}" Jun 03 20:43:17.828133 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:17.828103 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 20:43:17.828223 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:17.828159 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-196.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 20:43:17.830164 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.830126 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 20:43:17.833059 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.833040 2577 manager.go:354] Recovery completed Jun 03 20:43:17.837635 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.837620 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:17.839469 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.839446 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:17.839530 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.839486 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:17.839530 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.839498 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:17.840020 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.840009 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 20:43:17.840020 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.840016 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:17.840089 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.840019 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 20:43:17.840089 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.840084 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 03 20:43:17.840801 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.840784 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l4rsg" Jun 03 20:43:17.840925 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.840912 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:17.840972 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.840938 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:17.840972 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.840951 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:17.841312 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.841302 2577 policy_none.go:49] "None policy: Start" Jun 03 20:43:17.841358 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.841317 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 20:43:17.841358 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.841327 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 20:43:17.841621 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:17.841547 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-196.ec2.internal.18b5acf56fe9fb28 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-196.ec2.internal,UID:ip-10-0-128-196.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-196.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-196.ec2.internal,},FirstTimestamp:2026-06-03 20:43:17.839469352 +0000 UTC m=+0.440696324,LastTimestamp:2026-06-03 20:43:17.839469352 +0000 UTC m=+0.440696324,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-196.ec2.internal,}" Jun 03 20:43:17.842558 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.842535 2577 policy_none.go:47] "Start" Jun 03 20:43:17.848374 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.848334 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l4rsg" Jun 03 20:43:17.851706 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:17.851630 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-196.ec2.internal.18b5acf56fea51f7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-196.ec2.internal,UID:ip-10-0-128-196.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-196.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-196.ec2.internal,},FirstTimestamp:2026-06-03 20:43:17.839491575 +0000 UTC m=+0.440718546,LastTimestamp:2026-06-03 20:43:17.839491575 +0000 UTC m=+0.440718546,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-196.ec2.internal,}" Jun 03 20:43:17.879033 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.879016 2577 manager.go:337] "Starting Device Plugin manager" Jun 03 20:43:17.891638 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:17.879110 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 20:43:17.891638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.879126 2577 server.go:87] "Starting device plugin registration server" Jun 03 20:43:17.891638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.879414 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 20:43:17.891638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.879430 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 20:43:17.891638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.879521 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 20:43:17.891638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.879589 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 20:43:17.891638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.879595 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 20:43:17.891638 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:17.880410 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 20:43:17.891638 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:17.880455 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-196.ec2.internal\" not found" Jun 03 20:43:17.891638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.887990 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 20:43:17.891638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.888024 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 20:43:17.891638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.888045 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 20:43:17.891638 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:17.888123 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 20:43:17.891638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.889667 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:17.979889 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.979853 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:17.980858 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.980843 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:17.980927 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.980875 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:17.980927 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.980891 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:17.980927 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.980919 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-196.ec2.internal" Jun 03 20:43:17.988897 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.988847 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-196.ec2.internal"] Jun 03 20:43:17.988968 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.988919 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:17.989860 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.989846 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-196.ec2.internal" Jun 03 20:43:17.989899 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:17.989868 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-196.ec2.internal\": node \"ip-10-0-128-196.ec2.internal\" not found" Jun 03 20:43:17.990589 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.990576 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:17.990655 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.990602 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:17.990655 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.990614 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:17.992031 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.992002 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:17.992118 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.992104 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal" Jun 03 20:43:17.992163 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.992144 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:17.992716 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.992694 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:17.992818 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.992725 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:17.992818 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.992736 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:17.992818 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.992740 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:17.992818 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.992756 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:17.992818 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.992770 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:17.994105 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.994091 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-196.ec2.internal" Jun 03 20:43:17.994156 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.994117 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 20:43:17.994966 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.994951 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasSufficientMemory" Jun 03 20:43:17.995039 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.994982 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 20:43:17.995039 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:17.994996 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeHasSufficientPID" Jun 03 20:43:18.014167 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:18.014146 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-196.ec2.internal\" not found" Jun 03 20:43:18.020007 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:18.019989 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-196.ec2.internal\" not found" node="ip-10-0-128-196.ec2.internal" Jun 03 20:43:18.024533 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.024508 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/717d1a917b1152c89902cbfaf6731cd2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal\" (UID: \"717d1a917b1152c89902cbfaf6731cd2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal" Jun 03 20:43:18.024618 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.024534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/717d1a917b1152c89902cbfaf6731cd2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal\" (UID: \"717d1a917b1152c89902cbfaf6731cd2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal" Jun 03 20:43:18.024618 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.024552 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1dca1cb65a4fa78fa52bf28f0a56768c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-196.ec2.internal\" (UID: \"1dca1cb65a4fa78fa52bf28f0a56768c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-196.ec2.internal" Jun 03 20:43:18.024618 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:18.024556 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-196.ec2.internal\" not found" node="ip-10-0-128-196.ec2.internal" Jun 03 20:43:18.115203 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:18.115172 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-196.ec2.internal\" not found" Jun 03 20:43:18.125540 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.125510 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/717d1a917b1152c89902cbfaf6731cd2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal\" (UID: \"717d1a917b1152c89902cbfaf6731cd2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal" Jun 03 20:43:18.125619 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.125544 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1dca1cb65a4fa78fa52bf28f0a56768c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-196.ec2.internal\" (UID: \"1dca1cb65a4fa78fa52bf28f0a56768c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-196.ec2.internal" Jun 03 20:43:18.125619 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.125563 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/717d1a917b1152c89902cbfaf6731cd2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal\" (UID: \"717d1a917b1152c89902cbfaf6731cd2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal" Jun 03 20:43:18.125619 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.125613 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1dca1cb65a4fa78fa52bf28f0a56768c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-196.ec2.internal\" (UID: \"1dca1cb65a4fa78fa52bf28f0a56768c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-196.ec2.internal" Jun 03 20:43:18.125720 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.125620 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/717d1a917b1152c89902cbfaf6731cd2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal\" (UID: \"717d1a917b1152c89902cbfaf6731cd2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal" Jun 03 20:43:18.125720 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.125671 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/717d1a917b1152c89902cbfaf6731cd2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal\" (UID: \"717d1a917b1152c89902cbfaf6731cd2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal" Jun 03 20:43:18.215729 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:18.215698 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-196.ec2.internal\" not found" Jun 03 20:43:18.316609 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:18.316544 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-196.ec2.internal\" not found" Jun 03 20:43:18.322720 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.322699 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal" Jun 03 20:43:18.328397 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.328375 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-196.ec2.internal" Jun 03 20:43:18.417407 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:18.417370 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-196.ec2.internal\" not found" Jun 03 20:43:18.517873 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:18.517840 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-196.ec2.internal\" not found" Jun 03 20:43:18.618482 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:18.618404 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-196.ec2.internal\" not found" Jun 03 20:43:18.718996 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:18.718964 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-196.ec2.internal\" not found" Jun 03 20:43:18.723557 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.723532 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:18.764666 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.764629 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 20:43:18.765448 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.764844 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 20:43:18.765448 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.764853 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 20:43:18.802948 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.802914 2577 apiserver.go:52] "Watching apiserver" Jun 03 20:43:18.820607 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.820586 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 20:43:18.820957 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.820938 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-vfvrg","kube-system/konnectivity-agent-nklxt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh","openshift-cluster-node-tuning-operator/tuned-vf2st","openshift-dns/node-resolver-5f2ll","openshift-multus/multus-additional-cni-plugins-v5gsw","openshift-multus/network-metrics-daemon-wl8bs","openshift-network-diagnostics/network-check-target-hvn4f","kube-system/global-pull-secret-syncer-nz55h","openshift-image-registry/node-ca-qmq99","openshift-multus/multus-b5szz","openshift-network-operator/iptables-alerter-wldmp"] Jun 03 20:43:18.822634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.822609 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-196.ec2.internal" Jun 03 20:43:18.822757 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.822643 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 20:43:18.823230 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.823213 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.825369 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.824992 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nklxt" Jun 03 20:43:18.827968 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.825531 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 20:43:18.827968 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.827116 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 20:43:18.827968 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.827202 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 20:43:18.827968 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.827296 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 20:43:18.827968 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.827307 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 20:43:18.827968 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.827605 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 20:43:18.827968 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.827719 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:18.827968 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.827789 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 20:43:18.827968 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.827818 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 20:43:18.828422 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.828074 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ggq4d\"" Jun 03 20:43:18.828767 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.828746 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rgck\" (UniqueName: \"kubernetes.io/projected/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-kube-api-access-6rgck\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.828867 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.828778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c7e040c2-067d-4275-96b9-1ef76faa94da-agent-certs\") pod \"konnectivity-agent-nklxt\" (UID: \"c7e040c2-067d-4275-96b9-1ef76faa94da\") " pod="kube-system/konnectivity-agent-nklxt" Jun 03 20:43:18.828867 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.828801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c7e040c2-067d-4275-96b9-1ef76faa94da-konnectivity-ca\") pod \"konnectivity-agent-nklxt\" (UID: \"c7e040c2-067d-4275-96b9-1ef76faa94da\") " pod="kube-system/konnectivity-agent-nklxt" Jun 03 20:43:18.828867 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.828826 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-kubelet\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.828867 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.828852 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-systemd-units\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829068 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.828872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-run-netns\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829068 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.828890 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9j6ks\"" Jun 03 20:43:18.829068 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.828893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-run-systemd\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829068 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.828950 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-etc-openvswitch\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829068 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.828989 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-run-openvswitch\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829068 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.829018 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-run-ovn-kubernetes\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829068 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.829045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-slash\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829410 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.829081 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-var-lib-openvswitch\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829410 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.829099 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-run-ovn\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829410 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.829118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-cni-netd\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829410 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.829139 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-ovnkube-config\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829410 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.829161 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-env-overrides\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829410 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.829177 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-ovnkube-script-lib\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829410 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.829191 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-node-log\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829410 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.829204 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-cni-bin\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829410 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.829270 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-ovn-node-metrics-cert\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829410 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.829286 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-log-socket\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829410 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.829300 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.829920 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.829463 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:18.830839 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.830819 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5f2ll" Jun 03 20:43:18.831454 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.831439 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 20:43:18.831524 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.831441 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 20:43:18.832114 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.832096 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:18.832576 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.832553 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2jgl4\"" Jun 03 20:43:18.832656 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.832628 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 20:43:18.832861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.832846 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 20:43:18.833055 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.833041 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 20:43:18.833127 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.833113 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wwzjz\"" Jun 03 20:43:18.833364 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.833332 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 20:43:18.833416 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.833390 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:43:18.833416 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.833406 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:18.833492 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.833409 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 20:43:18.833492 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:18.833461 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:43:18.833566 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.833516 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal" Jun 03 20:43:18.834749 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.834734 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:18.834835 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.834763 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 20:43:18.834893 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:18.834839 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:18.834964 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.834951 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2k7cc\"" Jun 03 20:43:18.835688 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.835673 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 20:43:18.835688 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.835679 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-crk9d\"" Jun 03 20:43:18.835827 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.835756 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 20:43:18.835827 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.835808 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 20:43:18.835926 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.835842 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 20:43:18.836010 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.835991 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:18.836074 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:18.836058 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz55h" podUID="78164361-9b18-423d-83eb-e2ddbaa78edd" Jun 03 20:43:18.837154 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.837137 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 20:43:18.837328 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.837314 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qmq99" Jun 03 20:43:18.838485 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.838468 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.839647 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.839622 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 20:43:18.839647 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.839623 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nnm7m\"" Jun 03 20:43:18.839795 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:18.839667 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717d1a917b1152c89902cbfaf6731cd2.slice/crio-3bf046b0eeae1bd8e56a575e93123e698ef00fd6504934835f7e9312d352fba6 WatchSource:0}: Error finding container 3bf046b0eeae1bd8e56a575e93123e698ef00fd6504934835f7e9312d352fba6: Status 404 returned error can't find the container with id 3bf046b0eeae1bd8e56a575e93123e698ef00fd6504934835f7e9312d352fba6 Jun 03 20:43:18.839795 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.839744 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-196.ec2.internal"] Jun 03 20:43:18.839898 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.839825 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wldmp" Jun 03 20:43:18.840213 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:18.840019 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dca1cb65a4fa78fa52bf28f0a56768c.slice/crio-145572a74151739fd3b8354c51fc6c488dc2ec11ac20ffc582165039417e427d WatchSource:0}: Error finding container 145572a74151739fd3b8354c51fc6c488dc2ec11ac20ffc582165039417e427d: Status 404 returned error can't find the container with id 145572a74151739fd3b8354c51fc6c488dc2ec11ac20ffc582165039417e427d Jun 03 20:43:18.840213 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.840119 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 20:43:18.840213 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.840127 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 20:43:18.840672 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.840654 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qckfb\"" Jun 03 20:43:18.840765 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.840657 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 20:43:18.842432 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.842413 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hgmjt\"" Jun 03 20:43:18.842534 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.842434 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 20:43:18.842603 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.842543 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:43:18.842603 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.842565 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 20:43:18.847946 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.847932 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:43:18.850923 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.850836 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 20:38:17 +0000 UTC" deadline="2028-02-25 14:26:37.91260177 +0000 UTC" Jun 03 20:43:18.850923 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.850856 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15161h43m19.061748151s" Jun 03 20:43:18.852922 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.852903 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal"] Jun 03 20:43:18.853188 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.853171 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 20:43:18.867319 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.867300 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rmhqt" Jun 03 20:43:18.877809 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.877790 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rmhqt" Jun 03 20:43:18.891668 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.891629 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-196.ec2.internal" event={"ID":"1dca1cb65a4fa78fa52bf28f0a56768c","Type":"ContainerStarted","Data":"145572a74151739fd3b8354c51fc6c488dc2ec11ac20ffc582165039417e427d"} Jun 03 20:43:18.892691 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.892664 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal" event={"ID":"717d1a917b1152c89902cbfaf6731cd2","Type":"ContainerStarted","Data":"3bf046b0eeae1bd8e56a575e93123e698ef00fd6504934835f7e9312d352fba6"} Jun 03 20:43:18.924959 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.924787 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 20:43:18.930308 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930285 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxbc8\" (UniqueName: \"kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8\") pod \"network-check-target-hvn4f\" (UID: \"31affeb8-aa2a-40de-b080-cd2c0168abfb\") " pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:18.930395 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930318 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret\") pod \"global-pull-secret-syncer-nz55h\" (UID: \"78164361-9b18-423d-83eb-e2ddbaa78edd\") " pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:18.930395 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-kubelet\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.930395 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-run-systemd\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.930395 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930395 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-env-overrides\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.930572 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930409 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-ovnkube-script-lib\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.930572 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l22q5\" (UniqueName: \"kubernetes.io/projected/3a9244b8-54da-477d-8860-1161ace67c83-kube-api-access-l22q5\") pod \"node-ca-qmq99\" (UID: \"3a9244b8-54da-477d-8860-1161ace67c83\") " pod="openshift-image-registry/node-ca-qmq99" Jun 03 20:43:18.930572 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930428 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-kubelet\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.930572 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930438 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs\") pod \"network-metrics-daemon-wl8bs\" (UID: \"5c12c87b-72ec-41be-8add-0584a341a706\") " pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:18.930572 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-multus-conf-dir\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.930572 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-ovnkube-config\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.930572 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930566 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c21c159-d406-48b0-badc-260eb9f84e99-tmp\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:18.930813 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930591 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/209cb1df-687a-4601-b73c-a0dd2e1240c9-host-slash\") pod \"iptables-alerter-wldmp\" (UID: \"209cb1df-687a-4601-b73c-a0dd2e1240c9\") " pod="openshift-network-operator/iptables-alerter-wldmp" Jun 03 20:43:18.930813 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930606 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-run-systemd\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.930813 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930618 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-cni-bin\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.930813 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930654 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-cni-bin\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.930813 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930657 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-kubernetes\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:18.930813 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930685 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-sysctl-d\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:18.930813 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930707 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-var-lib-kubelet\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:18.930813 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78164361-9b18-423d-83eb-e2ddbaa78edd-dbus\") pod \"global-pull-secret-syncer-nz55h\" (UID: \"78164361-9b18-423d-83eb-e2ddbaa78edd\") " pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:18.930813 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930763 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-var-lib-kubelet\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.931060 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930813 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqc42\" (UniqueName: \"kubernetes.io/projected/209cb1df-687a-4601-b73c-a0dd2e1240c9-kube-api-access-dqc42\") pod \"iptables-alerter-wldmp\" (UID: \"209cb1df-687a-4601-b73c-a0dd2e1240c9\") " pod="openshift-network-operator/iptables-alerter-wldmp" Jun 03 20:43:18.931060 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.931060 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930883 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-run-multus-certs\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.931060 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930908 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-run-netns\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.931060 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930918 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.931060 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930929 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-env-overrides\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.931060 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930951 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-run-netns\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.931060 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930934 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-run-openvswitch\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.931060 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930970 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-run-openvswitch\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.931060 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.930985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-run-ovn-kubernetes\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.931060 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931014 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-sys-fs\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:18.931060 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931039 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-run-ovn-kubernetes\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.931060 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931030 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7868b106-9752-43d7-bb61-85e9a8fe78f1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:18.931634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931066 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-var-lib-openvswitch\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.931634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931080 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-ovnkube-script-lib\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.931634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931083 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-run-ovn\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.931634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931105 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-run-ovn\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.931634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931115 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-cni-netd\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.931634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-systemd\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:18.931634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931140 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-var-lib-openvswitch\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.931634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931153 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7868b106-9752-43d7-bb61-85e9a8fe78f1-cnibin\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:18.931634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931157 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-cni-netd\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.931634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931176 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-run-netns\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.931634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931204 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-var-lib-cni-multus\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.931634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931234 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-ovn-node-metrics-cert\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.931634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931254 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-sysctl-conf\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:18.931634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931272 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-multus-cni-dir\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.931634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931285 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-cnibin\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.931634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e0215a1-6ccb-4f35-96dd-68369940f908-cni-binary-copy\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.931634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931321 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c21c159-d406-48b0-badc-260eb9f84e99-etc-tuned\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:18.932237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931355 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7868b106-9752-43d7-bb61-85e9a8fe78f1-cni-binary-copy\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:18.932237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931381 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx7dn\" (UniqueName: \"kubernetes.io/projected/5c12c87b-72ec-41be-8add-0584a341a706-kube-api-access-rx7dn\") pod \"network-metrics-daemon-wl8bs\" (UID: \"5c12c87b-72ec-41be-8add-0584a341a706\") " pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:18.932237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-system-cni-dir\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.932237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931411 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-run-k8s-cni-cncf-io\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.932237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931425 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/209cb1df-687a-4601-b73c-a0dd2e1240c9-iptables-alerter-script\") pod \"iptables-alerter-wldmp\" (UID: \"209cb1df-687a-4601-b73c-a0dd2e1240c9\") " pod="openshift-network-operator/iptables-alerter-wldmp" Jun 03 20:43:18.932237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931442 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-etc-openvswitch\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.932237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931455 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7868b106-9752-43d7-bb61-85e9a8fe78f1-os-release\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:18.932237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931488 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-etc-openvswitch\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.932237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931522 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-var-lib-cni-bin\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.932237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931535 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 20:43:18.932237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwdqv\" (UniqueName: \"kubernetes.io/projected/3e0215a1-6ccb-4f35-96dd-68369940f908-kube-api-access-pwdqv\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.932237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931574 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-slash\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.932237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931610 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-device-dir\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:18.932237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931619 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-host-slash\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.932237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931646 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:18.932237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931672 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/704afad7-2929-409b-a7ed-c877c45839ec-tmp-dir\") pod \"node-resolver-5f2ll\" (UID: \"704afad7-2929-409b-a7ed-c877c45839ec\") " pod="openshift-dns/node-resolver-5f2ll" Jun 03 20:43:18.932237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931697 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-node-log\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.932873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsc9f\" (UniqueName: \"kubernetes.io/projected/9c21c159-d406-48b0-badc-260eb9f84e99-kube-api-access-jsc9f\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:18.932873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931742 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/704afad7-2929-409b-a7ed-c877c45839ec-hosts-file\") pod \"node-resolver-5f2ll\" (UID: \"704afad7-2929-409b-a7ed-c877c45839ec\") " pod="openshift-dns/node-resolver-5f2ll" Jun 03 20:43:18.932873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931746 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-node-log\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.932873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931772 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7868b106-9752-43d7-bb61-85e9a8fe78f1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:18.932873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931787 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-os-release\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.932873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-multus-socket-dir-parent\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.932873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931800 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-ovnkube-config\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.932873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931816 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:18.932873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931832 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a9244b8-54da-477d-8860-1161ace67c83-serviceca\") pod \"node-ca-qmq99\" (UID: \"3a9244b8-54da-477d-8860-1161ace67c83\") " pod="openshift-image-registry/node-ca-qmq99" Jun 03 20:43:18.932873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5jdc\" (UniqueName: \"kubernetes.io/projected/7868b106-9752-43d7-bb61-85e9a8fe78f1-kube-api-access-k5jdc\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:18.932873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931903 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-hostroot\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.932873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931926 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3e0215a1-6ccb-4f35-96dd-68369940f908-multus-daemon-config\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.932873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931946 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-etc-kubernetes\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:18.932873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931966 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-systemd-units\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.932873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.931981 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c7e040c2-067d-4275-96b9-1ef76faa94da-agent-certs\") pod \"konnectivity-agent-nklxt\" (UID: \"c7e040c2-067d-4275-96b9-1ef76faa94da\") " pod="kube-system/konnectivity-agent-nklxt" Jun 03 20:43:18.932873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-run\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:18.932873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932022 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-systemd-units\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.933335 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78164361-9b18-423d-83eb-e2ddbaa78edd-kubelet-config\") pod \"global-pull-secret-syncer-nz55h\" (UID: \"78164361-9b18-423d-83eb-e2ddbaa78edd\") " pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:18.933335 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932058 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-socket-dir\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:18.933335 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932086 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wznzd\" (UniqueName: \"kubernetes.io/projected/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-kube-api-access-wznzd\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:18.933335 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932100 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-sysconfig\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:18.933335 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932131 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-lib-modules\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:18.933335 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932152 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a9244b8-54da-477d-8860-1161ace67c83-host\") pod \"node-ca-qmq99\" (UID: \"3a9244b8-54da-477d-8860-1161ace67c83\") " pod="openshift-image-registry/node-ca-qmq99" Jun 03 20:43:18.933335 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932167 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7868b106-9752-43d7-bb61-85e9a8fe78f1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:18.933335 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-sys\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:18.933335 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-host\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:18.933335 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932218 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g76zd\" (UniqueName: \"kubernetes.io/projected/704afad7-2929-409b-a7ed-c877c45839ec-kube-api-access-g76zd\") pod \"node-resolver-5f2ll\" (UID: \"704afad7-2929-409b-a7ed-c877c45839ec\") " pod="openshift-dns/node-resolver-5f2ll" Jun 03 20:43:18.933335 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932265 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7868b106-9752-43d7-bb61-85e9a8fe78f1-system-cni-dir\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:18.933335 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932332 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-log-socket\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.933335 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932310 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-log-socket\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.933335 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rgck\" (UniqueName: \"kubernetes.io/projected/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-kube-api-access-6rgck\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.933335 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932419 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c7e040c2-067d-4275-96b9-1ef76faa94da-konnectivity-ca\") pod \"konnectivity-agent-nklxt\" (UID: \"c7e040c2-067d-4275-96b9-1ef76faa94da\") " pod="kube-system/konnectivity-agent-nklxt" Jun 03 20:43:18.933335 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-registration-dir\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:18.933796 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932498 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-modprobe-d\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:18.933796 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.932883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c7e040c2-067d-4275-96b9-1ef76faa94da-konnectivity-ca\") pod \"konnectivity-agent-nklxt\" (UID: \"c7e040c2-067d-4275-96b9-1ef76faa94da\") " pod="kube-system/konnectivity-agent-nklxt" Jun 03 20:43:18.934493 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.934473 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-ovn-node-metrics-cert\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:18.934586 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.934572 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c7e040c2-067d-4275-96b9-1ef76faa94da-agent-certs\") pod \"konnectivity-agent-nklxt\" (UID: \"c7e040c2-067d-4275-96b9-1ef76faa94da\") " pod="kube-system/konnectivity-agent-nklxt" Jun 03 20:43:18.941752 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:18.941730 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rgck\" (UniqueName: \"kubernetes.io/projected/3686395b-19a4-4c36-b5ee-fdb263bc7a1d-kube-api-access-6rgck\") pod \"ovnkube-node-vfvrg\" (UID: \"3686395b-19a4-4c36-b5ee-fdb263bc7a1d\") " pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:19.029385 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.029354 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:19.033722 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.033700 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c21c159-d406-48b0-badc-260eb9f84e99-etc-tuned\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.033778 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.033734 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7868b106-9752-43d7-bb61-85e9a8fe78f1-cni-binary-copy\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:19.033778 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.033754 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx7dn\" (UniqueName: \"kubernetes.io/projected/5c12c87b-72ec-41be-8add-0584a341a706-kube-api-access-rx7dn\") pod \"network-metrics-daemon-wl8bs\" (UID: \"5c12c87b-72ec-41be-8add-0584a341a706\") " pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:19.033887 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.033777 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-system-cni-dir\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.033887 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.033800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-run-k8s-cni-cncf-io\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.033887 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.033825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/209cb1df-687a-4601-b73c-a0dd2e1240c9-iptables-alerter-script\") pod \"iptables-alerter-wldmp\" (UID: \"209cb1df-687a-4601-b73c-a0dd2e1240c9\") " pod="openshift-network-operator/iptables-alerter-wldmp" Jun 03 20:43:19.033887 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.033874 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-run-k8s-cni-cncf-io\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.034071 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.033877 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-system-cni-dir\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.034071 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.033906 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7868b106-9752-43d7-bb61-85e9a8fe78f1-os-release\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:19.034071 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.033938 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-var-lib-cni-bin\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.034071 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.033971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwdqv\" (UniqueName: \"kubernetes.io/projected/3e0215a1-6ccb-4f35-96dd-68369940f908-kube-api-access-pwdqv\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.034071 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.033969 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7868b106-9752-43d7-bb61-85e9a8fe78f1-os-release\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:19.034071 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034018 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-var-lib-cni-bin\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.034071 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-device-dir\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:19.034478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034097 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:19.034478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/704afad7-2929-409b-a7ed-c877c45839ec-tmp-dir\") pod \"node-resolver-5f2ll\" (UID: \"704afad7-2929-409b-a7ed-c877c45839ec\") " pod="openshift-dns/node-resolver-5f2ll" Jun 03 20:43:19.034478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsc9f\" (UniqueName: \"kubernetes.io/projected/9c21c159-d406-48b0-badc-260eb9f84e99-kube-api-access-jsc9f\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.034478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034158 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-device-dir\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:19.034478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034177 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/704afad7-2929-409b-a7ed-c877c45839ec-hosts-file\") pod \"node-resolver-5f2ll\" (UID: \"704afad7-2929-409b-a7ed-c877c45839ec\") " pod="openshift-dns/node-resolver-5f2ll" Jun 03 20:43:19.034478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034201 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7868b106-9752-43d7-bb61-85e9a8fe78f1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:19.034478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034201 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:19.034478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034253 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/704afad7-2929-409b-a7ed-c877c45839ec-hosts-file\") pod \"node-resolver-5f2ll\" (UID: \"704afad7-2929-409b-a7ed-c877c45839ec\") " pod="openshift-dns/node-resolver-5f2ll" Jun 03 20:43:19.034478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034294 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-os-release\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.034478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034321 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-multus-socket-dir-parent\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.034478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:19.034478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a9244b8-54da-477d-8860-1161ace67c83-serviceca\") pod \"node-ca-qmq99\" (UID: \"3a9244b8-54da-477d-8860-1161ace67c83\") " pod="openshift-image-registry/node-ca-qmq99" Jun 03 20:43:19.034478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5jdc\" (UniqueName: \"kubernetes.io/projected/7868b106-9752-43d7-bb61-85e9a8fe78f1-kube-api-access-k5jdc\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:19.034478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034458 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/209cb1df-687a-4601-b73c-a0dd2e1240c9-iptables-alerter-script\") pod \"iptables-alerter-wldmp\" (UID: \"209cb1df-687a-4601-b73c-a0dd2e1240c9\") " pod="openshift-network-operator/iptables-alerter-wldmp" Jun 03 20:43:19.034478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034476 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/704afad7-2929-409b-a7ed-c877c45839ec-tmp-dir\") pod \"node-resolver-5f2ll\" (UID: \"704afad7-2929-409b-a7ed-c877c45839ec\") " pod="openshift-dns/node-resolver-5f2ll" Jun 03 20:43:19.034478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034483 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-multus-socket-dir-parent\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034486 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-os-release\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034511 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-hostroot\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034537 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3e0215a1-6ccb-4f35-96dd-68369940f908-multus-daemon-config\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034560 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-etc-kubernetes\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034495 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7868b106-9752-43d7-bb61-85e9a8fe78f1-cni-binary-copy\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034586 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-run\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78164361-9b18-423d-83eb-e2ddbaa78edd-kubelet-config\") pod \"global-pull-secret-syncer-nz55h\" (UID: \"78164361-9b18-423d-83eb-e2ddbaa78edd\") " pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-socket-dir\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034651 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-etc-kubernetes\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034664 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7868b106-9752-43d7-bb61-85e9a8fe78f1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wznzd\" (UniqueName: \"kubernetes.io/projected/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-kube-api-access-wznzd\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034706 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-sysconfig\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034708 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-hostroot\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034729 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78164361-9b18-423d-83eb-e2ddbaa78edd-kubelet-config\") pod \"global-pull-secret-syncer-nz55h\" (UID: \"78164361-9b18-423d-83eb-e2ddbaa78edd\") " pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034761 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034775 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-sysconfig\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034788 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-lib-modules\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.035170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034851 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-run\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.035825 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034855 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-socket-dir\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:19.035825 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a9244b8-54da-477d-8860-1161ace67c83-host\") pod \"node-ca-qmq99\" (UID: \"3a9244b8-54da-477d-8860-1161ace67c83\") " pod="openshift-image-registry/node-ca-qmq99" Jun 03 20:43:19.035825 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7868b106-9752-43d7-bb61-85e9a8fe78f1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:19.035825 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034956 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-lib-modules\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.035825 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034959 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a9244b8-54da-477d-8860-1161ace67c83-host\") pod \"node-ca-qmq99\" (UID: \"3a9244b8-54da-477d-8860-1161ace67c83\") " pod="openshift-image-registry/node-ca-qmq99" Jun 03 20:43:19.035825 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034969 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a9244b8-54da-477d-8860-1161ace67c83-serviceca\") pod \"node-ca-qmq99\" (UID: \"3a9244b8-54da-477d-8860-1161ace67c83\") " pod="openshift-image-registry/node-ca-qmq99" Jun 03 20:43:19.035825 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.034986 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-sys\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.035825 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-host\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.035825 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035065 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-sys\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.035825 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035092 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g76zd\" (UniqueName: \"kubernetes.io/projected/704afad7-2929-409b-a7ed-c877c45839ec-kube-api-access-g76zd\") pod \"node-resolver-5f2ll\" (UID: \"704afad7-2929-409b-a7ed-c877c45839ec\") " pod="openshift-dns/node-resolver-5f2ll" Jun 03 20:43:19.035825 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035106 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7868b106-9752-43d7-bb61-85e9a8fe78f1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:19.035825 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035111 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-host\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.035825 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035135 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7868b106-9752-43d7-bb61-85e9a8fe78f1-system-cni-dir\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:19.035825 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035131 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3e0215a1-6ccb-4f35-96dd-68369940f908-multus-daemon-config\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.035825 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035201 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-registration-dir\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:19.035825 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035208 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7868b106-9752-43d7-bb61-85e9a8fe78f1-system-cni-dir\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:19.035825 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-modprobe-d\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.036581 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035258 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxbc8\" (UniqueName: \"kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8\") pod \"network-check-target-hvn4f\" (UID: \"31affeb8-aa2a-40de-b080-cd2c0168abfb\") " pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:19.036581 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035260 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-registration-dir\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:19.036581 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035293 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret\") pod \"global-pull-secret-syncer-nz55h\" (UID: \"78164361-9b18-423d-83eb-e2ddbaa78edd\") " pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:19.036581 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035379 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-modprobe-d\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.036581 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035382 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l22q5\" (UniqueName: \"kubernetes.io/projected/3a9244b8-54da-477d-8860-1161ace67c83-kube-api-access-l22q5\") pod \"node-ca-qmq99\" (UID: \"3a9244b8-54da-477d-8860-1161ace67c83\") " pod="openshift-image-registry/node-ca-qmq99" Jun 03 20:43:19.036581 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035428 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs\") pod \"network-metrics-daemon-wl8bs\" (UID: \"5c12c87b-72ec-41be-8add-0584a341a706\") " pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:19.036581 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035452 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-multus-conf-dir\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.036581 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035476 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c21c159-d406-48b0-badc-260eb9f84e99-tmp\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.036581 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:19.035382 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:19.036581 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/209cb1df-687a-4601-b73c-a0dd2e1240c9-host-slash\") pod \"iptables-alerter-wldmp\" (UID: \"209cb1df-687a-4601-b73c-a0dd2e1240c9\") " pod="openshift-network-operator/iptables-alerter-wldmp" Jun 03 20:43:19.036581 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035526 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-kubernetes\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.036581 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035527 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-multus-conf-dir\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.036581 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:19.035479 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:19.036581 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:19.035574 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret podName:78164361-9b18-423d-83eb-e2ddbaa78edd nodeName:}" failed. No retries permitted until 2026-06-03 20:43:19.535538519 +0000 UTC m=+2.136765498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret") pod "global-pull-secret-syncer-nz55h" (UID: "78164361-9b18-423d-83eb-e2ddbaa78edd") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:19.036581 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035583 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/209cb1df-687a-4601-b73c-a0dd2e1240c9-host-slash\") pod \"iptables-alerter-wldmp\" (UID: \"209cb1df-687a-4601-b73c-a0dd2e1240c9\") " pod="openshift-network-operator/iptables-alerter-wldmp" Jun 03 20:43:19.036581 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-sysctl-d\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.036581 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035608 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-kubernetes\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.037051 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:19.035638 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs podName:5c12c87b-72ec-41be-8add-0584a341a706 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:19.535606577 +0000 UTC m=+2.136833553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs") pod "network-metrics-daemon-wl8bs" (UID: "5c12c87b-72ec-41be-8add-0584a341a706") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:19.037051 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-var-lib-kubelet\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.037051 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78164361-9b18-423d-83eb-e2ddbaa78edd-dbus\") pod \"global-pull-secret-syncer-nz55h\" (UID: \"78164361-9b18-423d-83eb-e2ddbaa78edd\") " pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:19.037051 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035724 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-sysctl-d\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.037051 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035732 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-var-lib-kubelet\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.037051 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035726 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-var-lib-kubelet\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.037051 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035773 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-var-lib-kubelet\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.037051 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035774 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78164361-9b18-423d-83eb-e2ddbaa78edd-dbus\") pod \"global-pull-secret-syncer-nz55h\" (UID: \"78164361-9b18-423d-83eb-e2ddbaa78edd\") " pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:19.037051 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqc42\" (UniqueName: \"kubernetes.io/projected/209cb1df-687a-4601-b73c-a0dd2e1240c9-kube-api-access-dqc42\") pod \"iptables-alerter-wldmp\" (UID: \"209cb1df-687a-4601-b73c-a0dd2e1240c9\") " pod="openshift-network-operator/iptables-alerter-wldmp" Jun 03 20:43:19.037051 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035822 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-run-multus-certs\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.037051 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035849 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-sys-fs\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:19.037051 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035875 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-run-multus-certs\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.037051 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035874 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7868b106-9752-43d7-bb61-85e9a8fe78f1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:19.037051 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035913 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-systemd\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.037051 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035918 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-sys-fs\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:19.037051 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7868b106-9752-43d7-bb61-85e9a8fe78f1-cnibin\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:19.037051 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035945 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-run-netns\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.037558 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035980 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-run-netns\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.037558 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035983 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-systemd\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.037558 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.035987 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7868b106-9752-43d7-bb61-85e9a8fe78f1-cnibin\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:19.037558 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.036021 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-var-lib-cni-multus\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.037558 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.036051 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-sysctl-conf\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.037558 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.036071 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-host-var-lib-cni-multus\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.037558 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.036074 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-multus-cni-dir\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.037558 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.036102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-cnibin\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.037558 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.036126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e0215a1-6ccb-4f35-96dd-68369940f908-cni-binary-copy\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.037558 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.036126 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-multus-cni-dir\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.037558 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.036179 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e0215a1-6ccb-4f35-96dd-68369940f908-cnibin\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.037558 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.036226 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c21c159-d406-48b0-badc-260eb9f84e99-etc-sysctl-conf\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.037558 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.036403 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7868b106-9752-43d7-bb61-85e9a8fe78f1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:19.037558 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.036514 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c21c159-d406-48b0-badc-260eb9f84e99-etc-tuned\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.037558 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.036631 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e0215a1-6ccb-4f35-96dd-68369940f908-cni-binary-copy\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.037558 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.037461 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c21c159-d406-48b0-badc-260eb9f84e99-tmp\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.044663 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:19.044641 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:19.044663 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:19.044660 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:19.044834 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:19.044669 2577 projected.go:196] Error preparing data for projected volume kube-api-access-kxbc8 for pod openshift-network-diagnostics/network-check-target-hvn4f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:19.044834 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:19.044720 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8 podName:31affeb8-aa2a-40de-b080-cd2c0168abfb nodeName:}" failed. No retries permitted until 2026-06-03 20:43:19.544705612 +0000 UTC m=+2.145932584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kxbc8" (UniqueName: "kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8") pod "network-check-target-hvn4f" (UID: "31affeb8-aa2a-40de-b080-cd2c0168abfb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:19.045447 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.045415 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwdqv\" (UniqueName: \"kubernetes.io/projected/3e0215a1-6ccb-4f35-96dd-68369940f908-kube-api-access-pwdqv\") pod \"multus-b5szz\" (UID: \"3e0215a1-6ccb-4f35-96dd-68369940f908\") " pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.046966 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.046941 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqc42\" (UniqueName: \"kubernetes.io/projected/209cb1df-687a-4601-b73c-a0dd2e1240c9-kube-api-access-dqc42\") pod \"iptables-alerter-wldmp\" (UID: \"209cb1df-687a-4601-b73c-a0dd2e1240c9\") " pod="openshift-network-operator/iptables-alerter-wldmp" Jun 03 20:43:19.047308 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.047286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx7dn\" (UniqueName: \"kubernetes.io/projected/5c12c87b-72ec-41be-8add-0584a341a706-kube-api-access-rx7dn\") pod \"network-metrics-daemon-wl8bs\" (UID: \"5c12c87b-72ec-41be-8add-0584a341a706\") " pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:19.047446 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.047437 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g76zd\" (UniqueName: \"kubernetes.io/projected/704afad7-2929-409b-a7ed-c877c45839ec-kube-api-access-g76zd\") pod \"node-resolver-5f2ll\" (UID: \"704afad7-2929-409b-a7ed-c877c45839ec\") " pod="openshift-dns/node-resolver-5f2ll" Jun 03 20:43:19.047649 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.047627 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wznzd\" (UniqueName: \"kubernetes.io/projected/01e93592-8357-47c4-ae7e-8f6c1e6e75a6-kube-api-access-wznzd\") pod \"aws-ebs-csi-driver-node-z47lh\" (UID: \"01e93592-8357-47c4-ae7e-8f6c1e6e75a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:19.048065 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.048041 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsc9f\" (UniqueName: \"kubernetes.io/projected/9c21c159-d406-48b0-badc-260eb9f84e99-kube-api-access-jsc9f\") pod \"tuned-vf2st\" (UID: \"9c21c159-d406-48b0-badc-260eb9f84e99\") " pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.048598 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.048579 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l22q5\" (UniqueName: \"kubernetes.io/projected/3a9244b8-54da-477d-8860-1161ace67c83-kube-api-access-l22q5\") pod \"node-ca-qmq99\" (UID: \"3a9244b8-54da-477d-8860-1161ace67c83\") " pod="openshift-image-registry/node-ca-qmq99" Jun 03 20:43:19.048987 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.048970 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5jdc\" (UniqueName: \"kubernetes.io/projected/7868b106-9752-43d7-bb61-85e9a8fe78f1-kube-api-access-k5jdc\") pod \"multus-additional-cni-plugins-v5gsw\" (UID: \"7868b106-9752-43d7-bb61-85e9a8fe78f1\") " pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:19.146006 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.145923 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:19.153263 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.153236 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nklxt" Jun 03 20:43:19.155962 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:19.155934 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3686395b_19a4_4c36_b5ee_fdb263bc7a1d.slice/crio-c67bc2505e85e29593f8e7ea7951926c0fec2caca7b15d229c4b5b56521ec2ab WatchSource:0}: Error finding container c67bc2505e85e29593f8e7ea7951926c0fec2caca7b15d229c4b5b56521ec2ab: Status 404 returned error can't find the container with id c67bc2505e85e29593f8e7ea7951926c0fec2caca7b15d229c4b5b56521ec2ab Jun 03 20:43:19.159219 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.159196 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" Jun 03 20:43:19.160525 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:19.160501 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e040c2_067d_4275_96b9_1ef76faa94da.slice/crio-4c83701435f70c2f3587280b5f9dab9b093397d2427821b39f5b9aac7599f486 WatchSource:0}: Error finding container 4c83701435f70c2f3587280b5f9dab9b093397d2427821b39f5b9aac7599f486: Status 404 returned error can't find the container with id 4c83701435f70c2f3587280b5f9dab9b093397d2427821b39f5b9aac7599f486 Jun 03 20:43:19.165237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.165221 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vf2st" Jun 03 20:43:19.167944 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:19.167923 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01e93592_8357_47c4_ae7e_8f6c1e6e75a6.slice/crio-46644cb3b7192e0e6efc30b9d4bad040223abbb9ff03f93f659af44b589bf4c9 WatchSource:0}: Error finding container 46644cb3b7192e0e6efc30b9d4bad040223abbb9ff03f93f659af44b589bf4c9: Status 404 returned error can't find the container with id 46644cb3b7192e0e6efc30b9d4bad040223abbb9ff03f93f659af44b589bf4c9 Jun 03 20:43:19.171509 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.171444 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5f2ll" Jun 03 20:43:19.172692 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:19.172672 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c21c159_d406_48b0_badc_260eb9f84e99.slice/crio-ee9545e155ae4a75f21c3677d93472f0b3a134157df0c7ed6ba0cd393fe8e781 WatchSource:0}: Error finding container ee9545e155ae4a75f21c3677d93472f0b3a134157df0c7ed6ba0cd393fe8e781: Status 404 returned error can't find the container with id ee9545e155ae4a75f21c3677d93472f0b3a134157df0c7ed6ba0cd393fe8e781 Jun 03 20:43:19.176075 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.176060 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v5gsw" Jun 03 20:43:19.181721 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:19.181701 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod704afad7_2929_409b_a7ed_c877c45839ec.slice/crio-79671806e193e4b757a78a09c3345c36d3c24c896e4de4ad3e1621b5b5473528 WatchSource:0}: Error finding container 79671806e193e4b757a78a09c3345c36d3c24c896e4de4ad3e1621b5b5473528: Status 404 returned error can't find the container with id 79671806e193e4b757a78a09c3345c36d3c24c896e4de4ad3e1621b5b5473528 Jun 03 20:43:19.184323 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:19.184300 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7868b106_9752_43d7_bb61_85e9a8fe78f1.slice/crio-970b1790f98bb3706a9e85409ccb55b1c47b865ee098465452e1ef597357b414 WatchSource:0}: Error finding container 970b1790f98bb3706a9e85409ccb55b1c47b865ee098465452e1ef597357b414: Status 404 returned error can't find the container with id 970b1790f98bb3706a9e85409ccb55b1c47b865ee098465452e1ef597357b414 Jun 03 20:43:19.185384 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.185368 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qmq99" Jun 03 20:43:19.191765 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.191705 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b5szz" Jun 03 20:43:19.193971 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:19.193942 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a9244b8_54da_477d_8860_1161ace67c83.slice/crio-06033e44cfbb7198596f75449d136c51253d480e40fb4d3964c83f9a22f25b49 WatchSource:0}: Error finding container 06033e44cfbb7198596f75449d136c51253d480e40fb4d3964c83f9a22f25b49: Status 404 returned error can't find the container with id 06033e44cfbb7198596f75449d136c51253d480e40fb4d3964c83f9a22f25b49 Jun 03 20:43:19.196552 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.196533 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wldmp" Jun 03 20:43:19.201325 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:19.201302 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e0215a1_6ccb_4f35_96dd_68369940f908.slice/crio-87cce3a3e7c154c1d5c48750a1f5f58241ee8de5fa3581a837f7a7c140edd399 WatchSource:0}: Error finding container 87cce3a3e7c154c1d5c48750a1f5f58241ee8de5fa3581a837f7a7c140edd399: Status 404 returned error can't find the container with id 87cce3a3e7c154c1d5c48750a1f5f58241ee8de5fa3581a837f7a7c140edd399 Jun 03 20:43:19.206370 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:19.206329 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209cb1df_687a_4601_b73c_a0dd2e1240c9.slice/crio-88aaf470399e647ed7b1f849f9d83a489eb10d715208e9894e4a8bc536ccdd00 WatchSource:0}: Error finding container 88aaf470399e647ed7b1f849f9d83a489eb10d715208e9894e4a8bc536ccdd00: Status 404 returned error can't find the container with id 88aaf470399e647ed7b1f849f9d83a489eb10d715208e9894e4a8bc536ccdd00 Jun 03 20:43:19.352922 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.352888 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:19.541067 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.540951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret\") pod \"global-pull-secret-syncer-nz55h\" (UID: \"78164361-9b18-423d-83eb-e2ddbaa78edd\") " pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:19.541067 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.541007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs\") pod \"network-metrics-daemon-wl8bs\" (UID: \"5c12c87b-72ec-41be-8add-0584a341a706\") " pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:19.541285 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:19.541145 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:19.541285 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:19.541207 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs podName:5c12c87b-72ec-41be-8add-0584a341a706 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:20.541186997 +0000 UTC m=+3.142413970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs") pod "network-metrics-daemon-wl8bs" (UID: "5c12c87b-72ec-41be-8add-0584a341a706") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:19.541771 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:19.541632 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:19.541771 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:19.541689 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret podName:78164361-9b18-423d-83eb-e2ddbaa78edd nodeName:}" failed. No retries permitted until 2026-06-03 20:43:20.54167355 +0000 UTC m=+3.142900514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret") pod "global-pull-secret-syncer-nz55h" (UID: "78164361-9b18-423d-83eb-e2ddbaa78edd") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:19.642261 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.641589 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxbc8\" (UniqueName: \"kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8\") pod \"network-check-target-hvn4f\" (UID: \"31affeb8-aa2a-40de-b080-cd2c0168abfb\") " pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:19.642261 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:19.641784 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:19.642261 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:19.641806 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:19.642261 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:19.641819 2577 projected.go:196] Error preparing data for projected volume kube-api-access-kxbc8 for pod openshift-network-diagnostics/network-check-target-hvn4f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:19.642261 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:19.641913 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8 podName:31affeb8-aa2a-40de-b080-cd2c0168abfb nodeName:}" failed. No retries permitted until 2026-06-03 20:43:20.641893354 +0000 UTC m=+3.243120314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxbc8" (UniqueName: "kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8") pod "network-check-target-hvn4f" (UID: "31affeb8-aa2a-40de-b080-cd2c0168abfb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:19.880704 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.880580 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 20:38:18 +0000 UTC" deadline="2028-01-18 23:00:03.593757828 +0000 UTC" Jun 03 20:43:19.880704 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.880660 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14258h16m43.713102483s" Jun 03 20:43:19.908427 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.908305 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wldmp" event={"ID":"209cb1df-687a-4601-b73c-a0dd2e1240c9","Type":"ContainerStarted","Data":"88aaf470399e647ed7b1f849f9d83a489eb10d715208e9894e4a8bc536ccdd00"} Jun 03 20:43:19.921817 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.921779 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b5szz" event={"ID":"3e0215a1-6ccb-4f35-96dd-68369940f908","Type":"ContainerStarted","Data":"87cce3a3e7c154c1d5c48750a1f5f58241ee8de5fa3581a837f7a7c140edd399"} Jun 03 20:43:19.925097 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.925063 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5gsw" event={"ID":"7868b106-9752-43d7-bb61-85e9a8fe78f1","Type":"ContainerStarted","Data":"970b1790f98bb3706a9e85409ccb55b1c47b865ee098465452e1ef597357b414"} Jun 03 20:43:19.933001 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.932966 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5f2ll" event={"ID":"704afad7-2929-409b-a7ed-c877c45839ec","Type":"ContainerStarted","Data":"79671806e193e4b757a78a09c3345c36d3c24c896e4de4ad3e1621b5b5473528"} Jun 03 20:43:19.936800 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.936709 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nklxt" event={"ID":"c7e040c2-067d-4275-96b9-1ef76faa94da","Type":"ContainerStarted","Data":"4c83701435f70c2f3587280b5f9dab9b093397d2427821b39f5b9aac7599f486"} Jun 03 20:43:19.953111 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.953072 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qmq99" event={"ID":"3a9244b8-54da-477d-8860-1161ace67c83","Type":"ContainerStarted","Data":"06033e44cfbb7198596f75449d136c51253d480e40fb4d3964c83f9a22f25b49"} Jun 03 20:43:19.972596 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.972555 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vf2st" event={"ID":"9c21c159-d406-48b0-badc-260eb9f84e99","Type":"ContainerStarted","Data":"ee9545e155ae4a75f21c3677d93472f0b3a134157df0c7ed6ba0cd393fe8e781"} Jun 03 20:43:19.985815 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.985777 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" event={"ID":"01e93592-8357-47c4-ae7e-8f6c1e6e75a6","Type":"ContainerStarted","Data":"46644cb3b7192e0e6efc30b9d4bad040223abbb9ff03f93f659af44b589bf4c9"} Jun 03 20:43:19.996373 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:19.996086 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" event={"ID":"3686395b-19a4-4c36-b5ee-fdb263bc7a1d","Type":"ContainerStarted","Data":"c67bc2505e85e29593f8e7ea7951926c0fec2caca7b15d229c4b5b56521ec2ab"} Jun 03 20:43:20.359086 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:20.359007 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:20.549286 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:20.549220 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret\") pod \"global-pull-secret-syncer-nz55h\" (UID: \"78164361-9b18-423d-83eb-e2ddbaa78edd\") " pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:20.549286 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:20.549276 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs\") pod \"network-metrics-daemon-wl8bs\" (UID: \"5c12c87b-72ec-41be-8add-0584a341a706\") " pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:20.549539 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:20.549450 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:20.549539 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:20.549516 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs podName:5c12c87b-72ec-41be-8add-0584a341a706 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:22.54949718 +0000 UTC m=+5.150724154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs") pod "network-metrics-daemon-wl8bs" (UID: "5c12c87b-72ec-41be-8add-0584a341a706") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:20.549989 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:20.549969 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:20.550089 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:20.550037 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret podName:78164361-9b18-423d-83eb-e2ddbaa78edd nodeName:}" failed. No retries permitted until 2026-06-03 20:43:22.550012684 +0000 UTC m=+5.151239663 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret") pod "global-pull-secret-syncer-nz55h" (UID: "78164361-9b18-423d-83eb-e2ddbaa78edd") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:20.650239 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:20.650132 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxbc8\" (UniqueName: \"kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8\") pod \"network-check-target-hvn4f\" (UID: \"31affeb8-aa2a-40de-b080-cd2c0168abfb\") " pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:20.650453 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:20.650364 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:20.650453 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:20.650387 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:20.650453 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:20.650401 2577 projected.go:196] Error preparing data for projected volume kube-api-access-kxbc8 for pod openshift-network-diagnostics/network-check-target-hvn4f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:20.650633 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:20.650470 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8 podName:31affeb8-aa2a-40de-b080-cd2c0168abfb nodeName:}" failed. No retries permitted until 2026-06-03 20:43:22.650447536 +0000 UTC m=+5.251674495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxbc8" (UniqueName: "kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8") pod "network-check-target-hvn4f" (UID: "31affeb8-aa2a-40de-b080-cd2c0168abfb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:20.881112 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:20.881065 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 20:38:18 +0000 UTC" deadline="2028-01-18 11:48:14.143867313 +0000 UTC" Jun 03 20:43:20.881112 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:20.881111 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14247h4m53.262761319s" Jun 03 20:43:20.888501 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:20.888473 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:20.888666 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:20.888609 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz55h" podUID="78164361-9b18-423d-83eb-e2ddbaa78edd" Jun 03 20:43:20.889040 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:20.889019 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:20.889141 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:20.889121 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:20.889204 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:20.889189 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:20.889294 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:20.889273 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:43:21.308003 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:21.307947 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 20:43:22.566247 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:22.566207 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret\") pod \"global-pull-secret-syncer-nz55h\" (UID: \"78164361-9b18-423d-83eb-e2ddbaa78edd\") " pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:22.566720 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:22.566256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs\") pod \"network-metrics-daemon-wl8bs\" (UID: \"5c12c87b-72ec-41be-8add-0584a341a706\") " pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:22.566720 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:22.566413 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:22.566720 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:22.566475 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs podName:5c12c87b-72ec-41be-8add-0584a341a706 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:26.566456281 +0000 UTC m=+9.167683242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs") pod "network-metrics-daemon-wl8bs" (UID: "5c12c87b-72ec-41be-8add-0584a341a706") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:22.566912 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:22.566809 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:22.566912 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:22.566849 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret podName:78164361-9b18-423d-83eb-e2ddbaa78edd nodeName:}" failed. No retries permitted until 2026-06-03 20:43:26.566837338 +0000 UTC m=+9.168064297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret") pod "global-pull-secret-syncer-nz55h" (UID: "78164361-9b18-423d-83eb-e2ddbaa78edd") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:22.667678 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:22.667039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxbc8\" (UniqueName: \"kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8\") pod \"network-check-target-hvn4f\" (UID: \"31affeb8-aa2a-40de-b080-cd2c0168abfb\") " pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:22.667678 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:22.667226 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:22.667678 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:22.667251 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:22.667678 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:22.667263 2577 projected.go:196] Error preparing data for projected volume kube-api-access-kxbc8 for pod openshift-network-diagnostics/network-check-target-hvn4f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:22.667678 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:22.667323 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8 podName:31affeb8-aa2a-40de-b080-cd2c0168abfb nodeName:}" failed. No retries permitted until 2026-06-03 20:43:26.667306001 +0000 UTC m=+9.268532963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxbc8" (UniqueName: "kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8") pod "network-check-target-hvn4f" (UID: "31affeb8-aa2a-40de-b080-cd2c0168abfb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:22.888963 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:22.888881 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:22.889138 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:22.889019 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz55h" podUID="78164361-9b18-423d-83eb-e2ddbaa78edd" Jun 03 20:43:22.889710 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:22.889427 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:22.889710 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:22.889529 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:22.889710 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:22.889585 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:22.889710 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:22.889667 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:43:24.888793 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:24.888758 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:24.889288 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:24.888878 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:24.889288 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:24.889257 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:24.889423 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:24.889366 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:43:24.889487 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:24.889436 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:24.889581 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:24.889558 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz55h" podUID="78164361-9b18-423d-83eb-e2ddbaa78edd" Jun 03 20:43:26.602164 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:26.601520 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret\") pod \"global-pull-secret-syncer-nz55h\" (UID: \"78164361-9b18-423d-83eb-e2ddbaa78edd\") " pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:26.602164 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:26.601581 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs\") pod \"network-metrics-daemon-wl8bs\" (UID: \"5c12c87b-72ec-41be-8add-0584a341a706\") " pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:26.602164 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:26.601716 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:26.602164 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:26.601779 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs podName:5c12c87b-72ec-41be-8add-0584a341a706 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:34.601759638 +0000 UTC m=+17.202986613 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs") pod "network-metrics-daemon-wl8bs" (UID: "5c12c87b-72ec-41be-8add-0584a341a706") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:26.602164 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:26.601898 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:26.602164 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:26.601953 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret podName:78164361-9b18-423d-83eb-e2ddbaa78edd nodeName:}" failed. No retries permitted until 2026-06-03 20:43:34.60194007 +0000 UTC m=+17.203167031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret") pod "global-pull-secret-syncer-nz55h" (UID: "78164361-9b18-423d-83eb-e2ddbaa78edd") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:26.702231 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:26.702122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxbc8\" (UniqueName: \"kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8\") pod \"network-check-target-hvn4f\" (UID: \"31affeb8-aa2a-40de-b080-cd2c0168abfb\") " pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:26.702432 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:26.702326 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:26.702432 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:26.702371 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:26.702432 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:26.702385 2577 projected.go:196] Error preparing data for projected volume kube-api-access-kxbc8 for pod openshift-network-diagnostics/network-check-target-hvn4f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:26.702602 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:26.702452 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8 podName:31affeb8-aa2a-40de-b080-cd2c0168abfb nodeName:}" failed. No retries permitted until 2026-06-03 20:43:34.702430063 +0000 UTC m=+17.303657027 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxbc8" (UniqueName: "kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8") pod "network-check-target-hvn4f" (UID: "31affeb8-aa2a-40de-b080-cd2c0168abfb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:26.888481 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:26.888396 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:26.888638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:26.888399 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:26.888638 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:26.888527 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz55h" podUID="78164361-9b18-423d-83eb-e2ddbaa78edd" Jun 03 20:43:26.888638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:26.888542 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:26.888638 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:26.888629 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:26.888840 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:26.888752 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:43:28.889048 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:28.889018 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:28.889048 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:28.889055 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:28.889531 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:28.889121 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:28.889531 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:28.889139 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:28.889531 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:28.889221 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:43:28.889531 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:28.889301 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz55h" podUID="78164361-9b18-423d-83eb-e2ddbaa78edd" Jun 03 20:43:30.889304 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:30.889253 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:30.889811 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:30.889266 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:30.889811 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:30.889395 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz55h" podUID="78164361-9b18-423d-83eb-e2ddbaa78edd" Jun 03 20:43:30.889811 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:30.889464 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:30.889811 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:30.889579 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:30.889811 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:30.889683 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:43:32.888742 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:32.888694 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:32.888742 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:32.888744 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:32.889272 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:32.888807 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:32.889272 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:32.888826 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz55h" podUID="78164361-9b18-423d-83eb-e2ddbaa78edd" Jun 03 20:43:32.889272 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:32.888907 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:43:32.889272 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:32.888978 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:34.663157 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:34.663125 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret\") pod \"global-pull-secret-syncer-nz55h\" (UID: \"78164361-9b18-423d-83eb-e2ddbaa78edd\") " pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:34.663157 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:34.663162 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs\") pod \"network-metrics-daemon-wl8bs\" (UID: \"5c12c87b-72ec-41be-8add-0584a341a706\") " pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:34.663662 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:34.663274 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:34.663662 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:34.663278 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:34.663662 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:34.663360 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs podName:5c12c87b-72ec-41be-8add-0584a341a706 nodeName:}" failed. No retries permitted until 2026-06-03 20:43:50.663326967 +0000 UTC m=+33.264553931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs") pod "network-metrics-daemon-wl8bs" (UID: "5c12c87b-72ec-41be-8add-0584a341a706") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:34.663662 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:34.663376 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret podName:78164361-9b18-423d-83eb-e2ddbaa78edd nodeName:}" failed. No retries permitted until 2026-06-03 20:43:50.663369298 +0000 UTC m=+33.264596257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret") pod "global-pull-secret-syncer-nz55h" (UID: "78164361-9b18-423d-83eb-e2ddbaa78edd") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:34.763897 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:34.763858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxbc8\" (UniqueName: \"kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8\") pod \"network-check-target-hvn4f\" (UID: \"31affeb8-aa2a-40de-b080-cd2c0168abfb\") " pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:34.764066 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:34.764021 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:34.764066 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:34.764044 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:34.764066 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:34.764059 2577 projected.go:196] Error preparing data for projected volume kube-api-access-kxbc8 for pod openshift-network-diagnostics/network-check-target-hvn4f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:34.764225 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:34.764126 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8 podName:31affeb8-aa2a-40de-b080-cd2c0168abfb nodeName:}" failed. No retries permitted until 2026-06-03 20:43:50.764111353 +0000 UTC m=+33.365338324 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxbc8" (UniqueName: "kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8") pod "network-check-target-hvn4f" (UID: "31affeb8-aa2a-40de-b080-cd2c0168abfb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:34.888599 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:34.888564 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:34.888747 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:34.888628 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:34.888747 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:34.888735 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:34.888859 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:34.888750 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:34.889250 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:34.889214 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:43:34.889437 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:34.889413 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz55h" podUID="78164361-9b18-423d-83eb-e2ddbaa78edd" Jun 03 20:43:36.888310 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:36.888272 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:36.888823 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:36.888272 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:36.888823 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:36.888419 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:36.888823 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:36.888272 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:36.888823 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:36.888594 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:43:36.888823 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:36.888455 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz55h" podUID="78164361-9b18-423d-83eb-e2ddbaa78edd" Jun 03 20:43:38.888810 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:38.888771 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:38.888810 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:38.888806 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:38.889225 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:38.888828 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:38.889225 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:38.888917 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:38.889225 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:38.888946 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz55h" podUID="78164361-9b18-423d-83eb-e2ddbaa78edd" Jun 03 20:43:38.889225 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:38.889013 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:43:39.037447 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:39.037230 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b5szz" event={"ID":"3e0215a1-6ccb-4f35-96dd-68369940f908","Type":"ContainerStarted","Data":"046ca3ead72830cf417c94fb48aa772a81bbe002381a84bf3a335f5bdd9bc136"} Jun 03 20:43:39.038748 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:39.038727 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-196.ec2.internal" event={"ID":"1dca1cb65a4fa78fa52bf28f0a56768c","Type":"ContainerStarted","Data":"bd7d6a5688f5bc97a04bfc076e172c340773bba4b22ee02f22e1ba3122e76827"} Jun 03 20:43:39.040072 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:39.040053 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vf2st" event={"ID":"9c21c159-d406-48b0-badc-260eb9f84e99","Type":"ContainerStarted","Data":"14a94f7103d3d344967e2f4eecae708110a5851567f9181347f4818c7677bdac"} Jun 03 20:43:39.057598 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:39.057551 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-b5szz" podStartSLOduration=1.4887095879999999 podStartE2EDuration="21.057537925s" totalImagesPullingTime="19.568828337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:39.057472424 +0000 UTC m=+21.658699406" watchObservedRunningTime="2026-06-03 20:43:39.057537925 +0000 UTC m=+21.658764906" Jun 03 20:43:39.079084 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:39.079035 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vf2st" podStartSLOduration=1.561112329 podStartE2EDuration="21.079019542s" totalImagesPullingTime="19.517907213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:39.078444312 +0000 UTC m=+21.679671294" watchObservedRunningTime="2026-06-03 20:43:39.079019542 +0000 UTC m=+21.680246523" Jun 03 20:43:39.091727 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:39.091680 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-196.ec2.internal" podStartSLOduration=21.091665292 podStartE2EDuration="21.091665292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:39.091390384 +0000 UTC m=+21.692617365" watchObservedRunningTime="2026-06-03 20:43:39.091665292 +0000 UTC m=+21.692892273" Jun 03 20:43:40.043959 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.043742 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" event={"ID":"01e93592-8357-47c4-ae7e-8f6c1e6e75a6","Type":"ContainerStarted","Data":"4869017c157ad96a3a23ffc86f5b39f8e7396817fa0a3a71693afb478a62cef9"} Jun 03 20:43:40.046398 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.046375 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 20:43:40.046689 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.046670 2577 generic.go:356] "Generic (PLEG): container finished" podID="3686395b-19a4-4c36-b5ee-fdb263bc7a1d" containerID="a1538bee9cca055fdb7f5b4ac1126bf90d914613e9ed796ded64c58c9c03d5e6" exitCode=1 Jun 03 20:43:40.046758 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.046741 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" event={"ID":"3686395b-19a4-4c36-b5ee-fdb263bc7a1d","Type":"ContainerStarted","Data":"549a68d7d9467f90db241e6e1d251ff4bbd847782e07437df8e1978a7036636f"} Jun 03 20:43:40.046810 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.046798 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" event={"ID":"3686395b-19a4-4c36-b5ee-fdb263bc7a1d","Type":"ContainerStarted","Data":"c3d387ca5dd3fbe4c5d995c4d550444aaf50b296730c87a6b3da4ffc871357d0"} Jun 03 20:43:40.046856 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.046835 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" event={"ID":"3686395b-19a4-4c36-b5ee-fdb263bc7a1d","Type":"ContainerStarted","Data":"7a838aeb34be48543aa0c3650ea3d8c16edfde002270358cdaab000c0eeb0358"} Jun 03 20:43:40.046897 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.046878 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" event={"ID":"3686395b-19a4-4c36-b5ee-fdb263bc7a1d","Type":"ContainerStarted","Data":"56e3d8ca55e5dbdb373c0a8cd448d0366c57a160ad5744f79013865158c2ceff"} Jun 03 20:43:40.046937 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.046923 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" event={"ID":"3686395b-19a4-4c36-b5ee-fdb263bc7a1d","Type":"ContainerDied","Data":"a1538bee9cca055fdb7f5b4ac1126bf90d914613e9ed796ded64c58c9c03d5e6"} Jun 03 20:43:40.046988 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.046976 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" event={"ID":"3686395b-19a4-4c36-b5ee-fdb263bc7a1d","Type":"ContainerStarted","Data":"dadda88273fe383e43b0175b40484a2847b88df8bca54173214c1f6bde4616dd"} Jun 03 20:43:40.048006 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.047984 2577 generic.go:356] "Generic (PLEG): container finished" podID="717d1a917b1152c89902cbfaf6731cd2" containerID="a7676b2edf09bd369027b3aeacaf8bba253cd544693e58c4d301fd4ca383cced" exitCode=0 Jun 03 20:43:40.048106 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.048023 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal" event={"ID":"717d1a917b1152c89902cbfaf6731cd2","Type":"ContainerDied","Data":"a7676b2edf09bd369027b3aeacaf8bba253cd544693e58c4d301fd4ca383cced"} Jun 03 20:43:40.049820 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.049796 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wldmp" event={"ID":"209cb1df-687a-4601-b73c-a0dd2e1240c9","Type":"ContainerStarted","Data":"bee98bdad5fce2a0f1f5506624f92926e8d47df92ba9006feb4628032a7c84b2"} Jun 03 20:43:40.051537 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.051512 2577 generic.go:356] "Generic (PLEG): container finished" podID="7868b106-9752-43d7-bb61-85e9a8fe78f1" containerID="721a4fb096b1ac92b3b769fc3ca78317fd91363626824adf4d7bbeaf3bddb543" exitCode=0 Jun 03 20:43:40.051654 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.051553 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5gsw" event={"ID":"7868b106-9752-43d7-bb61-85e9a8fe78f1","Type":"ContainerDied","Data":"721a4fb096b1ac92b3b769fc3ca78317fd91363626824adf4d7bbeaf3bddb543"} Jun 03 20:43:40.053165 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.053142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5f2ll" event={"ID":"704afad7-2929-409b-a7ed-c877c45839ec","Type":"ContainerStarted","Data":"e9dee4d984895cf15570ded850be44da235fdbe518541aa72244120a3638a624"} Jun 03 20:43:40.055253 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.055231 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nklxt" event={"ID":"c7e040c2-067d-4275-96b9-1ef76faa94da","Type":"ContainerStarted","Data":"6c1b5b0d83c11f47e445178e1ee9b6dbce46e3ca76ddf201b8be7daf47777369"} Jun 03 20:43:40.056592 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.056571 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qmq99" event={"ID":"3a9244b8-54da-477d-8860-1161ace67c83","Type":"ContainerStarted","Data":"b134176d95219185d71d3d2e3bdb33fbcff6504f4230b5b2cee79321c4cd7686"} Jun 03 20:43:40.108531 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.108481 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qmq99" podStartSLOduration=2.566691741 podStartE2EDuration="22.108464751s" totalImagesPullingTime="19.54177301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:40.108023103 +0000 UTC m=+22.709250084" watchObservedRunningTime="2026-06-03 20:43:40.108464751 +0000 UTC m=+22.709691732" Jun 03 20:43:40.122504 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.122459 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5f2ll" podStartSLOduration=2.567003395 podStartE2EDuration="22.122446054s" totalImagesPullingTime="19.555442659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:40.122214494 +0000 UTC m=+22.723441475" watchObservedRunningTime="2026-06-03 20:43:40.122446054 +0000 UTC m=+22.723673035" Jun 03 20:43:40.141028 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.140866 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nklxt" podStartSLOduration=2.612381332 podStartE2EDuration="22.140843265s" totalImagesPullingTime="19.528461933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:40.139988639 +0000 UTC m=+22.741215619" watchObservedRunningTime="2026-06-03 20:43:40.140843265 +0000 UTC m=+22.742070247" Jun 03 20:43:40.239713 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.239526 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nklxt" Jun 03 20:43:40.240082 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.240066 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nklxt" Jun 03 20:43:40.888641 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.888607 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:40.888906 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.888648 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:40.888906 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:40.888710 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:40.888906 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:40.888727 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz55h" podUID="78164361-9b18-423d-83eb-e2ddbaa78edd" Jun 03 20:43:40.888906 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:40.888798 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:43:40.888906 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:40.888868 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:41.063198 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:41.063166 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal" event={"ID":"717d1a917b1152c89902cbfaf6731cd2","Type":"ContainerStarted","Data":"6ff4b8bd47973e423744e7875dde34b4980b82a2a29e29e589bc8ff1d05d22cd"} Jun 03 20:43:41.068546 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:41.068520 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 20:43:41.078368 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:41.078051 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-196.ec2.internal" podStartSLOduration=23.078032894 podStartE2EDuration="23.078032894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:41.077921536 +0000 UTC m=+23.679148500" watchObservedRunningTime="2026-06-03 20:43:41.078032894 +0000 UTC m=+23.679259878" Jun 03 20:43:41.094147 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:41.094099 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wldmp" podStartSLOduration=3.610065857 podStartE2EDuration="23.094083715s" totalImagesPullingTime="19.484017858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:41.094022381 +0000 UTC m=+23.695249372" watchObservedRunningTime="2026-06-03 20:43:41.094083715 +0000 UTC m=+23.695310695" Jun 03 20:43:41.891724 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:41.891609 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T20:43:41.068540077Z","UUID":"be02995b-bc66-4ddb-977b-3ec27e312f77","Handler":null,"Name":"","Endpoint":""} Jun 03 20:43:41.893319 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:41.893299 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 20:43:41.893476 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:41.893331 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 20:43:42.067911 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:42.067641 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" event={"ID":"01e93592-8357-47c4-ae7e-8f6c1e6e75a6","Type":"ContainerStarted","Data":"40ba1354358d6171084b94225ff623ce1ae23ab334b33f334a05ef71ad0c7113"} Jun 03 20:43:42.067911 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:42.067680 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 20:43:42.888971 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:42.888940 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:42.889208 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:42.889030 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:42.889208 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:42.889038 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz55h" podUID="78164361-9b18-423d-83eb-e2ddbaa78edd" Jun 03 20:43:42.889208 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:42.889057 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:42.889208 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:42.889126 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:42.889208 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:42.889189 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:43:43.071403 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:43.071372 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" event={"ID":"01e93592-8357-47c4-ae7e-8f6c1e6e75a6","Type":"ContainerStarted","Data":"5c2610f6b5384768c788b499de526a9345508b0cee0af16ae9289dd17a652abe"} Jun 03 20:43:43.074440 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:43.074421 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 20:43:43.074764 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:43.074745 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" event={"ID":"3686395b-19a4-4c36-b5ee-fdb263bc7a1d","Type":"ContainerStarted","Data":"b377d973a32116ab5c6743d81165eb932ed46c7607630b6636d76bc5ae8ee752"} Jun 03 20:43:43.093471 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:43.093423 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z47lh" podStartSLOduration=3.365783596 podStartE2EDuration="25.09341162s" totalImagesPullingTime="21.727628024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:43.093086952 +0000 UTC m=+25.694313932" watchObservedRunningTime="2026-06-03 20:43:43.09341162 +0000 UTC m=+25.694638635" Jun 03 20:43:44.888744 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:44.888705 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:44.888744 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:44.888737 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:44.889328 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:44.888752 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:44.889328 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:44.888845 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:44.889328 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:44.888924 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:43:44.889328 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:44.889019 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz55h" podUID="78164361-9b18-423d-83eb-e2ddbaa78edd" Jun 03 20:43:46.084053 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:46.084026 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 20:43:46.084446 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:46.084408 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" event={"ID":"3686395b-19a4-4c36-b5ee-fdb263bc7a1d","Type":"ContainerStarted","Data":"47adce1b3b218c4ce024cbc9d80d6e2d452bfbf9880a2b8a0661a4b25f7e21d8"} Jun 03 20:43:46.084676 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:46.084653 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:46.084870 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:46.084851 2577 scope.go:117] "RemoveContainer" containerID="a1538bee9cca055fdb7f5b4ac1126bf90d914613e9ed796ded64c58c9c03d5e6" Jun 03 20:43:46.086388 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:46.086364 2577 generic.go:356] "Generic (PLEG): container finished" podID="7868b106-9752-43d7-bb61-85e9a8fe78f1" containerID="a5f83b05d86e4a79015ea016ee8546c7f289c1c876636c92148a4e8604bfd561" exitCode=0 Jun 03 20:43:46.086478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:46.086397 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5gsw" event={"ID":"7868b106-9752-43d7-bb61-85e9a8fe78f1","Type":"ContainerDied","Data":"a5f83b05d86e4a79015ea016ee8546c7f289c1c876636c92148a4e8604bfd561"} Jun 03 20:43:46.102472 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:46.102452 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:46.888308 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:46.888267 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:46.888740 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:46.888267 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:46.888740 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:46.888400 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz55h" podUID="78164361-9b18-423d-83eb-e2ddbaa78edd" Jun 03 20:43:46.888740 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:46.888267 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:46.888740 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:46.888453 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:46.888740 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:46.888548 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:43:47.094587 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:47.094317 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 20:43:47.095071 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:47.095042 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" event={"ID":"3686395b-19a4-4c36-b5ee-fdb263bc7a1d","Type":"ContainerStarted","Data":"8bb3ddd7051e1170ba1578ec7046a1e263f405e58477e39056ef18cc97fd8b68"} Jun 03 20:43:47.096158 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:47.096137 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:47.096283 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:47.096220 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:47.113851 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:47.113817 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:43:47.162895 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:47.162851 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" podStartSLOduration=8.993954034 podStartE2EDuration="29.162834037s" totalImagesPullingTime="20.168880003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:47.128870601 +0000 UTC m=+29.730097582" watchObservedRunningTime="2026-06-03 20:43:47.162834037 +0000 UTC m=+29.764061018" Jun 03 20:43:47.500514 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:47.500482 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hvn4f"] Jun 03 20:43:47.500671 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:47.500618 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:47.500714 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:47.500697 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:47.503260 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:47.503232 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nz55h"] Jun 03 20:43:47.503407 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:47.503332 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:47.503476 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:47.503454 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz55h" podUID="78164361-9b18-423d-83eb-e2ddbaa78edd" Jun 03 20:43:47.504035 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:47.504010 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wl8bs"] Jun 03 20:43:47.504148 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:47.504106 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:47.504200 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:47.504176 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:43:47.835801 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:47.835707 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nklxt" Jun 03 20:43:47.835963 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:47.835830 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 20:43:47.836356 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:47.836315 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nklxt" Jun 03 20:43:48.099037 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:48.098945 2577 generic.go:356] "Generic (PLEG): container finished" podID="7868b106-9752-43d7-bb61-85e9a8fe78f1" containerID="d6f33ebba0a9c43d18e34ead6638405bfcf33d23468709c71149292793ffca23" exitCode=0 Jun 03 20:43:48.099522 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:48.099035 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5gsw" event={"ID":"7868b106-9752-43d7-bb61-85e9a8fe78f1","Type":"ContainerDied","Data":"d6f33ebba0a9c43d18e34ead6638405bfcf33d23468709c71149292793ffca23"} Jun 03 20:43:48.888747 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:48.888666 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:48.888916 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:48.888779 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:49.103535 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:49.103505 2577 generic.go:356] "Generic (PLEG): container finished" podID="7868b106-9752-43d7-bb61-85e9a8fe78f1" containerID="9ae6de3f84c46b09f82475a6e478f83e5cec43498c651314005102e442fc497b" exitCode=0 Jun 03 20:43:49.104233 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:49.103581 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5gsw" event={"ID":"7868b106-9752-43d7-bb61-85e9a8fe78f1","Type":"ContainerDied","Data":"9ae6de3f84c46b09f82475a6e478f83e5cec43498c651314005102e442fc497b"} Jun 03 20:43:49.888528 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:49.888491 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:49.888732 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:49.888643 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:43:49.888732 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:49.888720 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:49.888861 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:49.888830 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nz55h" podUID="78164361-9b18-423d-83eb-e2ddbaa78edd" Jun 03 20:43:50.689331 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:50.689291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret\") pod \"global-pull-secret-syncer-nz55h\" (UID: \"78164361-9b18-423d-83eb-e2ddbaa78edd\") " pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:50.689331 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:50.689335 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs\") pod \"network-metrics-daemon-wl8bs\" (UID: \"5c12c87b-72ec-41be-8add-0584a341a706\") " pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:50.689955 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:50.689453 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:50.689955 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:50.689523 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs podName:5c12c87b-72ec-41be-8add-0584a341a706 nodeName:}" failed. No retries permitted until 2026-06-03 20:44:22.689503062 +0000 UTC m=+65.290730025 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs") pod "network-metrics-daemon-wl8bs" (UID: "5c12c87b-72ec-41be-8add-0584a341a706") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 20:43:50.689955 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:50.689454 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:50.689955 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:50.689609 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret podName:78164361-9b18-423d-83eb-e2ddbaa78edd nodeName:}" failed. No retries permitted until 2026-06-03 20:44:22.689592709 +0000 UTC m=+65.290819677 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret") pod "global-pull-secret-syncer-nz55h" (UID: "78164361-9b18-423d-83eb-e2ddbaa78edd") : object "kube-system"/"original-pull-secret" not registered Jun 03 20:43:50.790079 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:50.790046 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxbc8\" (UniqueName: \"kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8\") pod \"network-check-target-hvn4f\" (UID: \"31affeb8-aa2a-40de-b080-cd2c0168abfb\") " pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:50.790263 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:50.790236 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 20:43:50.790316 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:50.790265 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 20:43:50.790316 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:50.790278 2577 projected.go:196] Error preparing data for projected volume kube-api-access-kxbc8 for pod openshift-network-diagnostics/network-check-target-hvn4f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:50.790435 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:50.790373 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8 podName:31affeb8-aa2a-40de-b080-cd2c0168abfb nodeName:}" failed. No retries permitted until 2026-06-03 20:44:22.790336935 +0000 UTC m=+65.391563911 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kxbc8" (UniqueName: "kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8") pod "network-check-target-hvn4f" (UID: "31affeb8-aa2a-40de-b080-cd2c0168abfb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 20:43:50.889087 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:50.889049 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:50.889266 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:50.889196 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvn4f" podUID="31affeb8-aa2a-40de-b080-cd2c0168abfb" Jun 03 20:43:51.741752 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.741557 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-196.ec2.internal" event="NodeReady" Jun 03 20:43:51.742174 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.741901 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 20:43:51.775557 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.775526 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64b886f49b-c8rzs"] Jun 03 20:43:51.777742 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.777712 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.780490 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.780464 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 20:43:51.780628 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.780467 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 20:43:51.780628 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.780544 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 20:43:51.780922 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.780816 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qqw74\"" Jun 03 20:43:51.787671 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.787646 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 20:43:51.792170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.792148 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-px4nq"] Jun 03 20:43:51.794030 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.794011 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-px4nq" Jun 03 20:43:51.796788 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.796765 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bjbbr"] Jun 03 20:43:51.798050 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.798005 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 20:43:51.798597 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.798579 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bjbbr" Jun 03 20:43:51.798692 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.798624 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d78km\"" Jun 03 20:43:51.798692 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.798674 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 20:43:51.801720 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.801534 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ql74z\"" Jun 03 20:43:51.801720 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.801582 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 20:43:51.801720 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.801585 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 20:43:51.802530 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.801911 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 20:43:51.803323 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.803298 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64b886f49b-c8rzs"] Jun 03 20:43:51.813378 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.813355 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bjbbr"] Jun 03 20:43:51.814133 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.814113 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-px4nq"] Jun 03 20:43:51.889230 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.889141 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:43:51.889230 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.889174 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:43:51.892712 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.892685 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kg9x\"" Jun 03 20:43:51.892859 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.892834 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 20:43:51.893367 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.892952 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 20:43:51.896588 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.896563 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2d955896-e762-4a3b-9517-75622c75eafe-config-volume\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:43:51.896725 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.896601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3869bb16-98d6-4fcf-810c-83d235e8670f-trusted-ca\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.896725 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.896628 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-bound-sa-token\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.896725 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.896653 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn7sk\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-kube-api-access-sn7sk\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.896725 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.896676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:43:51.896725 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.896717 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d955896-e762-4a3b-9517-75622c75eafe-tmp-dir\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:43:51.896972 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.896754 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3869bb16-98d6-4fcf-810c-83d235e8670f-ca-trust-extracted\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.896972 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.896808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3869bb16-98d6-4fcf-810c-83d235e8670f-installation-pull-secrets\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.896972 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.896852 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-certificates\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.896972 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.896879 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.896972 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.896911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3869bb16-98d6-4fcf-810c-83d235e8670f-image-registry-private-configuration\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.897192 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.896985 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/618af87a-4eb4-4bc2-8f94-3915b3a005ff-cert\") pod \"ingress-canary-bjbbr\" (UID: \"618af87a-4eb4-4bc2-8f94-3915b3a005ff\") " pod="openshift-ingress-canary/ingress-canary-bjbbr" Jun 03 20:43:51.897192 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.897026 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddlp9\" (UniqueName: \"kubernetes.io/projected/2d955896-e762-4a3b-9517-75622c75eafe-kube-api-access-ddlp9\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:43:51.897192 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.897052 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjr49\" (UniqueName: \"kubernetes.io/projected/618af87a-4eb4-4bc2-8f94-3915b3a005ff-kube-api-access-mjr49\") pod \"ingress-canary-bjbbr\" (UID: \"618af87a-4eb4-4bc2-8f94-3915b3a005ff\") " pod="openshift-ingress-canary/ingress-canary-bjbbr" Jun 03 20:43:51.972950 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.972909 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nklxt_c7e040c2-067d-4275-96b9-1ef76faa94da/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:51.997954 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.997913 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3869bb16-98d6-4fcf-810c-83d235e8670f-trusted-ca\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.997954 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.997960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-bound-sa-token\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.998216 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.997983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn7sk\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-kube-api-access-sn7sk\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.998216 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.998012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:43:51.998216 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.998067 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d955896-e762-4a3b-9517-75622c75eafe-tmp-dir\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:43:51.998216 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.998107 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3869bb16-98d6-4fcf-810c-83d235e8670f-ca-trust-extracted\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.998216 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.998135 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3869bb16-98d6-4fcf-810c-83d235e8670f-installation-pull-secrets\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.998216 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.998167 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-certificates\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.998216 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:51.998196 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:51.998578 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:51.998269 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls podName:2d955896-e762-4a3b-9517-75622c75eafe nodeName:}" failed. No retries permitted until 2026-06-03 20:43:52.498246765 +0000 UTC m=+35.099473734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls") pod "dns-default-px4nq" (UID: "2d955896-e762-4a3b-9517-75622c75eafe") : secret "dns-default-metrics-tls" not found Jun 03 20:43:51.998578 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:51.998282 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:43:51.998578 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:51.998298 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b886f49b-c8rzs: secret "image-registry-tls" not found Jun 03 20:43:51.998578 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:51.998364 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls podName:3869bb16-98d6-4fcf-810c-83d235e8670f nodeName:}" failed. No retries permitted until 2026-06-03 20:43:52.49832998 +0000 UTC m=+35.099556944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls") pod "image-registry-64b886f49b-c8rzs" (UID: "3869bb16-98d6-4fcf-810c-83d235e8670f") : secret "image-registry-tls" not found Jun 03 20:43:51.998756 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.998724 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3869bb16-98d6-4fcf-810c-83d235e8670f-ca-trust-extracted\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.998801 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.998197 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.998881 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.998859 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-certificates\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.998931 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.998875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3869bb16-98d6-4fcf-810c-83d235e8670f-image-registry-private-configuration\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:51.998931 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.998924 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/618af87a-4eb4-4bc2-8f94-3915b3a005ff-cert\") pod \"ingress-canary-bjbbr\" (UID: \"618af87a-4eb4-4bc2-8f94-3915b3a005ff\") " pod="openshift-ingress-canary/ingress-canary-bjbbr" Jun 03 20:43:51.999025 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.998962 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddlp9\" (UniqueName: \"kubernetes.io/projected/2d955896-e762-4a3b-9517-75622c75eafe-kube-api-access-ddlp9\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:43:51.999025 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.998989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjr49\" (UniqueName: \"kubernetes.io/projected/618af87a-4eb4-4bc2-8f94-3915b3a005ff-kube-api-access-mjr49\") pod \"ingress-canary-bjbbr\" (UID: \"618af87a-4eb4-4bc2-8f94-3915b3a005ff\") " pod="openshift-ingress-canary/ingress-canary-bjbbr" Jun 03 20:43:51.999025 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.998992 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d955896-e762-4a3b-9517-75622c75eafe-tmp-dir\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:43:51.999025 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.999017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2d955896-e762-4a3b-9517-75622c75eafe-config-volume\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:43:51.999593 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.999554 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2d955896-e762-4a3b-9517-75622c75eafe-config-volume\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:43:51.999716 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:51.999629 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3869bb16-98d6-4fcf-810c-83d235e8670f-trusted-ca\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:52.003785 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:52.003759 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3869bb16-98d6-4fcf-810c-83d235e8670f-installation-pull-secrets\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:52.003934 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:52.003786 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/618af87a-4eb4-4bc2-8f94-3915b3a005ff-cert\") pod \"ingress-canary-bjbbr\" (UID: \"618af87a-4eb4-4bc2-8f94-3915b3a005ff\") " pod="openshift-ingress-canary/ingress-canary-bjbbr" Jun 03 20:43:52.003934 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:52.003825 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3869bb16-98d6-4fcf-810c-83d235e8670f-image-registry-private-configuration\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:52.010471 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:52.010436 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-bound-sa-token\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:52.012264 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:52.012224 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjr49\" (UniqueName: \"kubernetes.io/projected/618af87a-4eb4-4bc2-8f94-3915b3a005ff-kube-api-access-mjr49\") pod \"ingress-canary-bjbbr\" (UID: \"618af87a-4eb4-4bc2-8f94-3915b3a005ff\") " pod="openshift-ingress-canary/ingress-canary-bjbbr" Jun 03 20:43:52.012264 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:52.012252 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn7sk\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-kube-api-access-sn7sk\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:52.012563 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:52.012541 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddlp9\" (UniqueName: \"kubernetes.io/projected/2d955896-e762-4a3b-9517-75622c75eafe-kube-api-access-ddlp9\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:43:52.111048 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:52.111009 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bjbbr" Jun 03 20:43:52.122612 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:52.122581 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nklxt_c7e040c2-067d-4275-96b9-1ef76faa94da/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:52.504469 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:52.504435 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:43:52.504638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:52.504525 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:52.504638 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:52.504593 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:52.504753 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:52.504646 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:43:52.504753 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:52.504658 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b886f49b-c8rzs: secret "image-registry-tls" not found Jun 03 20:43:52.504753 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:52.504676 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls podName:2d955896-e762-4a3b-9517-75622c75eafe nodeName:}" failed. No retries permitted until 2026-06-03 20:43:53.504655408 +0000 UTC m=+36.105882380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls") pod "dns-default-px4nq" (UID: "2d955896-e762-4a3b-9517-75622c75eafe") : secret "dns-default-metrics-tls" not found Jun 03 20:43:52.504753 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:52.504693 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls podName:3869bb16-98d6-4fcf-810c-83d235e8670f nodeName:}" failed. No retries permitted until 2026-06-03 20:43:53.504683764 +0000 UTC m=+36.105910738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls") pod "image-registry-64b886f49b-c8rzs" (UID: "3869bb16-98d6-4fcf-810c-83d235e8670f") : secret "image-registry-tls" not found Jun 03 20:43:52.888530 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:52.888449 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:43:52.894926 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:52.894895 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 20:43:52.895117 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:52.895089 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t9n2b\"" Jun 03 20:43:52.895930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:52.895906 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 20:43:53.141773 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:53.141741 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bjbbr"] Jun 03 20:43:53.145220 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:43:53.145194 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod618af87a_4eb4_4bc2_8f94_3915b3a005ff.slice/crio-a1de0e177bd6756996fc669819bd982f4e970a0e74d68bb820f27d3c4ae812ee WatchSource:0}: Error finding container a1de0e177bd6756996fc669819bd982f4e970a0e74d68bb820f27d3c4ae812ee: Status 404 returned error can't find the container with id a1de0e177bd6756996fc669819bd982f4e970a0e74d68bb820f27d3c4ae812ee Jun 03 20:43:53.511895 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:53.511843 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:43:53.512080 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:53.511926 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:53.512080 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:53.512003 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:53.512080 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:53.512012 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:43:53.512080 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:53.512026 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b886f49b-c8rzs: secret "image-registry-tls" not found Jun 03 20:43:53.512080 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:53.512078 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls podName:3869bb16-98d6-4fcf-810c-83d235e8670f nodeName:}" failed. No retries permitted until 2026-06-03 20:43:55.512062036 +0000 UTC m=+38.113288996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls") pod "image-registry-64b886f49b-c8rzs" (UID: "3869bb16-98d6-4fcf-810c-83d235e8670f") : secret "image-registry-tls" not found Jun 03 20:43:53.512236 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:53.512091 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls podName:2d955896-e762-4a3b-9517-75622c75eafe nodeName:}" failed. No retries permitted until 2026-06-03 20:43:55.512085508 +0000 UTC m=+38.113312467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls") pod "dns-default-px4nq" (UID: "2d955896-e762-4a3b-9517-75622c75eafe") : secret "dns-default-metrics-tls" not found Jun 03 20:43:54.118831 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:54.118635 2577 generic.go:356] "Generic (PLEG): container finished" podID="7868b106-9752-43d7-bb61-85e9a8fe78f1" containerID="ae83034763bc4ee89d0dfbcbaa7e2e00744f734709ffe60fde4a7238da57d0ae" exitCode=0 Jun 03 20:43:54.119295 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:54.118711 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5gsw" event={"ID":"7868b106-9752-43d7-bb61-85e9a8fe78f1","Type":"ContainerDied","Data":"ae83034763bc4ee89d0dfbcbaa7e2e00744f734709ffe60fde4a7238da57d0ae"} Jun 03 20:43:54.120223 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:54.120194 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bjbbr" event={"ID":"618af87a-4eb4-4bc2-8f94-3915b3a005ff","Type":"ContainerStarted","Data":"a1de0e177bd6756996fc669819bd982f4e970a0e74d68bb820f27d3c4ae812ee"} Jun 03 20:43:55.125696 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:55.125658 2577 generic.go:356] "Generic (PLEG): container finished" podID="7868b106-9752-43d7-bb61-85e9a8fe78f1" containerID="dbf456c340b95d3070a7220573d2c3c6c0b86bb53f05d566b7147bdf4f0bf13d" exitCode=0 Jun 03 20:43:55.126131 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:55.125701 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5gsw" event={"ID":"7868b106-9752-43d7-bb61-85e9a8fe78f1","Type":"ContainerDied","Data":"dbf456c340b95d3070a7220573d2c3c6c0b86bb53f05d566b7147bdf4f0bf13d"} Jun 03 20:43:55.528324 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:55.528289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:43:55.528517 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:55.528382 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:55.528517 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:55.528458 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:55.528517 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:55.528471 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:43:55.528517 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:55.528482 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b886f49b-c8rzs: secret "image-registry-tls" not found Jun 03 20:43:55.528663 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:55.528523 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls podName:2d955896-e762-4a3b-9517-75622c75eafe nodeName:}" failed. No retries permitted until 2026-06-03 20:43:59.528506621 +0000 UTC m=+42.129733580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls") pod "dns-default-px4nq" (UID: "2d955896-e762-4a3b-9517-75622c75eafe") : secret "dns-default-metrics-tls" not found Jun 03 20:43:55.528663 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:55.528537 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls podName:3869bb16-98d6-4fcf-810c-83d235e8670f nodeName:}" failed. No retries permitted until 2026-06-03 20:43:59.528531013 +0000 UTC m=+42.129757971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls") pod "image-registry-64b886f49b-c8rzs" (UID: "3869bb16-98d6-4fcf-810c-83d235e8670f") : secret "image-registry-tls" not found Jun 03 20:43:56.131611 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:56.131581 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5gsw" event={"ID":"7868b106-9752-43d7-bb61-85e9a8fe78f1","Type":"ContainerStarted","Data":"4741dd9e3575749acea824dece82338850376f10162137066bcaeddfe49e2031"} Jun 03 20:43:56.133040 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:56.133014 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bjbbr" event={"ID":"618af87a-4eb4-4bc2-8f94-3915b3a005ff","Type":"ContainerStarted","Data":"bbb8d4aa44e48419fe6d61f2cc87bc97f9d3b20c7225883a6b036c126f8e10b4"} Jun 03 20:43:56.157519 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:56.157471 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v5gsw" podStartSLOduration=7.554981102 podStartE2EDuration="38.157455171s" totalImagesPullingTime="30.602474069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:56.155637511 +0000 UTC m=+38.756864493" watchObservedRunningTime="2026-06-03 20:43:56.157455171 +0000 UTC m=+38.758682151" Jun 03 20:43:56.173953 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:56.173906 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bjbbr" podStartSLOduration=3.142350889 podStartE2EDuration="5.173891487s" totalImagesPullingTime="2.031540598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:43:56.172990568 +0000 UTC m=+38.774217548" watchObservedRunningTime="2026-06-03 20:43:56.173891487 +0000 UTC m=+38.775118461" Jun 03 20:43:56.381035 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:56.380988 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nklxt_c7e040c2-067d-4275-96b9-1ef76faa94da/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:56.449681 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:56.449640 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nklxt_c7e040c2-067d-4275-96b9-1ef76faa94da/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:57.487557 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:57.487522 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nklxt_c7e040c2-067d-4275-96b9-1ef76faa94da/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:57.588540 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:57.588505 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nklxt_c7e040c2-067d-4275-96b9-1ef76faa94da/konnectivity-agent/0.log" limit=1024 Jun 03 20:43:59.558141 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:59.558098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:43:59.558544 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:43:59.558192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:43:59.558544 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:59.558259 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:43:59.558544 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:59.558277 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:43:59.558544 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:59.558289 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b886f49b-c8rzs: secret "image-registry-tls" not found Jun 03 20:43:59.558544 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:59.558331 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls podName:2d955896-e762-4a3b-9517-75622c75eafe nodeName:}" failed. No retries permitted until 2026-06-03 20:44:07.558313021 +0000 UTC m=+50.159539995 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls") pod "dns-default-px4nq" (UID: "2d955896-e762-4a3b-9517-75622c75eafe") : secret "dns-default-metrics-tls" not found Jun 03 20:43:59.558544 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:43:59.558364 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls podName:3869bb16-98d6-4fcf-810c-83d235e8670f nodeName:}" failed. No retries permitted until 2026-06-03 20:44:07.558357626 +0000 UTC m=+50.159584598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls") pod "image-registry-64b886f49b-c8rzs" (UID: "3869bb16-98d6-4fcf-810c-83d235e8670f") : secret "image-registry-tls" not found Jun 03 20:44:07.619768 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:07.619723 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:44:07.620185 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:07.619795 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:44:07.620185 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:44:07.619887 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:07.620185 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:44:07.619891 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:44:07.620185 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:44:07.619993 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls podName:2d955896-e762-4a3b-9517-75622c75eafe nodeName:}" failed. No retries permitted until 2026-06-03 20:44:23.619977227 +0000 UTC m=+66.221204185 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls") pod "dns-default-px4nq" (UID: "2d955896-e762-4a3b-9517-75622c75eafe") : secret "dns-default-metrics-tls" not found Jun 03 20:44:07.620185 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:44:07.619995 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b886f49b-c8rzs: secret "image-registry-tls" not found Jun 03 20:44:07.620185 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:44:07.620023 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls podName:3869bb16-98d6-4fcf-810c-83d235e8670f nodeName:}" failed. No retries permitted until 2026-06-03 20:44:23.620016913 +0000 UTC m=+66.221243872 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls") pod "image-registry-64b886f49b-c8rzs" (UID: "3869bb16-98d6-4fcf-810c-83d235e8670f") : secret "image-registry-tls" not found Jun 03 20:44:19.114527 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:19.114500 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vfvrg" Jun 03 20:44:22.726510 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:22.726462 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret\") pod \"global-pull-secret-syncer-nz55h\" (UID: \"78164361-9b18-423d-83eb-e2ddbaa78edd\") " pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:44:22.726510 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:22.726516 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs\") pod \"network-metrics-daemon-wl8bs\" (UID: \"5c12c87b-72ec-41be-8add-0584a341a706\") " pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:44:22.729782 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:22.729760 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 20:44:22.729861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:22.729759 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 20:44:22.737125 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:44:22.737101 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 20:44:22.737237 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:44:22.737179 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs podName:5c12c87b-72ec-41be-8add-0584a341a706 nodeName:}" failed. No retries permitted until 2026-06-03 20:45:26.737161693 +0000 UTC m=+129.338388652 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs") pod "network-metrics-daemon-wl8bs" (UID: "5c12c87b-72ec-41be-8add-0584a341a706") : secret "metrics-daemon-secret" not found Jun 03 20:44:22.740288 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:22.740261 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78164361-9b18-423d-83eb-e2ddbaa78edd-original-pull-secret\") pod \"global-pull-secret-syncer-nz55h\" (UID: \"78164361-9b18-423d-83eb-e2ddbaa78edd\") " pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:44:22.803138 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:22.803102 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nz55h" Jun 03 20:44:22.827568 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:22.827537 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxbc8\" (UniqueName: \"kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8\") pod \"network-check-target-hvn4f\" (UID: \"31affeb8-aa2a-40de-b080-cd2c0168abfb\") " pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:44:22.831007 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:22.830988 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 20:44:22.841441 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:22.841417 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 20:44:22.852001 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:22.851974 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxbc8\" (UniqueName: \"kubernetes.io/projected/31affeb8-aa2a-40de-b080-cd2c0168abfb-kube-api-access-kxbc8\") pod \"network-check-target-hvn4f\" (UID: \"31affeb8-aa2a-40de-b080-cd2c0168abfb\") " pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:44:22.902871 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:22.902842 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t9n2b\"" Jun 03 20:44:22.910152 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:22.910120 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:44:22.924262 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:22.924234 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nz55h"] Jun 03 20:44:22.927542 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:44:22.927519 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78164361_9b18_423d_83eb_e2ddbaa78edd.slice/crio-2892184e1e4e943bb57de190796b17f3b1a5a43ff54e4dcda8b1187944aaabc1 WatchSource:0}: Error finding container 2892184e1e4e943bb57de190796b17f3b1a5a43ff54e4dcda8b1187944aaabc1: Status 404 returned error can't find the container with id 2892184e1e4e943bb57de190796b17f3b1a5a43ff54e4dcda8b1187944aaabc1 Jun 03 20:44:23.045672 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:23.045601 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hvn4f"] Jun 03 20:44:23.048436 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:44:23.048407 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31affeb8_aa2a_40de_b080_cd2c0168abfb.slice/crio-a0842ed72a5f741f19d53a071f0d18a1346b719eb5058fadc8741d5f68a9b962 WatchSource:0}: Error finding container a0842ed72a5f741f19d53a071f0d18a1346b719eb5058fadc8741d5f68a9b962: Status 404 returned error can't find the container with id a0842ed72a5f741f19d53a071f0d18a1346b719eb5058fadc8741d5f68a9b962 Jun 03 20:44:23.199787 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:23.199749 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hvn4f" event={"ID":"31affeb8-aa2a-40de-b080-cd2c0168abfb","Type":"ContainerStarted","Data":"a0842ed72a5f741f19d53a071f0d18a1346b719eb5058fadc8741d5f68a9b962"} Jun 03 20:44:23.200797 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:23.200773 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nz55h" event={"ID":"78164361-9b18-423d-83eb-e2ddbaa78edd","Type":"ContainerStarted","Data":"2892184e1e4e943bb57de190796b17f3b1a5a43ff54e4dcda8b1187944aaabc1"} Jun 03 20:44:23.633670 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:23.633629 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:44:23.633845 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:23.633718 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:44:23.633845 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:44:23.633760 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:23.633845 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:44:23.633813 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:44:23.633845 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:44:23.633826 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b886f49b-c8rzs: secret "image-registry-tls" not found Jun 03 20:44:23.633845 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:44:23.633832 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls podName:2d955896-e762-4a3b-9517-75622c75eafe nodeName:}" failed. No retries permitted until 2026-06-03 20:44:55.633812445 +0000 UTC m=+98.235039419 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls") pod "dns-default-px4nq" (UID: "2d955896-e762-4a3b-9517-75622c75eafe") : secret "dns-default-metrics-tls" not found Jun 03 20:44:23.634092 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:44:23.633860 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls podName:3869bb16-98d6-4fcf-810c-83d235e8670f nodeName:}" failed. No retries permitted until 2026-06-03 20:44:55.633850082 +0000 UTC m=+98.235077055 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls") pod "image-registry-64b886f49b-c8rzs" (UID: "3869bb16-98d6-4fcf-810c-83d235e8670f") : secret "image-registry-tls" not found Jun 03 20:44:28.214808 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:28.214771 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nz55h" event={"ID":"78164361-9b18-423d-83eb-e2ddbaa78edd","Type":"ContainerStarted","Data":"03133750f0ec9cb91c4eaded7e32818913afb24fe510212ee1bc432f7a20d3dc"} Jun 03 20:44:28.216135 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:28.216107 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hvn4f" event={"ID":"31affeb8-aa2a-40de-b080-cd2c0168abfb","Type":"ContainerStarted","Data":"50b6123279e967842a166209faf48de6b660537a1d916f94541fdc5aea1cc533"} Jun 03 20:44:28.216268 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:28.216168 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:44:28.231967 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:28.231917 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nz55h" podStartSLOduration=65.781856136 podStartE2EDuration="1m10.231902821s" totalImagesPullingTime="4.450046685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:28.231411795 +0000 UTC m=+70.832638788" watchObservedRunningTime="2026-06-03 20:44:28.231902821 +0000 UTC m=+70.833129802" Jun 03 20:44:28.249049 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:28.249002 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hvn4f" podStartSLOduration=65.923157009 podStartE2EDuration="1m10.248986827s" totalImagesPullingTime="4.325829818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:44:28.248805657 +0000 UTC m=+70.850032638" watchObservedRunningTime="2026-06-03 20:44:28.248986827 +0000 UTC m=+70.850213809" Jun 03 20:44:55.664720 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:55.664685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:44:55.665269 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:55.664739 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:44:55.665269 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:44:55.664842 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:44:55.665269 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:44:55.664857 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:44:55.665269 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:44:55.664883 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b886f49b-c8rzs: secret "image-registry-tls" not found Jun 03 20:44:55.665269 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:44:55.664895 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls podName:2d955896-e762-4a3b-9517-75622c75eafe nodeName:}" failed. No retries permitted until 2026-06-03 20:45:59.664881507 +0000 UTC m=+162.266108466 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls") pod "dns-default-px4nq" (UID: "2d955896-e762-4a3b-9517-75622c75eafe") : secret "dns-default-metrics-tls" not found Jun 03 20:44:55.665269 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:44:55.664956 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls podName:3869bb16-98d6-4fcf-810c-83d235e8670f nodeName:}" failed. No retries permitted until 2026-06-03 20:45:59.664938524 +0000 UTC m=+162.266165505 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls") pod "image-registry-64b886f49b-c8rzs" (UID: "3869bb16-98d6-4fcf-810c-83d235e8670f") : secret "image-registry-tls" not found Jun 03 20:44:59.221024 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:44:59.220995 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hvn4f" Jun 03 20:45:26.785906 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:45:26.785855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs\") pod \"network-metrics-daemon-wl8bs\" (UID: \"5c12c87b-72ec-41be-8add-0584a341a706\") " pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:45:26.786441 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:45:26.786017 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 20:45:26.786441 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:45:26.786089 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs podName:5c12c87b-72ec-41be-8add-0584a341a706 nodeName:}" failed. No retries permitted until 2026-06-03 20:47:28.786072271 +0000 UTC m=+251.387299230 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs") pod "network-metrics-daemon-wl8bs" (UID: "5c12c87b-72ec-41be-8add-0584a341a706") : secret "metrics-daemon-secret" not found Jun 03 20:45:54.788662 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:45:54.788543 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" podUID="3869bb16-98d6-4fcf-810c-83d235e8670f" Jun 03 20:45:54.805952 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:45:54.805903 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-px4nq" podUID="2d955896-e762-4a3b-9517-75622c75eafe" Jun 03 20:45:54.909010 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:45:54.908953 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wl8bs" podUID="5c12c87b-72ec-41be-8add-0584a341a706" Jun 03 20:45:55.420635 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:45:55.420596 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-px4nq" Jun 03 20:45:55.420852 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:45:55.420596 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:45:59.718533 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:45:59.718490 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:45:59.718969 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:45:59.718559 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:45:59.718969 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:45:59.718645 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 20:45:59.718969 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:45:59.718666 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b886f49b-c8rzs: secret "image-registry-tls" not found Jun 03 20:45:59.718969 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:45:59.718667 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 20:45:59.718969 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:45:59.718724 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls podName:3869bb16-98d6-4fcf-810c-83d235e8670f nodeName:}" failed. No retries permitted until 2026-06-03 20:48:01.718708727 +0000 UTC m=+284.319935687 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls") pod "image-registry-64b886f49b-c8rzs" (UID: "3869bb16-98d6-4fcf-810c-83d235e8670f") : secret "image-registry-tls" not found Jun 03 20:45:59.718969 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:45:59.718739 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls podName:2d955896-e762-4a3b-9517-75622c75eafe nodeName:}" failed. No retries permitted until 2026-06-03 20:48:01.718733173 +0000 UTC m=+284.319960132 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls") pod "dns-default-px4nq" (UID: "2d955896-e762-4a3b-9517-75622c75eafe") : secret "dns-default-metrics-tls" not found Jun 03 20:46:08.888829 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:08.888780 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:46:47.364822 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.364771 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fgqmn"] Jun 03 20:46:47.366775 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.366753 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6"] Jun 03 20:46:47.366916 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.366872 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fgqmn" Jun 03 20:46:47.368428 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.368409 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-69684796bc-mt8bs"] Jun 03 20:46:47.368537 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.368521 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6" Jun 03 20:46:47.369583 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.369560 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:46:47.369670 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.369605 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xpbgh\"" Jun 03 20:46:47.370028 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.370000 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw"] Jun 03 20:46:47.370153 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.370136 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.371082 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.371064 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:46:47.371159 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.371064 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 20:46:47.371159 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.371069 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 20:46:47.371494 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.371479 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 20:46:47.371670 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.371650 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-px9d2\"" Jun 03 20:46:47.371787 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.371771 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" Jun 03 20:46:47.372511 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.372494 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 20:46:47.372711 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.372695 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 20:46:47.372964 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.372941 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 20:46:47.373134 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.372968 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 20:46:47.373134 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.373025 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jxmv6\"" Jun 03 20:46:47.374673 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.374325 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 20:46:47.375093 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.375079 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 20:46:47.375477 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.375448 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 20:46:47.375477 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.375466 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 20:46:47.375651 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.375499 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qgw29\"" Jun 03 20:46:47.375781 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.375767 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 20:46:47.379634 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.379609 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 20:46:47.380915 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.380888 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6"] Jun 03 20:46:47.381843 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.381821 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fgqmn"] Jun 03 20:46:47.383942 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.383921 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-mt8bs"] Jun 03 20:46:47.386251 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.386229 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw"] Jun 03 20:46:47.447984 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.447950 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39a33de3-9405-411b-8924-8ff39d3fc516-trusted-ca-bundle\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.447984 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.447990 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39a33de3-9405-411b-8924-8ff39d3fc516-snapshots\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.448200 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.448011 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86402679-3f8d-487e-80cd-df90bb52ca76-serving-cert\") pod \"service-ca-operator-5bc4cf794b-t5sd6\" (UID: \"86402679-3f8d-487e-80cd-df90bb52ca76\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6" Jun 03 20:46:47.448200 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.448033 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl7vf\" (UniqueName: \"kubernetes.io/projected/86402679-3f8d-487e-80cd-df90bb52ca76-kube-api-access-kl7vf\") pod \"service-ca-operator-5bc4cf794b-t5sd6\" (UID: \"86402679-3f8d-487e-80cd-df90bb52ca76\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6" Jun 03 20:46:47.448200 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.448080 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a57c6adc-7ae5-4ab4-b440-27573322eedd-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-57lpw\" (UID: \"a57c6adc-7ae5-4ab4-b440-27573322eedd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" Jun 03 20:46:47.448200 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.448096 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7gvn\" (UniqueName: \"kubernetes.io/projected/1a3565a2-ee2f-4973-b4f5-081d94ea18d0-kube-api-access-h7gvn\") pod \"volume-data-source-validator-78dd696465-fgqmn\" (UID: \"1a3565a2-ee2f-4973-b4f5-081d94ea18d0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fgqmn" Jun 03 20:46:47.448200 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.448146 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xfml\" (UniqueName: \"kubernetes.io/projected/39a33de3-9405-411b-8924-8ff39d3fc516-kube-api-access-2xfml\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.448200 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.448173 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/86402679-3f8d-487e-80cd-df90bb52ca76-config\") pod \"service-ca-operator-5bc4cf794b-t5sd6\" (UID: \"86402679-3f8d-487e-80cd-df90bb52ca76\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6" Jun 03 20:46:47.448200 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.448197 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-57lpw\" (UID: \"a57c6adc-7ae5-4ab4-b440-27573322eedd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" Jun 03 20:46:47.448434 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.448217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39a33de3-9405-411b-8924-8ff39d3fc516-serving-cert\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.448434 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.448250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39a33de3-9405-411b-8924-8ff39d3fc516-service-ca-bundle\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.448434 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.448278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlzzv\" (UniqueName: \"kubernetes.io/projected/a57c6adc-7ae5-4ab4-b440-27573322eedd-kube-api-access-zlzzv\") pod \"cluster-monitoring-operator-57769895dd-57lpw\" (UID: \"a57c6adc-7ae5-4ab4-b440-27573322eedd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" Jun 03 20:46:47.448434 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.448300 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39a33de3-9405-411b-8924-8ff39d3fc516-tmp\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.463621 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.463584 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-d56v4"] Jun 03 20:46:47.465715 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.465697 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st"] Jun 03 20:46:47.465839 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.465824 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-d56v4" Jun 03 20:46:47.467520 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.467500 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st" Jun 03 20:46:47.473641 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.473620 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-j2w5r\"" Jun 03 20:46:47.474323 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.474302 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8fmvn\"" Jun 03 20:46:47.476979 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.476963 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:46:47.477184 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.477167 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 20:46:47.477246 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.477206 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 20:46:47.480773 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.480752 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st"] Jun 03 20:46:47.486895 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.485445 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-d56v4"] Jun 03 20:46:47.549091 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.549057 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39a33de3-9405-411b-8924-8ff39d3fc516-trusted-ca-bundle\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.549091 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.549092 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39a33de3-9405-411b-8924-8ff39d3fc516-snapshots\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.549402 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.549112 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86402679-3f8d-487e-80cd-df90bb52ca76-serving-cert\") pod \"service-ca-operator-5bc4cf794b-t5sd6\" (UID: \"86402679-3f8d-487e-80cd-df90bb52ca76\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6" Jun 03 20:46:47.549402 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.549128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl7vf\" (UniqueName: \"kubernetes.io/projected/86402679-3f8d-487e-80cd-df90bb52ca76-kube-api-access-kl7vf\") pod \"service-ca-operator-5bc4cf794b-t5sd6\" (UID: \"86402679-3f8d-487e-80cd-df90bb52ca76\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6" Jun 03 20:46:47.549402 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.549191 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fgtd\" (UniqueName: \"kubernetes.io/projected/49622be1-13fd-4045-bafb-11ed28cc18bd-kube-api-access-8fgtd\") pod \"network-check-source-dbd9cf844-d56v4\" (UID: \"49622be1-13fd-4045-bafb-11ed28cc18bd\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-d56v4" Jun 03 20:46:47.549402 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.549256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a57c6adc-7ae5-4ab4-b440-27573322eedd-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-57lpw\" (UID: \"a57c6adc-7ae5-4ab4-b440-27573322eedd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" Jun 03 20:46:47.549402 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.549303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7gvn\" (UniqueName: \"kubernetes.io/projected/1a3565a2-ee2f-4973-b4f5-081d94ea18d0-kube-api-access-h7gvn\") pod \"volume-data-source-validator-78dd696465-fgqmn\" (UID: \"1a3565a2-ee2f-4973-b4f5-081d94ea18d0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fgqmn" Jun 03 20:46:47.549402 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.549371 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xfml\" (UniqueName: \"kubernetes.io/projected/39a33de3-9405-411b-8924-8ff39d3fc516-kube-api-access-2xfml\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.549402 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.549399 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/86402679-3f8d-487e-80cd-df90bb52ca76-config\") pod \"service-ca-operator-5bc4cf794b-t5sd6\" (UID: \"86402679-3f8d-487e-80cd-df90bb52ca76\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6" Jun 03 20:46:47.549797 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.549427 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-57lpw\" (UID: \"a57c6adc-7ae5-4ab4-b440-27573322eedd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" Jun 03 20:46:47.549797 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:47.549514 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:47.549797 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:47.549582 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls podName:a57c6adc-7ae5-4ab4-b440-27573322eedd nodeName:}" failed. No retries permitted until 2026-06-03 20:46:48.049562669 +0000 UTC m=+210.650789636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-57lpw" (UID: "a57c6adc-7ae5-4ab4-b440-27573322eedd") : secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:47.549797 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.549598 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39a33de3-9405-411b-8924-8ff39d3fc516-serving-cert\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.549797 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.549645 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39a33de3-9405-411b-8924-8ff39d3fc516-service-ca-bundle\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.549797 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.549694 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlzzv\" (UniqueName: \"kubernetes.io/projected/a57c6adc-7ae5-4ab4-b440-27573322eedd-kube-api-access-zlzzv\") pod \"cluster-monitoring-operator-57769895dd-57lpw\" (UID: \"a57c6adc-7ae5-4ab4-b440-27573322eedd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" Jun 03 20:46:47.549797 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.549722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-6x9st\" (UID: \"eba17ab8-bc46-425f-bbae-9dfcc5510456\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st" Jun 03 20:46:47.549797 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.549756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39a33de3-9405-411b-8924-8ff39d3fc516-tmp\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.549797 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.549790 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnsrv\" (UniqueName: \"kubernetes.io/projected/eba17ab8-bc46-425f-bbae-9dfcc5510456-kube-api-access-cnsrv\") pod \"cluster-samples-operator-9f6f677f5-6x9st\" (UID: \"eba17ab8-bc46-425f-bbae-9dfcc5510456\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st" Jun 03 20:46:47.550259 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.549955 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39a33de3-9405-411b-8924-8ff39d3fc516-snapshots\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.550259 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.550134 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a57c6adc-7ae5-4ab4-b440-27573322eedd-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-57lpw\" (UID: \"a57c6adc-7ae5-4ab4-b440-27573322eedd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" Jun 03 20:46:47.550259 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.550147 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/86402679-3f8d-487e-80cd-df90bb52ca76-config\") pod \"service-ca-operator-5bc4cf794b-t5sd6\" (UID: \"86402679-3f8d-487e-80cd-df90bb52ca76\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6" Jun 03 20:46:47.550436 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.550313 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39a33de3-9405-411b-8924-8ff39d3fc516-service-ca-bundle\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.550436 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.550333 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39a33de3-9405-411b-8924-8ff39d3fc516-trusted-ca-bundle\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.550436 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.550376 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39a33de3-9405-411b-8924-8ff39d3fc516-tmp\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.551703 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.551677 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86402679-3f8d-487e-80cd-df90bb52ca76-serving-cert\") pod \"service-ca-operator-5bc4cf794b-t5sd6\" (UID: \"86402679-3f8d-487e-80cd-df90bb52ca76\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6" Jun 03 20:46:47.552013 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.551997 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39a33de3-9405-411b-8924-8ff39d3fc516-serving-cert\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.558797 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.558769 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-cdm7x"] Jun 03 20:46:47.561745 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.561718 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl7vf\" (UniqueName: \"kubernetes.io/projected/86402679-3f8d-487e-80cd-df90bb52ca76-kube-api-access-kl7vf\") pod \"service-ca-operator-5bc4cf794b-t5sd6\" (UID: \"86402679-3f8d-487e-80cd-df90bb52ca76\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6" Jun 03 20:46:47.561891 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.561873 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-cdm7x" Jun 03 20:46:47.562215 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.562072 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7gvn\" (UniqueName: \"kubernetes.io/projected/1a3565a2-ee2f-4973-b4f5-081d94ea18d0-kube-api-access-h7gvn\") pod \"volume-data-source-validator-78dd696465-fgqmn\" (UID: \"1a3565a2-ee2f-4973-b4f5-081d94ea18d0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fgqmn" Jun 03 20:46:47.562215 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.562117 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xfml\" (UniqueName: \"kubernetes.io/projected/39a33de3-9405-411b-8924-8ff39d3fc516-kube-api-access-2xfml\") pod \"insights-operator-69684796bc-mt8bs\" (UID: \"39a33de3-9405-411b-8924-8ff39d3fc516\") " pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.562389 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.562302 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlzzv\" (UniqueName: \"kubernetes.io/projected/a57c6adc-7ae5-4ab4-b440-27573322eedd-kube-api-access-zlzzv\") pod \"cluster-monitoring-operator-57769895dd-57lpw\" (UID: \"a57c6adc-7ae5-4ab4-b440-27573322eedd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" Jun 03 20:46:47.564309 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.564291 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 20:46:47.564477 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.564318 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 20:46:47.564477 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.564420 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-k8v7j\"" Jun 03 20:46:47.569311 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.569289 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-cdm7x"] Jun 03 20:46:47.651022 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.650924 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-6x9st\" (UID: \"eba17ab8-bc46-425f-bbae-9dfcc5510456\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st" Jun 03 20:46:47.651022 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.650970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-nginx-conf\") pod \"networking-console-plugin-68d6b54856-cdm7x\" (UID: \"9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-cdm7x" Jun 03 20:46:47.651022 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.650995 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnsrv\" (UniqueName: \"kubernetes.io/projected/eba17ab8-bc46-425f-bbae-9dfcc5510456-kube-api-access-cnsrv\") pod \"cluster-samples-operator-9f6f677f5-6x9st\" (UID: \"eba17ab8-bc46-425f-bbae-9dfcc5510456\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st" Jun 03 20:46:47.651247 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.651048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fgtd\" (UniqueName: \"kubernetes.io/projected/49622be1-13fd-4045-bafb-11ed28cc18bd-kube-api-access-8fgtd\") pod \"network-check-source-dbd9cf844-d56v4\" (UID: \"49622be1-13fd-4045-bafb-11ed28cc18bd\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-d56v4" Jun 03 20:46:47.651247 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.651104 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-cdm7x\" (UID: \"9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-cdm7x" Jun 03 20:46:47.651247 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:47.651110 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 20:46:47.651247 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:47.651182 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls podName:eba17ab8-bc46-425f-bbae-9dfcc5510456 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:48.151165397 +0000 UTC m=+210.752392355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-6x9st" (UID: "eba17ab8-bc46-425f-bbae-9dfcc5510456") : secret "samples-operator-tls" not found Jun 03 20:46:47.663677 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.663647 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnsrv\" (UniqueName: \"kubernetes.io/projected/eba17ab8-bc46-425f-bbae-9dfcc5510456-kube-api-access-cnsrv\") pod \"cluster-samples-operator-9f6f677f5-6x9st\" (UID: \"eba17ab8-bc46-425f-bbae-9dfcc5510456\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st" Jun 03 20:46:47.663866 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.663848 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fgtd\" (UniqueName: \"kubernetes.io/projected/49622be1-13fd-4045-bafb-11ed28cc18bd-kube-api-access-8fgtd\") pod \"network-check-source-dbd9cf844-d56v4\" (UID: \"49622be1-13fd-4045-bafb-11ed28cc18bd\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-d56v4" Jun 03 20:46:47.678627 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.678593 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fgqmn" Jun 03 20:46:47.687747 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.687727 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6" Jun 03 20:46:47.694660 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.694636 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-mt8bs" Jun 03 20:46:47.752440 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.752110 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-cdm7x\" (UID: \"9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-cdm7x" Jun 03 20:46:47.752440 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:47.752168 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 20:46:47.752440 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.752230 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-nginx-conf\") pod \"networking-console-plugin-68d6b54856-cdm7x\" (UID: \"9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-cdm7x" Jun 03 20:46:47.752440 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:47.752248 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert podName:9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:48.25222511 +0000 UTC m=+210.853452087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-cdm7x" (UID: "9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5") : secret "networking-console-plugin-cert" not found Jun 03 20:46:47.753590 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.753535 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-nginx-conf\") pod \"networking-console-plugin-68d6b54856-cdm7x\" (UID: \"9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-cdm7x" Jun 03 20:46:47.775725 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.775593 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-d56v4" Jun 03 20:46:47.824684 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.824649 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fgqmn"] Jun 03 20:46:47.828621 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:46:47.828588 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a3565a2_ee2f_4973_b4f5_081d94ea18d0.slice/crio-d5f82c124717bb9cf180528927cff49d947bbfb82353aac411420304625c74b6 WatchSource:0}: Error finding container d5f82c124717bb9cf180528927cff49d947bbfb82353aac411420304625c74b6: Status 404 returned error can't find the container with id d5f82c124717bb9cf180528927cff49d947bbfb82353aac411420304625c74b6 Jun 03 20:46:47.845994 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.845961 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-mt8bs"] Jun 03 20:46:47.920756 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:47.920711 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-d56v4"] Jun 03 20:46:47.923080 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:46:47.923040 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49622be1_13fd_4045_bafb_11ed28cc18bd.slice/crio-ad380edd2a6b3bf1ce18e4b2c824e4917c2adb0775012cd2cdca45d926a14a2a WatchSource:0}: Error finding container ad380edd2a6b3bf1ce18e4b2c824e4917c2adb0775012cd2cdca45d926a14a2a: Status 404 returned error can't find the container with id ad380edd2a6b3bf1ce18e4b2c824e4917c2adb0775012cd2cdca45d926a14a2a Jun 03 20:46:48.049629 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:48.049597 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6"] Jun 03 20:46:48.053093 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:46:48.053063 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86402679_3f8d_487e_80cd_df90bb52ca76.slice/crio-10f154d519b3f74469c031ff6802de0e93774a4c92935109ef3064c58fff8de1 WatchSource:0}: Error finding container 10f154d519b3f74469c031ff6802de0e93774a4c92935109ef3064c58fff8de1: Status 404 returned error can't find the container with id 10f154d519b3f74469c031ff6802de0e93774a4c92935109ef3064c58fff8de1 Jun 03 20:46:48.054442 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:48.054415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-57lpw\" (UID: \"a57c6adc-7ae5-4ab4-b440-27573322eedd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" Jun 03 20:46:48.054563 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:48.054550 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:48.054641 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:48.054627 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls podName:a57c6adc-7ae5-4ab4-b440-27573322eedd nodeName:}" failed. No retries permitted until 2026-06-03 20:46:49.054606377 +0000 UTC m=+211.655833338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-57lpw" (UID: "a57c6adc-7ae5-4ab4-b440-27573322eedd") : secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:48.155396 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:48.155357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-6x9st\" (UID: \"eba17ab8-bc46-425f-bbae-9dfcc5510456\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st" Jun 03 20:46:48.155571 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:48.155500 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 20:46:48.155571 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:48.155565 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls podName:eba17ab8-bc46-425f-bbae-9dfcc5510456 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:49.155549809 +0000 UTC m=+211.756776769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-6x9st" (UID: "eba17ab8-bc46-425f-bbae-9dfcc5510456") : secret "samples-operator-tls" not found Jun 03 20:46:48.256526 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:48.255890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-cdm7x\" (UID: \"9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-cdm7x" Jun 03 20:46:48.256526 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:48.256074 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 20:46:48.256526 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:48.256145 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert podName:9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:49.256125245 +0000 UTC m=+211.857352207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-cdm7x" (UID: "9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5") : secret "networking-console-plugin-cert" not found Jun 03 20:46:48.553280 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:48.553187 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-mt8bs" event={"ID":"39a33de3-9405-411b-8924-8ff39d3fc516","Type":"ContainerStarted","Data":"3ac96fc06bf158a43861452d20158b6e18cc12ec5a9a64652f226b67b9c18f56"} Jun 03 20:46:48.554791 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:48.554721 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fgqmn" event={"ID":"1a3565a2-ee2f-4973-b4f5-081d94ea18d0","Type":"ContainerStarted","Data":"d5f82c124717bb9cf180528927cff49d947bbfb82353aac411420304625c74b6"} Jun 03 20:46:48.557165 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:48.556988 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-d56v4" event={"ID":"49622be1-13fd-4045-bafb-11ed28cc18bd","Type":"ContainerStarted","Data":"3f16613ad60cd7fcf81f47692b2fe7770abfdb066bbae458fe295f6ddccd2727"} Jun 03 20:46:48.557165 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:48.557030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-d56v4" event={"ID":"49622be1-13fd-4045-bafb-11ed28cc18bd","Type":"ContainerStarted","Data":"ad380edd2a6b3bf1ce18e4b2c824e4917c2adb0775012cd2cdca45d926a14a2a"} Jun 03 20:46:48.559458 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:48.559431 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6" event={"ID":"86402679-3f8d-487e-80cd-df90bb52ca76","Type":"ContainerStarted","Data":"10f154d519b3f74469c031ff6802de0e93774a4c92935109ef3064c58fff8de1"} Jun 03 20:46:48.574132 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:48.573085 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-d56v4" podStartSLOduration=1.573064118 podStartE2EDuration="1.573064118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:46:48.571727004 +0000 UTC m=+211.172953988" watchObservedRunningTime="2026-06-03 20:46:48.573064118 +0000 UTC m=+211.174291099" Jun 03 20:46:49.062950 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:49.062903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-57lpw\" (UID: \"a57c6adc-7ae5-4ab4-b440-27573322eedd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" Jun 03 20:46:49.063172 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:49.063067 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:49.063172 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:49.063149 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls podName:a57c6adc-7ae5-4ab4-b440-27573322eedd nodeName:}" failed. No retries permitted until 2026-06-03 20:46:51.06312704 +0000 UTC m=+213.664354022 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-57lpw" (UID: "a57c6adc-7ae5-4ab4-b440-27573322eedd") : secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:49.163625 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:49.163494 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-6x9st\" (UID: \"eba17ab8-bc46-425f-bbae-9dfcc5510456\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st" Jun 03 20:46:49.163812 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:49.163692 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 20:46:49.163812 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:49.163771 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls podName:eba17ab8-bc46-425f-bbae-9dfcc5510456 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:51.16375045 +0000 UTC m=+213.764977409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-6x9st" (UID: "eba17ab8-bc46-425f-bbae-9dfcc5510456") : secret "samples-operator-tls" not found Jun 03 20:46:49.264245 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:49.264199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-cdm7x\" (UID: \"9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-cdm7x" Jun 03 20:46:49.264476 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:49.264370 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 20:46:49.264476 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:49.264446 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert podName:9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:51.264424936 +0000 UTC m=+213.865651913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-cdm7x" (UID: "9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5") : secret "networking-console-plugin-cert" not found Jun 03 20:46:49.569371 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:49.569312 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fgqmn" event={"ID":"1a3565a2-ee2f-4973-b4f5-081d94ea18d0","Type":"ContainerStarted","Data":"adcf44a0917d412a33c7a27d994126f1cbe547a92c1d8aa310a7d8b6b9a59bc8"} Jun 03 20:46:49.587698 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:49.587630 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-fgqmn" podStartSLOduration=1.5377682419999998 podStartE2EDuration="2.587610167s" totalImagesPullingTime="1.049841925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:46:49.586538445 +0000 UTC m=+212.187765428" watchObservedRunningTime="2026-06-03 20:46:49.587610167 +0000 UTC m=+212.188837148" Jun 03 20:46:50.574426 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:50.574315 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-mt8bs" event={"ID":"39a33de3-9405-411b-8924-8ff39d3fc516","Type":"ContainerStarted","Data":"9ec85274ee23c2b947ba70dfe416a7e37e5f29994a7b60b27dc4ad3b7c5bd0ea"} Jun 03 20:46:50.576007 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:50.575974 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6" event={"ID":"86402679-3f8d-487e-80cd-df90bb52ca76","Type":"ContainerStarted","Data":"ad5ab78671ee9f15dcae06ef9f102a13e339bf9d19d8d9589e4b0f6ee38a92d5"} Jun 03 20:46:50.605314 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:50.605264 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-69684796bc-mt8bs" podStartSLOduration=1.247966995 podStartE2EDuration="3.605248155s" totalImagesPullingTime="2.35728116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:46:50.604380435 +0000 UTC m=+213.205607412" watchObservedRunningTime="2026-06-03 20:46:50.605248155 +0000 UTC m=+213.206475135" Jun 03 20:46:50.630498 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:50.630440 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6" podStartSLOduration=1.472690272 podStartE2EDuration="3.630423884s" totalImagesPullingTime="2.157733612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:46:50.629888149 +0000 UTC m=+213.231115130" watchObservedRunningTime="2026-06-03 20:46:50.630423884 +0000 UTC m=+213.231650865" Jun 03 20:46:51.081038 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:51.080993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-57lpw\" (UID: \"a57c6adc-7ae5-4ab4-b440-27573322eedd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" Jun 03 20:46:51.081200 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:51.081172 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:51.081260 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:51.081253 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls podName:a57c6adc-7ae5-4ab4-b440-27573322eedd nodeName:}" failed. No retries permitted until 2026-06-03 20:46:55.081232446 +0000 UTC m=+217.682459406 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-57lpw" (UID: "a57c6adc-7ae5-4ab4-b440-27573322eedd") : secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:51.182054 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:51.182015 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-6x9st\" (UID: \"eba17ab8-bc46-425f-bbae-9dfcc5510456\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st" Jun 03 20:46:51.182193 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:51.182160 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 20:46:51.182253 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:51.182239 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls podName:eba17ab8-bc46-425f-bbae-9dfcc5510456 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:55.182223839 +0000 UTC m=+217.783450798 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-6x9st" (UID: "eba17ab8-bc46-425f-bbae-9dfcc5510456") : secret "samples-operator-tls" not found Jun 03 20:46:51.283271 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:51.283229 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-cdm7x\" (UID: \"9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-cdm7x" Jun 03 20:46:51.283431 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:51.283401 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 20:46:51.283478 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:51.283467 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert podName:9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5 nodeName:}" failed. No retries permitted until 2026-06-03 20:46:55.283449161 +0000 UTC m=+217.884676141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-cdm7x" (UID: "9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5") : secret "networking-console-plugin-cert" not found Jun 03 20:46:51.472756 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:51.472722 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-9jzw4"] Jun 03 20:46:51.474802 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:51.474787 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9jzw4" Jun 03 20:46:51.477249 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:51.477222 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 20:46:51.478363 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:51.478317 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-vkl9t\"" Jun 03 20:46:51.478459 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:51.478365 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 20:46:51.485581 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:51.485554 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-9jzw4"] Jun 03 20:46:51.585418 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:51.585382 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8528\" (UniqueName: \"kubernetes.io/projected/9d5c4ec5-ee59-4b2f-92ef-f05064f53bc4-kube-api-access-l8528\") pod \"migrator-955ffdf5f-9jzw4\" (UID: \"9d5c4ec5-ee59-4b2f-92ef-f05064f53bc4\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9jzw4" Jun 03 20:46:51.686454 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:51.686415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8528\" (UniqueName: \"kubernetes.io/projected/9d5c4ec5-ee59-4b2f-92ef-f05064f53bc4-kube-api-access-l8528\") pod \"migrator-955ffdf5f-9jzw4\" (UID: \"9d5c4ec5-ee59-4b2f-92ef-f05064f53bc4\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9jzw4" Jun 03 20:46:51.698394 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:51.698360 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8528\" (UniqueName: \"kubernetes.io/projected/9d5c4ec5-ee59-4b2f-92ef-f05064f53bc4-kube-api-access-l8528\") pod \"migrator-955ffdf5f-9jzw4\" (UID: \"9d5c4ec5-ee59-4b2f-92ef-f05064f53bc4\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9jzw4" Jun 03 20:46:51.784423 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:51.784308 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9jzw4" Jun 03 20:46:51.908607 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:51.908576 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-9jzw4"] Jun 03 20:46:51.911488 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:46:51.911463 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d5c4ec5_ee59_4b2f_92ef_f05064f53bc4.slice/crio-a44a849e4d890670c26c9ffd1f7cf89d0b7876de41ec70a9cb62efd0b76918ac WatchSource:0}: Error finding container a44a849e4d890670c26c9ffd1f7cf89d0b7876de41ec70a9cb62efd0b76918ac: Status 404 returned error can't find the container with id a44a849e4d890670c26c9ffd1f7cf89d0b7876de41ec70a9cb62efd0b76918ac Jun 03 20:46:52.583533 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:52.583497 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9jzw4" event={"ID":"9d5c4ec5-ee59-4b2f-92ef-f05064f53bc4","Type":"ContainerStarted","Data":"a44a849e4d890670c26c9ffd1f7cf89d0b7876de41ec70a9cb62efd0b76918ac"} Jun 03 20:46:53.588448 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:53.588404 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9jzw4" event={"ID":"9d5c4ec5-ee59-4b2f-92ef-f05064f53bc4","Type":"ContainerStarted","Data":"a9a12293c2394d4ed868bd3eeb811af6b3b819f810bbc9383172702b19c3aaf9"} Jun 03 20:46:53.588921 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:53.588487 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9jzw4" event={"ID":"9d5c4ec5-ee59-4b2f-92ef-f05064f53bc4","Type":"ContainerStarted","Data":"0fa47f29a15278a1d45954e4b454b9351e685716445440103c1728a8c1700075"} Jun 03 20:46:53.605468 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:53.605421 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-9jzw4" podStartSLOduration=1.693976879 podStartE2EDuration="2.605405303s" totalImagesPullingTime="911.428424ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:46:53.605035474 +0000 UTC m=+216.206262458" watchObservedRunningTime="2026-06-03 20:46:53.605405303 +0000 UTC m=+216.206632284" Jun 03 20:46:53.897467 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:53.897382 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-zvwgt"] Jun 03 20:46:53.900368 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:53.900333 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-zvwgt" Jun 03 20:46:53.902876 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:53.902820 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 20:46:53.902876 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:53.902842 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 20:46:53.903078 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:53.902845 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xdncc\"" Jun 03 20:46:53.903078 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:53.902839 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 20:46:53.903818 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:53.903787 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 20:46:53.908375 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:53.908330 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-zvwgt"] Jun 03 20:46:54.004112 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:54.004077 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2198b076-9cef-4c79-a8cc-ec263794768c-signing-cabundle\") pod \"service-ca-7d74d578b8-zvwgt\" (UID: \"2198b076-9cef-4c79-a8cc-ec263794768c\") " pod="openshift-service-ca/service-ca-7d74d578b8-zvwgt" Jun 03 20:46:54.004304 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:54.004150 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7vlx\" (UniqueName: \"kubernetes.io/projected/2198b076-9cef-4c79-a8cc-ec263794768c-kube-api-access-k7vlx\") pod \"service-ca-7d74d578b8-zvwgt\" (UID: \"2198b076-9cef-4c79-a8cc-ec263794768c\") " pod="openshift-service-ca/service-ca-7d74d578b8-zvwgt" Jun 03 20:46:54.004304 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:54.004222 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2198b076-9cef-4c79-a8cc-ec263794768c-signing-key\") pod \"service-ca-7d74d578b8-zvwgt\" (UID: \"2198b076-9cef-4c79-a8cc-ec263794768c\") " pod="openshift-service-ca/service-ca-7d74d578b8-zvwgt" Jun 03 20:46:54.104747 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:54.104705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7vlx\" (UniqueName: \"kubernetes.io/projected/2198b076-9cef-4c79-a8cc-ec263794768c-kube-api-access-k7vlx\") pod \"service-ca-7d74d578b8-zvwgt\" (UID: \"2198b076-9cef-4c79-a8cc-ec263794768c\") " pod="openshift-service-ca/service-ca-7d74d578b8-zvwgt" Jun 03 20:46:54.104924 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:54.104780 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2198b076-9cef-4c79-a8cc-ec263794768c-signing-key\") pod \"service-ca-7d74d578b8-zvwgt\" (UID: \"2198b076-9cef-4c79-a8cc-ec263794768c\") " pod="openshift-service-ca/service-ca-7d74d578b8-zvwgt" Jun 03 20:46:54.104924 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:54.104823 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2198b076-9cef-4c79-a8cc-ec263794768c-signing-cabundle\") pod \"service-ca-7d74d578b8-zvwgt\" (UID: \"2198b076-9cef-4c79-a8cc-ec263794768c\") " pod="openshift-service-ca/service-ca-7d74d578b8-zvwgt" Jun 03 20:46:54.105557 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:54.105532 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2198b076-9cef-4c79-a8cc-ec263794768c-signing-cabundle\") pod \"service-ca-7d74d578b8-zvwgt\" (UID: \"2198b076-9cef-4c79-a8cc-ec263794768c\") " pod="openshift-service-ca/service-ca-7d74d578b8-zvwgt" Jun 03 20:46:54.107316 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:54.107299 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2198b076-9cef-4c79-a8cc-ec263794768c-signing-key\") pod \"service-ca-7d74d578b8-zvwgt\" (UID: \"2198b076-9cef-4c79-a8cc-ec263794768c\") " pod="openshift-service-ca/service-ca-7d74d578b8-zvwgt" Jun 03 20:46:54.114234 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:54.114212 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7vlx\" (UniqueName: \"kubernetes.io/projected/2198b076-9cef-4c79-a8cc-ec263794768c-kube-api-access-k7vlx\") pod \"service-ca-7d74d578b8-zvwgt\" (UID: \"2198b076-9cef-4c79-a8cc-ec263794768c\") " pod="openshift-service-ca/service-ca-7d74d578b8-zvwgt" Jun 03 20:46:54.143031 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:54.143003 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5f2ll_704afad7-2929-409b-a7ed-c877c45839ec/dns-node-resolver/0.log" Jun 03 20:46:54.210109 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:54.210075 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-zvwgt" Jun 03 20:46:54.334212 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:54.334177 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-zvwgt"] Jun 03 20:46:54.336882 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:46:54.336854 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2198b076_9cef_4c79_a8cc_ec263794768c.slice/crio-2599051b9ab1449f423e424caf80b3d5d2f517ea0f47fb4402421e81ed2ecd1e WatchSource:0}: Error finding container 2599051b9ab1449f423e424caf80b3d5d2f517ea0f47fb4402421e81ed2ecd1e: Status 404 returned error can't find the container with id 2599051b9ab1449f423e424caf80b3d5d2f517ea0f47fb4402421e81ed2ecd1e Jun 03 20:46:54.594217 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:54.594113 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-zvwgt" event={"ID":"2198b076-9cef-4c79-a8cc-ec263794768c","Type":"ContainerStarted","Data":"e84f739644bdd3d9d718a1aff02021dc871062627c805f6cbef241665f10f269"} Jun 03 20:46:54.594217 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:54.594175 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-zvwgt" event={"ID":"2198b076-9cef-4c79-a8cc-ec263794768c","Type":"ContainerStarted","Data":"2599051b9ab1449f423e424caf80b3d5d2f517ea0f47fb4402421e81ed2ecd1e"} Jun 03 20:46:54.612287 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:54.612081 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-zvwgt" podStartSLOduration=1.612067327 podStartE2EDuration="1.612067327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:46:54.611848929 +0000 UTC m=+217.213075910" watchObservedRunningTime="2026-06-03 20:46:54.612067327 +0000 UTC m=+217.213294308" Jun 03 20:46:55.113119 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:55.113073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-57lpw\" (UID: \"a57c6adc-7ae5-4ab4-b440-27573322eedd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" Jun 03 20:46:55.113298 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:55.113228 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:55.113371 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:55.113299 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls podName:a57c6adc-7ae5-4ab4-b440-27573322eedd nodeName:}" failed. No retries permitted until 2026-06-03 20:47:03.113279463 +0000 UTC m=+225.714506425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-57lpw" (UID: "a57c6adc-7ae5-4ab4-b440-27573322eedd") : secret "cluster-monitoring-operator-tls" not found Jun 03 20:46:55.214046 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:55.214007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-6x9st\" (UID: \"eba17ab8-bc46-425f-bbae-9dfcc5510456\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st" Jun 03 20:46:55.214221 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:55.214144 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 20:46:55.214221 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:55.214215 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls podName:eba17ab8-bc46-425f-bbae-9dfcc5510456 nodeName:}" failed. No retries permitted until 2026-06-03 20:47:03.214199251 +0000 UTC m=+225.815426218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-6x9st" (UID: "eba17ab8-bc46-425f-bbae-9dfcc5510456") : secret "samples-operator-tls" not found Jun 03 20:46:55.315305 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:55.315268 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-cdm7x\" (UID: \"9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-cdm7x" Jun 03 20:46:55.315470 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:55.315448 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 20:46:55.315525 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:46:55.315514 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert podName:9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5 nodeName:}" failed. No retries permitted until 2026-06-03 20:47:03.315498622 +0000 UTC m=+225.916725581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-cdm7x" (UID: "9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5") : secret "networking-console-plugin-cert" not found Jun 03 20:46:55.343377 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:55.343337 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qmq99_3a9244b8-54da-477d-8860-1161ace67c83/node-ca/0.log" Jun 03 20:46:56.147688 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:56.147656 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bjbbr_618af87a-4eb4-4bc2-8f94-3915b3a005ff/serve-healthcheck-canary/0.log" Jun 03 20:46:56.543687 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:56.543592 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-9jzw4_9d5c4ec5-ee59-4b2f-92ef-f05064f53bc4/migrator/0.log" Jun 03 20:46:56.743999 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:46:56.743969 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-9jzw4_9d5c4ec5-ee59-4b2f-92ef-f05064f53bc4/graceful-termination/0.log" Jun 03 20:47:03.181858 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:03.181819 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-57lpw\" (UID: \"a57c6adc-7ae5-4ab4-b440-27573322eedd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" Jun 03 20:47:03.184226 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:03.184205 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a57c6adc-7ae5-4ab4-b440-27573322eedd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-57lpw\" (UID: \"a57c6adc-7ae5-4ab4-b440-27573322eedd\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" Jun 03 20:47:03.283262 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:03.283216 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-6x9st\" (UID: \"eba17ab8-bc46-425f-bbae-9dfcc5510456\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st" Jun 03 20:47:03.285764 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:03.285741 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/eba17ab8-bc46-425f-bbae-9dfcc5510456-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-6x9st\" (UID: \"eba17ab8-bc46-425f-bbae-9dfcc5510456\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st" Jun 03 20:47:03.299600 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:03.299572 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" Jun 03 20:47:03.380664 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:03.380105 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st" Jun 03 20:47:03.383696 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:03.383666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-cdm7x\" (UID: \"9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-cdm7x" Jun 03 20:47:03.383844 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:47:03.383828 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 20:47:03.383920 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:47:03.383908 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert podName:9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5 nodeName:}" failed. No retries permitted until 2026-06-03 20:47:19.383885939 +0000 UTC m=+241.985112913 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-cdm7x" (UID: "9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5") : secret "networking-console-plugin-cert" not found Jun 03 20:47:03.436652 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:03.436613 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw"] Jun 03 20:47:03.440106 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:47:03.440057 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57c6adc_7ae5_4ab4_b440_27573322eedd.slice/crio-8aad7364fdf211fd9cb77344d786f0ec107619b4e5eb1c3cba74b195c6d45d27 WatchSource:0}: Error finding container 8aad7364fdf211fd9cb77344d786f0ec107619b4e5eb1c3cba74b195c6d45d27: Status 404 returned error can't find the container with id 8aad7364fdf211fd9cb77344d786f0ec107619b4e5eb1c3cba74b195c6d45d27 Jun 03 20:47:03.515776 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:03.515742 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st"] Jun 03 20:47:03.624408 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:03.624371 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st" event={"ID":"eba17ab8-bc46-425f-bbae-9dfcc5510456","Type":"ContainerStarted","Data":"8e64ee1956276794013cc71f73935f45fe58f5e44da9f0adbcbd658e352d6188"} Jun 03 20:47:03.625486 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:03.625458 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" event={"ID":"a57c6adc-7ae5-4ab4-b440-27573322eedd","Type":"ContainerStarted","Data":"8aad7364fdf211fd9cb77344d786f0ec107619b4e5eb1c3cba74b195c6d45d27"} Jun 03 20:47:06.638815 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:06.638768 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" event={"ID":"a57c6adc-7ae5-4ab4-b440-27573322eedd","Type":"ContainerStarted","Data":"137b164684fd4c7db0e1f4fe294f857cdded538b373d9be62774ec9d7e341342"} Jun 03 20:47:06.640518 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:06.640492 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st" event={"ID":"eba17ab8-bc46-425f-bbae-9dfcc5510456","Type":"ContainerStarted","Data":"d97c142107d232ac759ebf44acb2784efee2e83fa10131e4bf67ee771b4782f8"} Jun 03 20:47:06.640641 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:06.640539 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st" event={"ID":"eba17ab8-bc46-425f-bbae-9dfcc5510456","Type":"ContainerStarted","Data":"754d6b4ac3ac7182b9d855d8b72c4516586a9d408a2ff07dcbc9b954b04e8054"} Jun 03 20:47:06.658611 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:06.658559 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-57lpw" podStartSLOduration=17.405798514 podStartE2EDuration="19.658544855s" totalImagesPullingTime="2.252746341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:06.65784052 +0000 UTC m=+229.259067502" watchObservedRunningTime="2026-06-03 20:47:06.658544855 +0000 UTC m=+229.259771835" Jun 03 20:47:06.675919 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:06.675853 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-6x9st" podStartSLOduration=17.527757657 podStartE2EDuration="19.675838893s" totalImagesPullingTime="2.148081236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:06.674656931 +0000 UTC m=+229.275883911" watchObservedRunningTime="2026-06-03 20:47:06.675838893 +0000 UTC m=+229.277065875" Jun 03 20:47:16.190090 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.190054 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fj8cq"] Jun 03 20:47:16.196216 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.196188 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fj8cq" Jun 03 20:47:16.196913 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.196885 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kt8vg"] Jun 03 20:47:16.199015 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.198991 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gqp26\"" Jun 03 20:47:16.199206 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.199185 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 03 20:47:16.204367 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.200887 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kt8vg" Jun 03 20:47:16.206800 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.206748 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 20:47:16.207002 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.206984 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 20:47:16.207275 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.207252 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vxtnl\"" Jun 03 20:47:16.209750 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.209729 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fj8cq"] Jun 03 20:47:16.213889 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.213862 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kt8vg"] Jun 03 20:47:16.282878 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.282848 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea-crio-socket\") pod \"insights-runtime-extractor-kt8vg\" (UID: \"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea\") " pod="openshift-insights/insights-runtime-extractor-kt8vg" Jun 03 20:47:16.283031 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.282885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kt8vg\" (UID: \"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea\") " pod="openshift-insights/insights-runtime-extractor-kt8vg" Jun 03 20:47:16.283031 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.282996 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea-data-volume\") pod \"insights-runtime-extractor-kt8vg\" (UID: \"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea\") " pod="openshift-insights/insights-runtime-extractor-kt8vg" Jun 03 20:47:16.283031 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.283025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kt8vg\" (UID: \"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea\") " pod="openshift-insights/insights-runtime-extractor-kt8vg" Jun 03 20:47:16.283145 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.283051 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sckd\" (UniqueName: \"kubernetes.io/projected/e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea-kube-api-access-8sckd\") pod \"insights-runtime-extractor-kt8vg\" (UID: \"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea\") " pod="openshift-insights/insights-runtime-extractor-kt8vg" Jun 03 20:47:16.283145 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.283101 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b2ff2846-81e9-4e22-ab3b-1b4ac4cb5e93-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fj8cq\" (UID: \"b2ff2846-81e9-4e22-ab3b-1b4ac4cb5e93\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fj8cq" Jun 03 20:47:16.383599 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.383564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea-crio-socket\") pod \"insights-runtime-extractor-kt8vg\" (UID: \"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea\") " pod="openshift-insights/insights-runtime-extractor-kt8vg" Jun 03 20:47:16.383599 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.383602 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kt8vg\" (UID: \"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea\") " pod="openshift-insights/insights-runtime-extractor-kt8vg" Jun 03 20:47:16.383775 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.383677 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea-data-volume\") pod \"insights-runtime-extractor-kt8vg\" (UID: \"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea\") " pod="openshift-insights/insights-runtime-extractor-kt8vg" Jun 03 20:47:16.383775 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.383692 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea-crio-socket\") pod \"insights-runtime-extractor-kt8vg\" (UID: \"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea\") " pod="openshift-insights/insights-runtime-extractor-kt8vg" Jun 03 20:47:16.383775 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.383706 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kt8vg\" (UID: \"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea\") " pod="openshift-insights/insights-runtime-extractor-kt8vg" Jun 03 20:47:16.383775 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.383764 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sckd\" (UniqueName: \"kubernetes.io/projected/e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea-kube-api-access-8sckd\") pod \"insights-runtime-extractor-kt8vg\" (UID: \"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea\") " pod="openshift-insights/insights-runtime-extractor-kt8vg" Jun 03 20:47:16.383965 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.383789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b2ff2846-81e9-4e22-ab3b-1b4ac4cb5e93-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fj8cq\" (UID: \"b2ff2846-81e9-4e22-ab3b-1b4ac4cb5e93\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fj8cq" Jun 03 20:47:16.384322 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.384297 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea-data-volume\") pod \"insights-runtime-extractor-kt8vg\" (UID: \"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea\") " pod="openshift-insights/insights-runtime-extractor-kt8vg" Jun 03 20:47:16.384458 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.384443 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kt8vg\" (UID: \"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea\") " pod="openshift-insights/insights-runtime-extractor-kt8vg" Jun 03 20:47:16.386180 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.386160 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kt8vg\" (UID: \"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea\") " pod="openshift-insights/insights-runtime-extractor-kt8vg" Jun 03 20:47:16.386457 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.386440 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b2ff2846-81e9-4e22-ab3b-1b4ac4cb5e93-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fj8cq\" (UID: \"b2ff2846-81e9-4e22-ab3b-1b4ac4cb5e93\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fj8cq" Jun 03 20:47:16.395874 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.395844 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sckd\" (UniqueName: \"kubernetes.io/projected/e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea-kube-api-access-8sckd\") pod \"insights-runtime-extractor-kt8vg\" (UID: \"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea\") " pod="openshift-insights/insights-runtime-extractor-kt8vg" Jun 03 20:47:16.508899 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.508760 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fj8cq" Jun 03 20:47:16.516237 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.516212 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kt8vg" Jun 03 20:47:16.663464 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.663436 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fj8cq"] Jun 03 20:47:16.666038 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:47:16.665996 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ff2846_81e9_4e22_ab3b_1b4ac4cb5e93.slice/crio-7dc553a9e248dd272c6afa915359df13ea0fea533f682d3827804fa01f65472e WatchSource:0}: Error finding container 7dc553a9e248dd272c6afa915359df13ea0fea533f682d3827804fa01f65472e: Status 404 returned error can't find the container with id 7dc553a9e248dd272c6afa915359df13ea0fea533f682d3827804fa01f65472e Jun 03 20:47:16.672004 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.671972 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fj8cq" event={"ID":"b2ff2846-81e9-4e22-ab3b-1b4ac4cb5e93","Type":"ContainerStarted","Data":"7dc553a9e248dd272c6afa915359df13ea0fea533f682d3827804fa01f65472e"} Jun 03 20:47:16.679081 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:16.679056 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kt8vg"] Jun 03 20:47:16.682106 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:47:16.682084 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d455b1_8c9f_47c6_bfa5_6b7745aa07ea.slice/crio-aa8160951eed49bff795ab7a8801e4a62f286d811dfcb207ab33561b637ccbf7 WatchSource:0}: Error finding container aa8160951eed49bff795ab7a8801e4a62f286d811dfcb207ab33561b637ccbf7: Status 404 returned error can't find the container with id aa8160951eed49bff795ab7a8801e4a62f286d811dfcb207ab33561b637ccbf7 Jun 03 20:47:17.678751 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:17.678712 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fj8cq" event={"ID":"b2ff2846-81e9-4e22-ab3b-1b4ac4cb5e93","Type":"ContainerStarted","Data":"99409ffe2f9315745c410e0c032ecfe543a0ce2d01144b966b107f2ea297a0b6"} Jun 03 20:47:17.679289 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:17.678781 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fj8cq" Jun 03 20:47:17.680230 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:17.680198 2577 patch_prober.go:28] interesting pod/prometheus-operator-admission-webhook-5b6b8f594-fj8cq container/prometheus-operator-admission-webhook namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.132.0.18:8443/healthz\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body= Jun 03 20:47:17.680369 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:17.680254 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fj8cq" podUID="b2ff2846-81e9-4e22-ab3b-1b4ac4cb5e93" containerName="prometheus-operator-admission-webhook" probeResult="failure" output="Get \"https://10.132.0.18:8443/healthz\": dial tcp 10.132.0.18:8443: connect: connection refused" Jun 03 20:47:17.681217 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:17.681163 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kt8vg" event={"ID":"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea","Type":"ContainerStarted","Data":"0d98124a8340b8b00708612534ea66f9e4ad94241ffaa35e9d19f0bf30af0f32"} Jun 03 20:47:17.681324 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:17.681298 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kt8vg" event={"ID":"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea","Type":"ContainerStarted","Data":"b99dd4f9a59fd11b4c954fbaffcb2d7b4c212e601e87a2a6e5c5ccc4dfbb7ef1"} Jun 03 20:47:17.681409 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:17.681332 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kt8vg" event={"ID":"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea","Type":"ContainerStarted","Data":"aa8160951eed49bff795ab7a8801e4a62f286d811dfcb207ab33561b637ccbf7"} Jun 03 20:47:17.696153 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:17.696097 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fj8cq" podStartSLOduration=0.760624665 podStartE2EDuration="1.696075715s" totalImagesPullingTime="935.45105ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:17.695009547 +0000 UTC m=+240.296236527" watchObservedRunningTime="2026-06-03 20:47:17.696075715 +0000 UTC m=+240.297302697" Jun 03 20:47:18.685839 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:18.685798 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kt8vg" event={"ID":"e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea","Type":"ContainerStarted","Data":"346c8c6dcbdfb3e0976df4f27c96ab1307983d9a80065d75a55c0a4091a1202e"} Jun 03 20:47:18.689709 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:18.689689 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fj8cq" Jun 03 20:47:18.703541 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:18.703502 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kt8vg" podStartSLOduration=0.895826987 podStartE2EDuration="2.703488744s" totalImagesPullingTime="1.807661757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:47:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:18.702153061 +0000 UTC m=+241.303380042" watchObservedRunningTime="2026-06-03 20:47:18.703488744 +0000 UTC m=+241.304715725" Jun 03 20:47:19.408356 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:19.408309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-cdm7x\" (UID: \"9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-cdm7x" Jun 03 20:47:19.410755 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:19.410729 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-cdm7x\" (UID: \"9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-cdm7x" Jun 03 20:47:19.683058 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:19.683023 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-k8v7j\"" Jun 03 20:47:19.690382 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:19.690363 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-cdm7x" Jun 03 20:47:19.853393 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:19.853369 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-cdm7x"] Jun 03 20:47:19.855397 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:47:19.855372 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d436e2a_5481_4f64_9ba5_9e6eb39fcdb5.slice/crio-65b69fd83d1adcfce4dd4e976545d2cbabb9e171c3710e16d534156efb1cca86 WatchSource:0}: Error finding container 65b69fd83d1adcfce4dd4e976545d2cbabb9e171c3710e16d534156efb1cca86: Status 404 returned error can't find the container with id 65b69fd83d1adcfce4dd4e976545d2cbabb9e171c3710e16d534156efb1cca86 Jun 03 20:47:20.694669 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:20.694633 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-cdm7x" event={"ID":"9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5","Type":"ContainerStarted","Data":"65b69fd83d1adcfce4dd4e976545d2cbabb9e171c3710e16d534156efb1cca86"} Jun 03 20:47:21.699613 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:21.699580 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-cdm7x" event={"ID":"9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5","Type":"ContainerStarted","Data":"3a76625462f6c187f0387d11d64a14c2a4c5b30e8ee78ad8b0f6ebaadd610355"} Jun 03 20:47:21.716290 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:21.716242 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-68d6b54856-cdm7x" podStartSLOduration=33.307861202 podStartE2EDuration="34.716225719s" totalImagesPullingTime="1.408364517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:21.715832959 +0000 UTC m=+244.317059939" watchObservedRunningTime="2026-06-03 20:47:21.716225719 +0000 UTC m=+244.317452699" Jun 03 20:47:23.593789 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.593754 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9"] Jun 03 20:47:23.596776 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.596752 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.600736 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.600713 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 20:47:23.600934 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.600741 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 20:47:23.601067 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.600741 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 20:47:23.601067 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.600812 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 20:47:23.601067 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.600830 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8ppdw\"" Jun 03 20:47:23.603950 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.603928 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-74hl7"] Jun 03 20:47:23.607310 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.607289 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.610471 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.610448 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 20:47:23.610766 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.610746 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 20:47:23.610879 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.610864 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c5g8v\"" Jun 03 20:47:23.611166 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.611146 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 20:47:23.617362 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.616665 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9"] Jun 03 20:47:23.644696 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.643782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53c4e7d5-526b-43ef-ba73-f670065df44e-node-exporter-tls\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.644696 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.643827 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53c4e7d5-526b-43ef-ba73-f670065df44e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.644696 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.643860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53c4e7d5-526b-43ef-ba73-f670065df44e-metrics-client-ca\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.644696 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.643916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.644696 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.643941 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs9mv\" (UniqueName: \"kubernetes.io/projected/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-kube-api-access-fs9mv\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.644696 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.643971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/53c4e7d5-526b-43ef-ba73-f670065df44e-node-exporter-textfile\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.644696 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.643995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/53c4e7d5-526b-43ef-ba73-f670065df44e-node-exporter-accelerators-collector-config\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.644696 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.644024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.644696 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.644067 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.644696 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.644099 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53c4e7d5-526b-43ef-ba73-f670065df44e-sys\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.644696 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.644146 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.644696 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.644168 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/53c4e7d5-526b-43ef-ba73-f670065df44e-node-exporter-wtmp\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.644696 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.644196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/53c4e7d5-526b-43ef-ba73-f670065df44e-root\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.644696 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.644220 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.644696 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.644259 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9bq7\" (UniqueName: \"kubernetes.io/projected/53c4e7d5-526b-43ef-ba73-f670065df44e-kube-api-access-m9bq7\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.746003 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.745538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.746003 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.745588 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs9mv\" (UniqueName: \"kubernetes.io/projected/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-kube-api-access-fs9mv\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.746003 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.745620 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/53c4e7d5-526b-43ef-ba73-f670065df44e-node-exporter-textfile\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.746003 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.745643 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/53c4e7d5-526b-43ef-ba73-f670065df44e-node-exporter-accelerators-collector-config\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.746003 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.745671 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.746003 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.745714 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.746003 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.745744 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53c4e7d5-526b-43ef-ba73-f670065df44e-sys\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.746003 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.745793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.746003 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.745815 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/53c4e7d5-526b-43ef-ba73-f670065df44e-node-exporter-wtmp\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.746003 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.745841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/53c4e7d5-526b-43ef-ba73-f670065df44e-root\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.746003 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.745863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.746003 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.745902 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9bq7\" (UniqueName: \"kubernetes.io/projected/53c4e7d5-526b-43ef-ba73-f670065df44e-kube-api-access-m9bq7\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.746003 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.745944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53c4e7d5-526b-43ef-ba73-f670065df44e-node-exporter-tls\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.746802 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.746023 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53c4e7d5-526b-43ef-ba73-f670065df44e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.746802 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.746061 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53c4e7d5-526b-43ef-ba73-f670065df44e-metrics-client-ca\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.746802 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.746102 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/53c4e7d5-526b-43ef-ba73-f670065df44e-root\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.746963 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.746810 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/53c4e7d5-526b-43ef-ba73-f670065df44e-node-exporter-wtmp\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.746963 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.746825 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53c4e7d5-526b-43ef-ba73-f670065df44e-metrics-client-ca\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.747142 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.747105 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/53c4e7d5-526b-43ef-ba73-f670065df44e-node-exporter-textfile\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.747667 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.747233 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.747667 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.747381 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53c4e7d5-526b-43ef-ba73-f670065df44e-sys\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.747667 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.747462 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/53c4e7d5-526b-43ef-ba73-f670065df44e-node-exporter-accelerators-collector-config\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.747891 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.747747 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.747952 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.747886 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.748690 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.748664 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.748930 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.748905 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53c4e7d5-526b-43ef-ba73-f670065df44e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.748994 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.748960 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.749521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.749493 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53c4e7d5-526b-43ef-ba73-f670065df44e-node-exporter-tls\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.754698 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.754679 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9bq7\" (UniqueName: \"kubernetes.io/projected/53c4e7d5-526b-43ef-ba73-f670065df44e-kube-api-access-m9bq7\") pod \"node-exporter-74hl7\" (UID: \"53c4e7d5-526b-43ef-ba73-f670065df44e\") " pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.754879 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.754862 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs9mv\" (UniqueName: \"kubernetes.io/projected/e6403eb7-e4ca-46b6-bb6a-ad4529c61826-kube-api-access-fs9mv\") pod \"kube-state-metrics-79fb7d47d4-28hd9\" (UID: \"e6403eb7-e4ca-46b6-bb6a-ad4529c61826\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.908183 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.908103 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" Jun 03 20:47:23.924866 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:23.924831 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-74hl7" Jun 03 20:47:23.936173 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:47:23.936144 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53c4e7d5_526b_43ef_ba73_f670065df44e.slice/crio-118d56c6a67428a1e576597097859d2a05e7787b127868febdd0e41d3d6e64d6 WatchSource:0}: Error finding container 118d56c6a67428a1e576597097859d2a05e7787b127868febdd0e41d3d6e64d6: Status 404 returned error can't find the container with id 118d56c6a67428a1e576597097859d2a05e7787b127868febdd0e41d3d6e64d6 Jun 03 20:47:24.041801 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.041769 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9"] Jun 03 20:47:24.043856 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:47:24.043829 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6403eb7_e4ca_46b6_bb6a_ad4529c61826.slice/crio-be66429c3f0b875eebb88d1c7110b2a18e97ad0ad7cdcd9c6d28af4f5daffa95 WatchSource:0}: Error finding container be66429c3f0b875eebb88d1c7110b2a18e97ad0ad7cdcd9c6d28af4f5daffa95: Status 404 returned error can't find the container with id be66429c3f0b875eebb88d1c7110b2a18e97ad0ad7cdcd9c6d28af4f5daffa95 Jun 03 20:47:24.649870 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.649836 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 20:47:24.654616 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.654592 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.658543 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.658153 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 20:47:24.658543 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.658318 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 20:47:24.658543 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.658390 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 20:47:24.658773 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.658598 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 20:47:24.658773 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.658644 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 20:47:24.658935 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.658918 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 20:47:24.658935 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.658928 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 20:47:24.659089 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.659067 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vzx22\"" Jun 03 20:47:24.659212 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.659158 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 20:47:24.659971 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.659795 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 20:47:24.671798 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.671772 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 20:47:24.711889 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.711850 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-74hl7" event={"ID":"53c4e7d5-526b-43ef-ba73-f670065df44e","Type":"ContainerStarted","Data":"118d56c6a67428a1e576597097859d2a05e7787b127868febdd0e41d3d6e64d6"} Jun 03 20:47:24.713384 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.713338 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" event={"ID":"e6403eb7-e4ca-46b6-bb6a-ad4529c61826","Type":"ContainerStarted","Data":"be66429c3f0b875eebb88d1c7110b2a18e97ad0ad7cdcd9c6d28af4f5daffa95"} Jun 03 20:47:24.757050 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.757010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-config-volume\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.757050 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.757059 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b9a4506-47ad-4fa8-bac9-54d025addd4a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.757268 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.757102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b9a4506-47ad-4fa8-bac9-54d025addd4a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.757268 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.757127 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.757268 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.757155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.757268 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.757179 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-web-config\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.757268 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.757204 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b9a4506-47ad-4fa8-bac9-54d025addd4a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.757268 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.757239 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.757580 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.757294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldfdn\" (UniqueName: \"kubernetes.io/projected/5b9a4506-47ad-4fa8-bac9-54d025addd4a-kube-api-access-ldfdn\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.757580 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.757331 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b9a4506-47ad-4fa8-bac9-54d025addd4a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.757580 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.757427 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b9a4506-47ad-4fa8-bac9-54d025addd4a-config-out\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.757580 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.757500 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.757580 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.757529 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.858279 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.858242 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b9a4506-47ad-4fa8-bac9-54d025addd4a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.858279 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.858279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.858530 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.858304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.858530 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.858329 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-web-config\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.858530 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.858370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b9a4506-47ad-4fa8-bac9-54d025addd4a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.858530 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.858409 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.858530 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:47:24.858453 2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 03 20:47:24.858530 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.858483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldfdn\" (UniqueName: \"kubernetes.io/projected/5b9a4506-47ad-4fa8-bac9-54d025addd4a-kube-api-access-ldfdn\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.858530 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.858521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b9a4506-47ad-4fa8-bac9-54d025addd4a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.858873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.858558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b9a4506-47ad-4fa8-bac9-54d025addd4a-config-out\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.858873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.858612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.858873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.858649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.858873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.858735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-config-volume\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.858873 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.858764 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b9a4506-47ad-4fa8-bac9-54d025addd4a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.858873 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:47:24.858833 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-main-tls podName:5b9a4506-47ad-4fa8-bac9-54d025addd4a nodeName:}" failed. No retries permitted until 2026-06-03 20:47:25.35880401 +0000 UTC m=+247.960030972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "5b9a4506-47ad-4fa8-bac9-54d025addd4a") : secret "alertmanager-main-tls" not found Jun 03 20:47:24.859625 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.859594 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b9a4506-47ad-4fa8-bac9-54d025addd4a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.859814 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:47:24.859790 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b9a4506-47ad-4fa8-bac9-54d025addd4a-alertmanager-trusted-ca-bundle podName:5b9a4506-47ad-4fa8-bac9-54d025addd4a nodeName:}" failed. No retries permitted until 2026-06-03 20:47:25.3597682 +0000 UTC m=+247.960995184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/5b9a4506-47ad-4fa8-bac9-54d025addd4a-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "5b9a4506-47ad-4fa8-bac9-54d025addd4a") : configmap references non-existent config key: ca-bundle.crt Jun 03 20:47:24.860625 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.860598 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b9a4506-47ad-4fa8-bac9-54d025addd4a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.862590 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.862540 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.862699 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.862663 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b9a4506-47ad-4fa8-bac9-54d025addd4a-config-out\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.862983 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.862932 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-web-config\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.863794 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.863757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.864173 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.864153 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.864245 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.864172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-config-volume\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.864322 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.864296 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b9a4506-47ad-4fa8-bac9-54d025addd4a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.864811 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.864757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:24.872747 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:24.872726 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldfdn\" (UniqueName: \"kubernetes.io/projected/5b9a4506-47ad-4fa8-bac9-54d025addd4a-kube-api-access-ldfdn\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:25.363423 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.363388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:25.363581 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.363429 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b9a4506-47ad-4fa8-bac9-54d025addd4a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:25.364621 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.364593 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b9a4506-47ad-4fa8-bac9-54d025addd4a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:25.366163 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.366140 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:25.571867 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.571550 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:47:25.571867 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.571576 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst"] Jun 03 20:47:25.575642 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.575621 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.578270 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.578234 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-50m75l0m5hm\"" Jun 03 20:47:25.578270 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.578252 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 20:47:25.578270 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.578264 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 20:47:25.578538 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.578336 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 20:47:25.578657 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.578634 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 20:47:25.578657 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.578639 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2bljs\"" Jun 03 20:47:25.578828 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.578739 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 20:47:25.588456 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.588433 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst"] Jun 03 20:47:25.667141 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.667103 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-grpc-tls\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.667564 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.667191 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.667564 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.667226 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-thanos-querier-tls\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.667564 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.667253 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.667564 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.667311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.667564 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.667410 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5a31666-6259-4990-82f0-b6eb577d3b32-metrics-client-ca\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.667564 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.667531 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.667564 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.667562 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9glv5\" (UniqueName: \"kubernetes.io/projected/a5a31666-6259-4990-82f0-b6eb577d3b32-kube-api-access-9glv5\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.716661 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.716621 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 20:47:25.719490 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.719459 2577 generic.go:356] "Generic (PLEG): container finished" podID="53c4e7d5-526b-43ef-ba73-f670065df44e" containerID="f5ec1a6ae3c347c13d6d42785e20fb40b70a519d50008ba488edbd7e6adf7e59" exitCode=0 Jun 03 20:47:25.719593 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.719538 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-74hl7" event={"ID":"53c4e7d5-526b-43ef-ba73-f670065df44e","Type":"ContainerDied","Data":"f5ec1a6ae3c347c13d6d42785e20fb40b70a519d50008ba488edbd7e6adf7e59"} Jun 03 20:47:25.720635 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:47:25.720609 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b9a4506_47ad_4fa8_bac9_54d025addd4a.slice/crio-9e44292abcd7b2b53f0562b2357b6d29e2451cd716bc3563b1ed172e2ae07062 WatchSource:0}: Error finding container 9e44292abcd7b2b53f0562b2357b6d29e2451cd716bc3563b1ed172e2ae07062: Status 404 returned error can't find the container with id 9e44292abcd7b2b53f0562b2357b6d29e2451cd716bc3563b1ed172e2ae07062 Jun 03 20:47:25.721793 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.721709 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" event={"ID":"e6403eb7-e4ca-46b6-bb6a-ad4529c61826","Type":"ContainerStarted","Data":"7aac4635620518db5b3a11333c5ebb0c1f534eebec3620e868da6df3340332fb"} Jun 03 20:47:25.721793 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.721760 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" event={"ID":"e6403eb7-e4ca-46b6-bb6a-ad4529c61826","Type":"ContainerStarted","Data":"58eba4aca6176bc2860a1336fd10b6d34e6c1e5e1c759f408aa460b4875ba421"} Jun 03 20:47:25.721793 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.721791 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" event={"ID":"e6403eb7-e4ca-46b6-bb6a-ad4529c61826","Type":"ContainerStarted","Data":"17ffc738c0fa81f91e49c25e38744e5227c188af71b49ea8f07ced1b0c54fa95"} Jun 03 20:47:25.756609 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.756562 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-28hd9" podStartSLOduration=1.614245969 podStartE2EDuration="2.756546871s" totalImagesPullingTime="1.142300902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:25.755027829 +0000 UTC m=+248.356254812" watchObservedRunningTime="2026-06-03 20:47:25.756546871 +0000 UTC m=+248.357773851" Jun 03 20:47:25.768623 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.768595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.768859 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.768828 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9glv5\" (UniqueName: \"kubernetes.io/projected/a5a31666-6259-4990-82f0-b6eb577d3b32-kube-api-access-9glv5\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.768974 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.768946 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-grpc-tls\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.769088 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.769037 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.769088 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.769066 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-thanos-querier-tls\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.769205 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.769093 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.769205 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.769164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.769324 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.769213 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5a31666-6259-4990-82f0-b6eb577d3b32-metrics-client-ca\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.770035 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.769999 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5a31666-6259-4990-82f0-b6eb577d3b32-metrics-client-ca\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.771300 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.771281 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.771579 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.771555 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.771780 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.771761 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.771920 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.771902 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-grpc-tls\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.772134 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.772106 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.772489 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.772473 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a5a31666-6259-4990-82f0-b6eb577d3b32-secret-thanos-querier-tls\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.776074 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.776055 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9glv5\" (UniqueName: \"kubernetes.io/projected/a5a31666-6259-4990-82f0-b6eb577d3b32-kube-api-access-9glv5\") pod \"thanos-querier-6cbdbff6d9-ktlst\" (UID: \"a5a31666-6259-4990-82f0-b6eb577d3b32\") " pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:25.893377 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:25.893095 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:26.028048 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:26.028024 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst"] Jun 03 20:47:26.030187 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:47:26.030160 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a31666_6259_4990_82f0_b6eb577d3b32.slice/crio-9d29319ef6eb3065108035ba3f18c9873a7e1487c6a95179621e1bd1e1a32e40 WatchSource:0}: Error finding container 9d29319ef6eb3065108035ba3f18c9873a7e1487c6a95179621e1bd1e1a32e40: Status 404 returned error can't find the container with id 9d29319ef6eb3065108035ba3f18c9873a7e1487c6a95179621e1bd1e1a32e40 Jun 03 20:47:26.730030 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:26.729980 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" event={"ID":"a5a31666-6259-4990-82f0-b6eb577d3b32","Type":"ContainerStarted","Data":"9d29319ef6eb3065108035ba3f18c9873a7e1487c6a95179621e1bd1e1a32e40"} Jun 03 20:47:26.731957 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:26.731836 2577 generic.go:356] "Generic (PLEG): container finished" podID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerID="2d94ad1ee2ec7f8a4d9d4a415a080527deb1e99d0c02863780f27cf7455706a5" exitCode=0 Jun 03 20:47:26.731957 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:26.731915 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b9a4506-47ad-4fa8-bac9-54d025addd4a","Type":"ContainerDied","Data":"2d94ad1ee2ec7f8a4d9d4a415a080527deb1e99d0c02863780f27cf7455706a5"} Jun 03 20:47:26.732147 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:26.731991 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b9a4506-47ad-4fa8-bac9-54d025addd4a","Type":"ContainerStarted","Data":"9e44292abcd7b2b53f0562b2357b6d29e2451cd716bc3563b1ed172e2ae07062"} Jun 03 20:47:26.735246 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:26.735217 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-74hl7" event={"ID":"53c4e7d5-526b-43ef-ba73-f670065df44e","Type":"ContainerStarted","Data":"4e142e8c84f7d2113d60e546b1aa57776eda41bd9f7cf4d7ca93111fdcc288b8"} Jun 03 20:47:26.735380 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:26.735281 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-74hl7" event={"ID":"53c4e7d5-526b-43ef-ba73-f670065df44e","Type":"ContainerStarted","Data":"ceaaaa062fd9f87d6852e21f15f2aaf7763926a0b7043b081ce35c7e2b53e8ee"} Jun 03 20:47:26.778135 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:26.778081 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-74hl7" podStartSLOduration=2.446286408 podStartE2EDuration="3.778063449s" totalImagesPullingTime="1.24770481s" totalInitContainerRuntime="84.072231ms" isStatefulPod=true podCreationTimestamp="2026-06-03 20:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:26.776198676 +0000 UTC m=+249.377425683" watchObservedRunningTime="2026-06-03 20:47:26.778063449 +0000 UTC m=+249.379290430" Jun 03 20:47:28.663769 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.663727 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-686ccb4947-zlb7q"] Jun 03 20:47:28.667203 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.667180 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.670230 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.670205 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 20:47:28.670400 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.670236 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 20:47:28.670400 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.670272 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 20:47:28.671460 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.671436 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 20:47:28.671554 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.671484 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 20:47:28.671554 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.671448 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 20:47:28.671554 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.671528 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gqcfk\"" Jun 03 20:47:28.671811 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.671797 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 20:47:28.675743 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.675723 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 20:47:28.680076 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.680056 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-686ccb4947-zlb7q"] Jun 03 20:47:28.744250 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.744155 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" event={"ID":"a5a31666-6259-4990-82f0-b6eb577d3b32","Type":"ContainerStarted","Data":"e437bec654435f0cfc3edd75fe11fb9485988dd753511c6d22bbd05121b78e7f"} Jun 03 20:47:28.744250 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.744233 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" event={"ID":"a5a31666-6259-4990-82f0-b6eb577d3b32","Type":"ContainerStarted","Data":"54f51f6e8b83dcc015727ddc1f136d660df33ff7ba7d59087046947112a9c247"} Jun 03 20:47:28.744488 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.744275 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" event={"ID":"a5a31666-6259-4990-82f0-b6eb577d3b32","Type":"ContainerStarted","Data":"2cfeaf06594bd6df553a011ba922e5857c9fbcee7c1e58eb408be7418fc8f256"} Jun 03 20:47:28.746969 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.746944 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b9a4506-47ad-4fa8-bac9-54d025addd4a","Type":"ContainerStarted","Data":"c692d5479fe367e60d85e935186020850563c1076048f406883247484f24ddb2"} Jun 03 20:47:28.747083 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.747000 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b9a4506-47ad-4fa8-bac9-54d025addd4a","Type":"ContainerStarted","Data":"8a1a4f2c7b398e6edf79615ec30623c763079ecdea42cdc37730692926955539"} Jun 03 20:47:28.747083 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.747035 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b9a4506-47ad-4fa8-bac9-54d025addd4a","Type":"ContainerStarted","Data":"2fdf61fb57484c5ee6767b4db24a35e5bdf1e71af60f28a7ab0f4dfe742d98ff"} Jun 03 20:47:28.747083 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.747060 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b9a4506-47ad-4fa8-bac9-54d025addd4a","Type":"ContainerStarted","Data":"661fa556298e82c212a24a09606c8d94bae595141fd246c5da24dbab07ab0aa1"} Jun 03 20:47:28.747083 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.747081 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b9a4506-47ad-4fa8-bac9-54d025addd4a","Type":"ContainerStarted","Data":"c64d542686488cfb6a73b640aabd177ce12c94f708590b23ffdcc33b242e0d6c"} Jun 03 20:47:28.799946 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.799910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6bbq\" (UniqueName: \"kubernetes.io/projected/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-kube-api-access-k6bbq\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.799946 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.799950 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-oauth-serving-cert\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.800139 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.800003 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs\") pod \"network-metrics-daemon-wl8bs\" (UID: \"5c12c87b-72ec-41be-8add-0584a341a706\") " pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:47:28.800139 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.800029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-config\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.800139 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.800070 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-oauth-config\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.800305 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.800281 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-serving-cert\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.800375 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.800313 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-service-ca\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.800375 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.800370 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-trusted-ca-bundle\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.802623 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.802597 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c12c87b-72ec-41be-8add-0584a341a706-metrics-certs\") pod \"network-metrics-daemon-wl8bs\" (UID: \"5c12c87b-72ec-41be-8add-0584a341a706\") " pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:47:28.901129 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.901090 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-serving-cert\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.901129 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.901128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-service-ca\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.901373 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.901151 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-trusted-ca-bundle\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.901373 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.901192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6bbq\" (UniqueName: \"kubernetes.io/projected/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-kube-api-access-k6bbq\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.901373 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.901222 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-oauth-serving-cert\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.901373 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.901288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-config\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.901373 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.901332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-oauth-config\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.902248 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.901984 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-service-ca\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.902248 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.902190 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-oauth-serving-cert\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.902248 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.902232 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-trusted-ca-bundle\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.902526 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.902268 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-config\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.904013 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.903990 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-serving-cert\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.904138 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.904069 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-oauth-config\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.909952 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.909928 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6bbq\" (UniqueName: \"kubernetes.io/projected/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-kube-api-access-k6bbq\") pod \"console-686ccb4947-zlb7q\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.976867 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.976829 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:28.992509 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:28.992481 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kg9x\"" Jun 03 20:47:29.000640 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.000565 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wl8bs" Jun 03 20:47:29.258079 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.258001 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-686ccb4947-zlb7q"] Jun 03 20:47:29.262225 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:47:29.262023 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716ab7dd_f6ac_4014_a223_5c0beacdfb3f.slice/crio-aef838ebd55cb4896a1a3956fa68de4d323ef00222978395284e17d1c1776d60 WatchSource:0}: Error finding container aef838ebd55cb4896a1a3956fa68de4d323ef00222978395284e17d1c1776d60: Status 404 returned error can't find the container with id aef838ebd55cb4896a1a3956fa68de4d323ef00222978395284e17d1c1776d60 Jun 03 20:47:29.275118 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.275091 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wl8bs"] Jun 03 20:47:29.278158 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:47:29.278131 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c12c87b_72ec_41be_8add_0584a341a706.slice/crio-939f5e4c5421916fc64624bc88bcf01284bb85a494ee6ba24e51c6a274c2d193 WatchSource:0}: Error finding container 939f5e4c5421916fc64624bc88bcf01284bb85a494ee6ba24e51c6a274c2d193: Status 404 returned error can't find the container with id 939f5e4c5421916fc64624bc88bcf01284bb85a494ee6ba24e51c6a274c2d193 Jun 03 20:47:29.755645 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.755595 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686ccb4947-zlb7q" event={"ID":"716ab7dd-f6ac-4014-a223-5c0beacdfb3f","Type":"ContainerStarted","Data":"aef838ebd55cb4896a1a3956fa68de4d323ef00222978395284e17d1c1776d60"} Jun 03 20:47:29.759809 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.759595 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" event={"ID":"a5a31666-6259-4990-82f0-b6eb577d3b32","Type":"ContainerStarted","Data":"062dd68f0a188e1efcd2abe210987365efdb230df652e42b42e9cd89f615b872"} Jun 03 20:47:29.759809 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.759672 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" event={"ID":"a5a31666-6259-4990-82f0-b6eb577d3b32","Type":"ContainerStarted","Data":"4d5432b34a41af0239f539c9fadc68cab609ad7df2badfffee2cd7ca2f043839"} Jun 03 20:47:29.759809 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.759714 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" event={"ID":"a5a31666-6259-4990-82f0-b6eb577d3b32","Type":"ContainerStarted","Data":"0e90163f29b481eb0443f9162fa6a7e77dccddd63a1bf53a7a9010542794a17f"} Jun 03 20:47:29.759809 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.759760 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:29.769894 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.769858 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b9a4506-47ad-4fa8-bac9-54d025addd4a","Type":"ContainerStarted","Data":"bba5c11c3b909797bc22b781b58b4c7908e3ba65f4d75ba38798231f55aee8be"} Jun 03 20:47:29.771848 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.771821 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wl8bs" event={"ID":"5c12c87b-72ec-41be-8add-0584a341a706","Type":"ContainerStarted","Data":"939f5e4c5421916fc64624bc88bcf01284bb85a494ee6ba24e51c6a274c2d193"} Jun 03 20:47:29.782064 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.781956 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" podStartSLOduration=1.870781247 podStartE2EDuration="4.781937297s" totalImagesPullingTime="2.91115605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:29.780816031 +0000 UTC m=+252.382043014" watchObservedRunningTime="2026-06-03 20:47:29.781937297 +0000 UTC m=+252.383164279" Jun 03 20:47:29.800534 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.800497 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:47:29.805289 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.805217 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.810883 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.808708 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.808633362 podStartE2EDuration="5.808691035s" totalImagesPullingTime="2.979158572s" totalInitContainerRuntime="20.899101ms" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:29.807918588 +0000 UTC m=+252.409145608" watchObservedRunningTime="2026-06-03 20:47:29.808691035 +0000 UTC m=+252.409918019" Jun 03 20:47:29.810883 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.809027 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 20:47:29.810883 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.809089 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 20:47:29.810883 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.809365 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 03 20:47:29.810883 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.809607 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 20:47:29.810883 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.809882 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-83pv6brsrq2a\"" Jun 03 20:47:29.810883 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.810174 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 20:47:29.810883 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.810275 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 20:47:29.810883 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.810466 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cwfzx\"" Jun 03 20:47:29.810883 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.810728 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 20:47:29.810883 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.810757 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 20:47:29.811565 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.810960 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 20:47:29.811565 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.811558 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 20:47:29.811666 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.811569 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 20:47:29.811933 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.811911 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 20:47:29.814078 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.813830 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 03 20:47:29.815409 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.815272 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 20:47:29.818580 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.818435 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 20:47:29.829548 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.829520 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:47:29.910604 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.910556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.910604 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.910603 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911089 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.910995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/519374e6-b71b-4d87-9fa2-56519b66cb54-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911089 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.911032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911089 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.911055 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-web-config\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911377 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.911111 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911377 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.911159 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911377 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.911200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911377 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.911222 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911377 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.911249 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kg7f\" (UniqueName: \"kubernetes.io/projected/519374e6-b71b-4d87-9fa2-56519b66cb54-kube-api-access-8kg7f\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911377 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.911306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911377 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.911370 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/519374e6-b71b-4d87-9fa2-56519b66cb54-config-out\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911777 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.911406 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911777 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.911448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911777 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.911467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911777 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.911505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-config\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911777 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.911529 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911777 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.911559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911777 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.911583 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:29.911777 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:29.911625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012251 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012155 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012251 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/519374e6-b71b-4d87-9fa2-56519b66cb54-config-out\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012251 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012565 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012565 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012321 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012565 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-config\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012565 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012401 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012565 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012565 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012565 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012490 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012903 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012588 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012903 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012615 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012903 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/519374e6-b71b-4d87-9fa2-56519b66cb54-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012903 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012693 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012903 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-web-config\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012903 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012754 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012903 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012903 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012819 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012903 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012842 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.012903 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.012893 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kg7f\" (UniqueName: \"kubernetes.io/projected/519374e6-b71b-4d87-9fa2-56519b66cb54-kube-api-access-8kg7f\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.014687 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.014085 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.014687 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.014208 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.014687 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.014384 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.018689 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.015531 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.018689 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.017884 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.018689 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.018267 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.018689 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.018617 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.018689 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.018638 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.018997 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.018738 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.019838 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.019814 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.020499 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.020201 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.020499 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.020458 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/519374e6-b71b-4d87-9fa2-56519b66cb54-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.020944 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.020911 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/519374e6-b71b-4d87-9fa2-56519b66cb54-config-out\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.021652 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.021609 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kg7f\" (UniqueName: \"kubernetes.io/projected/519374e6-b71b-4d87-9fa2-56519b66cb54-kube-api-access-8kg7f\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.022592 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.022550 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.022699 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.022675 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-web-config\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.022759 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.022749 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.023128 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.023102 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.023699 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.023680 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.024995 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.024956 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-config\") pod \"prometheus-k8s-0\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.123819 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.123769 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:30.310265 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.310186 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:47:30.312911 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:47:30.312881 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519374e6_b71b_4d87_9fa2_56519b66cb54.slice/crio-619deb6cc806e67ad1afd741c8b9d34c183aa64789d0bbea6a62b62b5c05b263 WatchSource:0}: Error finding container 619deb6cc806e67ad1afd741c8b9d34c183aa64789d0bbea6a62b62b5c05b263: Status 404 returned error can't find the container with id 619deb6cc806e67ad1afd741c8b9d34c183aa64789d0bbea6a62b62b5c05b263 Jun 03 20:47:30.778540 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.778500 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wl8bs" event={"ID":"5c12c87b-72ec-41be-8add-0584a341a706","Type":"ContainerStarted","Data":"c0035c6eca27994ef2413164cd078822ef8ec4ac5b8f4f6ba67571a511fe5e92"} Jun 03 20:47:30.778997 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.778569 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wl8bs" event={"ID":"5c12c87b-72ec-41be-8add-0584a341a706","Type":"ContainerStarted","Data":"c042139309f98710a211910ed3ce1506c14c0b70b32440febeb2155f3573bd32"} Jun 03 20:47:30.780377 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.780324 2577 generic.go:356] "Generic (PLEG): container finished" podID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerID="0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2" exitCode=0 Jun 03 20:47:30.780496 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.780381 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"519374e6-b71b-4d87-9fa2-56519b66cb54","Type":"ContainerDied","Data":"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2"} Jun 03 20:47:30.780496 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.780449 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"519374e6-b71b-4d87-9fa2-56519b66cb54","Type":"ContainerStarted","Data":"619deb6cc806e67ad1afd741c8b9d34c183aa64789d0bbea6a62b62b5c05b263"} Jun 03 20:47:30.796922 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:30.796870 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wl8bs" podStartSLOduration=251.884615598 podStartE2EDuration="4m12.796850736s" totalImagesPullingTime="912.235138ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:30.794612686 +0000 UTC m=+253.395839667" watchObservedRunningTime="2026-06-03 20:47:30.796850736 +0000 UTC m=+253.398077717" Jun 03 20:47:32.793300 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:32.793259 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686ccb4947-zlb7q" event={"ID":"716ab7dd-f6ac-4014-a223-5c0beacdfb3f","Type":"ContainerStarted","Data":"cab3151a434c756f61e9be280c92d0851e074270ce8a54fce8ba19e8026750f0"} Jun 03 20:47:32.812238 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:32.812180 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-686ccb4947-zlb7q" podStartSLOduration=2.087276362 podStartE2EDuration="4.812161371s" totalImagesPullingTime="2.724885009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:32.81041454 +0000 UTC m=+255.411641521" watchObservedRunningTime="2026-06-03 20:47:32.812161371 +0000 UTC m=+255.413388352" Jun 03 20:47:34.808477 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:34.808442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"519374e6-b71b-4d87-9fa2-56519b66cb54","Type":"ContainerStarted","Data":"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45"} Jun 03 20:47:34.808949 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:34.808553 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"519374e6-b71b-4d87-9fa2-56519b66cb54","Type":"ContainerStarted","Data":"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4"} Jun 03 20:47:34.808949 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:34.808606 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"519374e6-b71b-4d87-9fa2-56519b66cb54","Type":"ContainerStarted","Data":"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba"} Jun 03 20:47:34.808949 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:34.808648 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"519374e6-b71b-4d87-9fa2-56519b66cb54","Type":"ContainerStarted","Data":"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f"} Jun 03 20:47:34.808949 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:34.808690 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"519374e6-b71b-4d87-9fa2-56519b66cb54","Type":"ContainerStarted","Data":"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5"} Jun 03 20:47:34.808949 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:34.808729 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"519374e6-b71b-4d87-9fa2-56519b66cb54","Type":"ContainerStarted","Data":"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943"} Jun 03 20:47:34.839785 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:34.839734 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.228707236 podStartE2EDuration="5.83971643s" totalImagesPullingTime="3.585587649s" totalInitContainerRuntime="25.421545ms" isStatefulPod=false podCreationTimestamp="2026-06-03 20:47:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:47:34.837767037 +0000 UTC m=+257.438994022" watchObservedRunningTime="2026-06-03 20:47:34.83971643 +0000 UTC m=+257.440943410" Jun 03 20:47:35.124164 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:35.124116 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:47:35.787313 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:35.787283 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6cbdbff6d9-ktlst" Jun 03 20:47:38.977429 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:38.977386 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:38.977824 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:38.977450 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:47:38.978868 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:38.978845 2577 patch_prober.go:28] interesting pod/console-686ccb4947-zlb7q container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 03 20:47:38.978931 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:38.978904 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-686ccb4947-zlb7q" podUID="716ab7dd-f6ac-4014-a223-5c0beacdfb3f" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 03 20:47:48.978158 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:48.978120 2577 patch_prober.go:28] interesting pod/console-686ccb4947-zlb7q container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 03 20:47:48.978591 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:48.978190 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-686ccb4947-zlb7q" podUID="716ab7dd-f6ac-4014-a223-5c0beacdfb3f" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 03 20:47:55.903594 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:55.903556 2577 generic.go:356] "Generic (PLEG): container finished" podID="86402679-3f8d-487e-80cd-df90bb52ca76" containerID="ad5ab78671ee9f15dcae06ef9f102a13e339bf9d19d8d9589e4b0f6ee38a92d5" exitCode=0 Jun 03 20:47:55.904113 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:55.903613 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6" event={"ID":"86402679-3f8d-487e-80cd-df90bb52ca76","Type":"ContainerDied","Data":"ad5ab78671ee9f15dcae06ef9f102a13e339bf9d19d8d9589e4b0f6ee38a92d5"} Jun 03 20:47:55.904113 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:55.904023 2577 scope.go:117] "RemoveContainer" containerID="ad5ab78671ee9f15dcae06ef9f102a13e339bf9d19d8d9589e4b0f6ee38a92d5" Jun 03 20:47:56.910026 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:56.909992 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-t5sd6" event={"ID":"86402679-3f8d-487e-80cd-df90bb52ca76","Type":"ContainerStarted","Data":"6b4536ac98fe0b1db5048eece2f66eb9fcd5a77ce98c6c83eb048c9e74033bc6"} Jun 03 20:47:58.421708 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:47:58.421661 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-px4nq" podUID="2d955896-e762-4a3b-9517-75622c75eafe" Jun 03 20:47:58.421708 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:47:58.421681 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" podUID="3869bb16-98d6-4fcf-810c-83d235e8670f" Jun 03 20:47:58.918109 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:58.918076 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:47:58.918298 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:58.918082 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-px4nq" Jun 03 20:47:58.977997 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:58.977958 2577 patch_prober.go:28] interesting pod/console-686ccb4947-zlb7q container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 03 20:47:58.978174 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:47:58.978014 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-686ccb4947-zlb7q" podUID="716ab7dd-f6ac-4014-a223-5c0beacdfb3f" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 03 20:48:01.727747 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:01.727710 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:48:01.728132 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:01.727779 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:48:01.730131 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:01.730106 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d955896-e762-4a3b-9517-75622c75eafe-metrics-tls\") pod \"dns-default-px4nq\" (UID: \"2d955896-e762-4a3b-9517-75622c75eafe\") " pod="openshift-dns/dns-default-px4nq" Jun 03 20:48:01.730201 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:01.730175 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls\") pod \"image-registry-64b886f49b-c8rzs\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:48:01.922273 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:01.922239 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qqw74\"" Jun 03 20:48:01.922273 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:01.922243 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d78km\"" Jun 03 20:48:01.929130 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:01.929101 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:48:01.929365 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:01.929148 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-px4nq" Jun 03 20:48:02.074707 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:02.074682 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-px4nq"] Jun 03 20:48:02.076843 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:48:02.076809 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d955896_e762_4a3b_9517_75622c75eafe.slice/crio-b66d153b3318f5d301756d30e11eee018c64accdc5a5c33dc959e0088ec73004 WatchSource:0}: Error finding container b66d153b3318f5d301756d30e11eee018c64accdc5a5c33dc959e0088ec73004: Status 404 returned error can't find the container with id b66d153b3318f5d301756d30e11eee018c64accdc5a5c33dc959e0088ec73004 Jun 03 20:48:02.090798 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:02.090778 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64b886f49b-c8rzs"] Jun 03 20:48:02.092632 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:48:02.092606 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3869bb16_98d6_4fcf_810c_83d235e8670f.slice/crio-d7bcf6b1fdee2295af8667696ef46469e9a56e514f7d92068fb195521d2ebb25 WatchSource:0}: Error finding container d7bcf6b1fdee2295af8667696ef46469e9a56e514f7d92068fb195521d2ebb25: Status 404 returned error can't find the container with id d7bcf6b1fdee2295af8667696ef46469e9a56e514f7d92068fb195521d2ebb25 Jun 03 20:48:02.937298 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:02.937244 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" event={"ID":"3869bb16-98d6-4fcf-810c-83d235e8670f","Type":"ContainerStarted","Data":"1d9e0fb3d6aa1638b233678e4b9359825032c67174896f0962cd10fb4ebebb10"} Jun 03 20:48:02.937803 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:02.937315 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:48:02.937803 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:02.937336 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" event={"ID":"3869bb16-98d6-4fcf-810c-83d235e8670f","Type":"ContainerStarted","Data":"d7bcf6b1fdee2295af8667696ef46469e9a56e514f7d92068fb195521d2ebb25"} Jun 03 20:48:02.938710 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:02.938675 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-px4nq" event={"ID":"2d955896-e762-4a3b-9517-75622c75eafe","Type":"ContainerStarted","Data":"b66d153b3318f5d301756d30e11eee018c64accdc5a5c33dc959e0088ec73004"} Jun 03 20:48:02.959833 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:02.959781 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" podStartSLOduration=284.959761806 podStartE2EDuration="4m44.959761806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:48:02.957831426 +0000 UTC m=+285.559058432" watchObservedRunningTime="2026-06-03 20:48:02.959761806 +0000 UTC m=+285.560988816" Jun 03 20:48:03.946431 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:03.946374 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-px4nq" event={"ID":"2d955896-e762-4a3b-9517-75622c75eafe","Type":"ContainerStarted","Data":"225139de62a2484645bd168cf19b850b2e8eb6401afd75e06682e8d25623586c"} Jun 03 20:48:04.952330 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:04.952294 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-px4nq" event={"ID":"2d955896-e762-4a3b-9517-75622c75eafe","Type":"ContainerStarted","Data":"f1a9d17223ff4da2c606dd4d0b0745d210c896ff95bfb79e74f7a0357d434bab"} Jun 03 20:48:04.952744 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:04.952462 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-px4nq" Jun 03 20:48:04.969778 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:04.969725 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-px4nq" podStartSLOduration=252.235535266 podStartE2EDuration="4m13.96970969s" totalImagesPullingTime="1.734174424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:48:04.969051137 +0000 UTC m=+287.570278118" watchObservedRunningTime="2026-06-03 20:48:04.96970969 +0000 UTC m=+287.570936670" Jun 03 20:48:08.977670 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:08.977636 2577 patch_prober.go:28] interesting pod/console-686ccb4947-zlb7q container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 03 20:48:08.978073 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:08.977701 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-686ccb4947-zlb7q" podUID="716ab7dd-f6ac-4014-a223-5c0beacdfb3f" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 03 20:48:14.959491 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:14.959459 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-px4nq" Jun 03 20:48:17.014216 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:17.014176 2577 generic.go:356] "Generic (PLEG): container finished" podID="39a33de3-9405-411b-8924-8ff39d3fc516" containerID="9ec85274ee23c2b947ba70dfe416a7e37e5f29994a7b60b27dc4ad3b7c5bd0ea" exitCode=0 Jun 03 20:48:17.014718 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:17.014249 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-mt8bs" event={"ID":"39a33de3-9405-411b-8924-8ff39d3fc516","Type":"ContainerDied","Data":"9ec85274ee23c2b947ba70dfe416a7e37e5f29994a7b60b27dc4ad3b7c5bd0ea"} Jun 03 20:48:17.014787 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:17.014737 2577 scope.go:117] "RemoveContainer" containerID="9ec85274ee23c2b947ba70dfe416a7e37e5f29994a7b60b27dc4ad3b7c5bd0ea" Jun 03 20:48:17.861009 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:17.860913 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 20:48:17.862891 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:17.862870 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 20:48:17.863952 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:17.863931 2577 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 20:48:18.020419 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:18.020382 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-mt8bs" event={"ID":"39a33de3-9405-411b-8924-8ff39d3fc516","Type":"ContainerStarted","Data":"0516190e42807284d931fda35a939ff187a8fc52d63e4f6a1588b29d3fb657ae"} Jun 03 20:48:18.982061 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:18.982017 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:48:18.985808 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:18.985783 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:48:21.933364 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:21.933321 2577 patch_prober.go:28] interesting pod/image-registry-64b886f49b-c8rzs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 20:48:21.933746 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:21.933399 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" podUID="3869bb16-98d6-4fcf-810c-83d235e8670f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 20:48:23.951385 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:23.951337 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:48:30.124941 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:30.124903 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:30.145869 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:30.145841 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:31.090697 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:31.090667 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:43.884960 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:43.884925 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 20:48:43.885380 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:43.885238 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="alertmanager" containerID="cri-o://c64d542686488cfb6a73b640aabd177ce12c94f708590b23ffdcc33b242e0d6c" gracePeriod=120 Jun 03 20:48:43.885380 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:43.885280 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="kube-rbac-proxy-web" containerID="cri-o://2fdf61fb57484c5ee6767b4db24a35e5bdf1e71af60f28a7ab0f4dfe742d98ff" gracePeriod=120 Jun 03 20:48:43.885380 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:43.885280 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="kube-rbac-proxy-metric" containerID="cri-o://c692d5479fe367e60d85e935186020850563c1076048f406883247484f24ddb2" gracePeriod=120 Jun 03 20:48:43.885380 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:43.885329 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="config-reloader" containerID="cri-o://661fa556298e82c212a24a09606c8d94bae595141fd246c5da24dbab07ab0aa1" gracePeriod=120 Jun 03 20:48:43.885587 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:43.885371 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="kube-rbac-proxy" containerID="cri-o://8a1a4f2c7b398e6edf79615ec30623c763079ecdea42cdc37730692926955539" gracePeriod=120 Jun 03 20:48:43.885587 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:43.885373 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="prom-label-proxy" containerID="cri-o://bba5c11c3b909797bc22b781b58b4c7908e3ba65f4d75ba38798231f55aee8be" gracePeriod=120 Jun 03 20:48:44.033810 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:44.033776 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64b886f49b-c8rzs"] Jun 03 20:48:44.140665 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:44.140559 2577 generic.go:356] "Generic (PLEG): container finished" podID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerID="bba5c11c3b909797bc22b781b58b4c7908e3ba65f4d75ba38798231f55aee8be" exitCode=0 Jun 03 20:48:44.140665 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:44.140592 2577 generic.go:356] "Generic (PLEG): container finished" podID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerID="8a1a4f2c7b398e6edf79615ec30623c763079ecdea42cdc37730692926955539" exitCode=0 Jun 03 20:48:44.140665 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:44.140602 2577 generic.go:356] "Generic (PLEG): container finished" podID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerID="661fa556298e82c212a24a09606c8d94bae595141fd246c5da24dbab07ab0aa1" exitCode=0 Jun 03 20:48:44.140665 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:44.140610 2577 generic.go:356] "Generic (PLEG): container finished" podID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerID="c64d542686488cfb6a73b640aabd177ce12c94f708590b23ffdcc33b242e0d6c" exitCode=0 Jun 03 20:48:44.140665 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:44.140611 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b9a4506-47ad-4fa8-bac9-54d025addd4a","Type":"ContainerDied","Data":"bba5c11c3b909797bc22b781b58b4c7908e3ba65f4d75ba38798231f55aee8be"} Jun 03 20:48:44.140999 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:44.140732 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b9a4506-47ad-4fa8-bac9-54d025addd4a","Type":"ContainerDied","Data":"8a1a4f2c7b398e6edf79615ec30623c763079ecdea42cdc37730692926955539"} Jun 03 20:48:44.140999 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:44.140775 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b9a4506-47ad-4fa8-bac9-54d025addd4a","Type":"ContainerDied","Data":"661fa556298e82c212a24a09606c8d94bae595141fd246c5da24dbab07ab0aa1"} Jun 03 20:48:44.140999 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:44.140807 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b9a4506-47ad-4fa8-bac9-54d025addd4a","Type":"ContainerDied","Data":"c64d542686488cfb6a73b640aabd177ce12c94f708590b23ffdcc33b242e0d6c"} Jun 03 20:48:45.148131 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.148094 2577 generic.go:356] "Generic (PLEG): container finished" podID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerID="c692d5479fe367e60d85e935186020850563c1076048f406883247484f24ddb2" exitCode=0 Jun 03 20:48:45.148131 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.148123 2577 generic.go:356] "Generic (PLEG): container finished" podID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerID="2fdf61fb57484c5ee6767b4db24a35e5bdf1e71af60f28a7ab0f4dfe742d98ff" exitCode=0 Jun 03 20:48:45.148571 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.148161 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b9a4506-47ad-4fa8-bac9-54d025addd4a","Type":"ContainerDied","Data":"c692d5479fe367e60d85e935186020850563c1076048f406883247484f24ddb2"} Jun 03 20:48:45.148571 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.148247 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b9a4506-47ad-4fa8-bac9-54d025addd4a","Type":"ContainerDied","Data":"2fdf61fb57484c5ee6767b4db24a35e5bdf1e71af60f28a7ab0f4dfe742d98ff"} Jun 03 20:48:45.239990 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.239922 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:45.322976 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.322941 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-config-volume\") pod \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " Jun 03 20:48:45.323162 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.322984 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b9a4506-47ad-4fa8-bac9-54d025addd4a-metrics-client-ca\") pod \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " Jun 03 20:48:45.323162 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.323005 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-web-config\") pod \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " Jun 03 20:48:45.323162 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.323039 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b9a4506-47ad-4fa8-bac9-54d025addd4a-config-out\") pod \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " Jun 03 20:48:45.323337 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.323187 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy-web\") pod \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " Jun 03 20:48:45.323337 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.323254 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b9a4506-47ad-4fa8-bac9-54d025addd4a-tls-assets\") pod \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " Jun 03 20:48:45.323337 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.323284 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-main-tls\") pod \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " Jun 03 20:48:45.323525 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.323338 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-cluster-tls-config\") pod \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " Jun 03 20:48:45.323525 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.323420 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b9a4506-47ad-4fa8-bac9-54d025addd4a-alertmanager-trusted-ca-bundle\") pod \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " Jun 03 20:48:45.323525 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.323454 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " Jun 03 20:48:45.323525 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.323502 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy\") pod \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " Jun 03 20:48:45.323525 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.323513 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b9a4506-47ad-4fa8-bac9-54d025addd4a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5b9a4506-47ad-4fa8-bac9-54d025addd4a" (UID: "5b9a4506-47ad-4fa8-bac9-54d025addd4a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:45.323773 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.323525 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldfdn\" (UniqueName: \"kubernetes.io/projected/5b9a4506-47ad-4fa8-bac9-54d025addd4a-kube-api-access-ldfdn\") pod \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " Jun 03 20:48:45.323773 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.323603 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b9a4506-47ad-4fa8-bac9-54d025addd4a-alertmanager-main-db\") pod \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\" (UID: \"5b9a4506-47ad-4fa8-bac9-54d025addd4a\") " Jun 03 20:48:45.323929 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.323905 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b9a4506-47ad-4fa8-bac9-54d025addd4a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5b9a4506-47ad-4fa8-bac9-54d025addd4a" (UID: "5b9a4506-47ad-4fa8-bac9-54d025addd4a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:45.324044 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.324023 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b9a4506-47ad-4fa8-bac9-54d025addd4a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:45.324222 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.324204 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b9a4506-47ad-4fa8-bac9-54d025addd4a-metrics-client-ca\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:45.324599 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.324579 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9a4506-47ad-4fa8-bac9-54d025addd4a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5b9a4506-47ad-4fa8-bac9-54d025addd4a" (UID: "5b9a4506-47ad-4fa8-bac9-54d025addd4a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:48:45.326150 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.326099 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5b9a4506-47ad-4fa8-bac9-54d025addd4a" (UID: "5b9a4506-47ad-4fa8-bac9-54d025addd4a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:45.326526 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.326498 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-config-volume" (OuterVolumeSpecName: "config-volume") pod "5b9a4506-47ad-4fa8-bac9-54d025addd4a" (UID: "5b9a4506-47ad-4fa8-bac9-54d025addd4a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:45.326619 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.326531 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9a4506-47ad-4fa8-bac9-54d025addd4a-config-out" (OuterVolumeSpecName: "config-out") pod "5b9a4506-47ad-4fa8-bac9-54d025addd4a" (UID: "5b9a4506-47ad-4fa8-bac9-54d025addd4a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:48:45.326734 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.326699 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5b9a4506-47ad-4fa8-bac9-54d025addd4a" (UID: "5b9a4506-47ad-4fa8-bac9-54d025addd4a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:45.326993 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.326972 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b9a4506-47ad-4fa8-bac9-54d025addd4a-kube-api-access-ldfdn" (OuterVolumeSpecName: "kube-api-access-ldfdn") pod "5b9a4506-47ad-4fa8-bac9-54d025addd4a" (UID: "5b9a4506-47ad-4fa8-bac9-54d025addd4a"). InnerVolumeSpecName "kube-api-access-ldfdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:48:45.327390 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.327365 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b9a4506-47ad-4fa8-bac9-54d025addd4a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5b9a4506-47ad-4fa8-bac9-54d025addd4a" (UID: "5b9a4506-47ad-4fa8-bac9-54d025addd4a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:48:45.327476 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.327458 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5b9a4506-47ad-4fa8-bac9-54d025addd4a" (UID: "5b9a4506-47ad-4fa8-bac9-54d025addd4a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:45.327663 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.327644 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5b9a4506-47ad-4fa8-bac9-54d025addd4a" (UID: "5b9a4506-47ad-4fa8-bac9-54d025addd4a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:45.331282 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.331252 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5b9a4506-47ad-4fa8-bac9-54d025addd4a" (UID: "5b9a4506-47ad-4fa8-bac9-54d025addd4a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:45.337686 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.337660 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-web-config" (OuterVolumeSpecName: "web-config") pod "5b9a4506-47ad-4fa8-bac9-54d025addd4a" (UID: "5b9a4506-47ad-4fa8-bac9-54d025addd4a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:45.424871 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.424826 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-web-config\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:45.424871 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.424863 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b9a4506-47ad-4fa8-bac9-54d025addd4a-config-out\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:45.424871 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.424874 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:45.424871 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.424883 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b9a4506-47ad-4fa8-bac9-54d025addd4a-tls-assets\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:45.425146 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.424893 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-main-tls\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:45.425146 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.424903 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-cluster-tls-config\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:45.425146 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.424911 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:45.425146 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.424921 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:45.425146 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.424929 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldfdn\" (UniqueName: \"kubernetes.io/projected/5b9a4506-47ad-4fa8-bac9-54d025addd4a-kube-api-access-ldfdn\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:45.425146 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.424938 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5b9a4506-47ad-4fa8-bac9-54d025addd4a-alertmanager-main-db\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:45.425146 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:45.424946 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5b9a4506-47ad-4fa8-bac9-54d025addd4a-config-volume\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:46.156179 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.156089 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5b9a4506-47ad-4fa8-bac9-54d025addd4a","Type":"ContainerDied","Data":"9e44292abcd7b2b53f0562b2357b6d29e2451cd716bc3563b1ed172e2ae07062"} Jun 03 20:48:46.156179 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.156116 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.156179 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.156181 2577 scope.go:117] "RemoveContainer" containerID="bba5c11c3b909797bc22b781b58b4c7908e3ba65f4d75ba38798231f55aee8be" Jun 03 20:48:46.164308 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.164289 2577 scope.go:117] "RemoveContainer" containerID="c692d5479fe367e60d85e935186020850563c1076048f406883247484f24ddb2" Jun 03 20:48:46.171831 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.171812 2577 scope.go:117] "RemoveContainer" containerID="8a1a4f2c7b398e6edf79615ec30623c763079ecdea42cdc37730692926955539" Jun 03 20:48:46.179283 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.179252 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 20:48:46.179977 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.179952 2577 scope.go:117] "RemoveContainer" containerID="2fdf61fb57484c5ee6767b4db24a35e5bdf1e71af60f28a7ab0f4dfe742d98ff" Jun 03 20:48:46.182828 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.182810 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 20:48:46.187418 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.187396 2577 scope.go:117] "RemoveContainer" containerID="661fa556298e82c212a24a09606c8d94bae595141fd246c5da24dbab07ab0aa1" Jun 03 20:48:46.196167 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.196151 2577 scope.go:117] "RemoveContainer" containerID="c64d542686488cfb6a73b640aabd177ce12c94f708590b23ffdcc33b242e0d6c" Jun 03 20:48:46.203671 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.203653 2577 scope.go:117] "RemoveContainer" containerID="2d94ad1ee2ec7f8a4d9d4a415a080527deb1e99d0c02863780f27cf7455706a5" Jun 03 20:48:46.208294 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.208264 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 20:48:46.208812 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.208791 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="alertmanager" Jun 03 20:48:46.208850 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.208817 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="alertmanager" Jun 03 20:48:46.208850 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.208832 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="kube-rbac-proxy-web" Jun 03 20:48:46.208850 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.208844 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="kube-rbac-proxy-web" Jun 03 20:48:46.208950 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.208859 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="kube-rbac-proxy" Jun 03 20:48:46.208950 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.208868 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="kube-rbac-proxy" Jun 03 20:48:46.208950 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.208885 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="prom-label-proxy" Jun 03 20:48:46.208950 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.208893 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="prom-label-proxy" Jun 03 20:48:46.208950 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.208904 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="init-config-reloader" Jun 03 20:48:46.208950 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.208912 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="init-config-reloader" Jun 03 20:48:46.208950 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.208932 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="kube-rbac-proxy-metric" Jun 03 20:48:46.208950 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.208940 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="kube-rbac-proxy-metric" Jun 03 20:48:46.209195 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.208955 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="config-reloader" Jun 03 20:48:46.209195 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.208964 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="config-reloader" Jun 03 20:48:46.209195 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.209074 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="kube-rbac-proxy" Jun 03 20:48:46.209195 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.209087 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="config-reloader" Jun 03 20:48:46.209195 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.209098 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="kube-rbac-proxy-web" Jun 03 20:48:46.209195 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.209108 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="prom-label-proxy" Jun 03 20:48:46.209195 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.209117 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="kube-rbac-proxy-metric" Jun 03 20:48:46.209195 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.209127 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" containerName="alertmanager" Jun 03 20:48:46.215059 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.215042 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.217683 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.217664 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 20:48:46.217918 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.217901 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 20:48:46.218094 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.217991 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 20:48:46.218248 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.218224 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vzx22\"" Jun 03 20:48:46.218356 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.218262 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 20:48:46.218356 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.218311 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 20:48:46.218356 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.218334 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 20:48:46.218511 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.218358 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 20:48:46.218578 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.218564 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 20:48:46.224832 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.224797 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 20:48:46.227334 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.227311 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 20:48:46.333469 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.333430 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d6b80698-c573-4fb2-8784-701e32a6a0d0-config-out\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.333469 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.333469 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6b80698-c573-4fb2-8784-701e32a6a0d0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.333684 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.333492 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.333684 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.333516 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.333684 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.333562 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.333684 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.333659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d6b80698-c573-4fb2-8784-701e32a6a0d0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.333807 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.333690 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-config-volume\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.333807 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.333709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjqc2\" (UniqueName: \"kubernetes.io/projected/d6b80698-c573-4fb2-8784-701e32a6a0d0-kube-api-access-fjqc2\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.333807 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.333727 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.333807 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.333764 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b80698-c573-4fb2-8784-701e32a6a0d0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.333807 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.333800 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-web-config\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.333952 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.333822 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d6b80698-c573-4fb2-8784-701e32a6a0d0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.333952 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.333842 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.434769 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.434733 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.434913 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.434776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.434913 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.434797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.434913 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.434818 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d6b80698-c573-4fb2-8784-701e32a6a0d0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.435043 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.434932 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-config-volume\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.435043 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.434965 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjqc2\" (UniqueName: \"kubernetes.io/projected/d6b80698-c573-4fb2-8784-701e32a6a0d0-kube-api-access-fjqc2\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.435043 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.434997 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.435238 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.435042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b80698-c573-4fb2-8784-701e32a6a0d0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.435238 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.435087 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-web-config\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.435238 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.435122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d6b80698-c573-4fb2-8784-701e32a6a0d0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.435238 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.435150 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.435238 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.435201 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d6b80698-c573-4fb2-8784-701e32a6a0d0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.435238 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.435237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d6b80698-c573-4fb2-8784-701e32a6a0d0-config-out\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.435574 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.435267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6b80698-c573-4fb2-8784-701e32a6a0d0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.436283 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.436016 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6b80698-c573-4fb2-8784-701e32a6a0d0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.438059 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.438021 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-web-config\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.438152 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.438025 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.438152 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.438115 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.438152 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.438118 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.438317 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.438241 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.438317 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.438301 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.438878 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.438854 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d6b80698-c573-4fb2-8784-701e32a6a0d0-config-out\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.439014 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.438990 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6b80698-c573-4fb2-8784-701e32a6a0d0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.439093 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.439079 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d6b80698-c573-4fb2-8784-701e32a6a0d0-config-volume\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.439836 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.439821 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d6b80698-c573-4fb2-8784-701e32a6a0d0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.443606 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.443580 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjqc2\" (UniqueName: \"kubernetes.io/projected/d6b80698-c573-4fb2-8784-701e32a6a0d0-kube-api-access-fjqc2\") pod \"alertmanager-main-0\" (UID: \"d6b80698-c573-4fb2-8784-701e32a6a0d0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.524702 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.524671 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 20:48:46.665196 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:46.665160 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 20:48:46.666602 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:48:46.666571 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b80698_c573_4fb2_8784_701e32a6a0d0.slice/crio-e45e754c6d29dbaff00f78a7e2f63329249cef8372afa1ff62dbfce3e3a0d7bd WatchSource:0}: Error finding container e45e754c6d29dbaff00f78a7e2f63329249cef8372afa1ff62dbfce3e3a0d7bd: Status 404 returned error can't find the container with id e45e754c6d29dbaff00f78a7e2f63329249cef8372afa1ff62dbfce3e3a0d7bd Jun 03 20:48:47.162754 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:47.162660 2577 generic.go:356] "Generic (PLEG): container finished" podID="d6b80698-c573-4fb2-8784-701e32a6a0d0" containerID="b397be71f6406b38af187e451c3b59269263aef5e4c7e5363827cb1337fd35b1" exitCode=0 Jun 03 20:48:47.162754 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:47.162707 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b80698-c573-4fb2-8784-701e32a6a0d0","Type":"ContainerDied","Data":"b397be71f6406b38af187e451c3b59269263aef5e4c7e5363827cb1337fd35b1"} Jun 03 20:48:47.163167 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:47.162809 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b80698-c573-4fb2-8784-701e32a6a0d0","Type":"ContainerStarted","Data":"e45e754c6d29dbaff00f78a7e2f63329249cef8372afa1ff62dbfce3e3a0d7bd"} Jun 03 20:48:47.894919 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:47.894880 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b9a4506-47ad-4fa8-bac9-54d025addd4a" path="/var/lib/kubelet/pods/5b9a4506-47ad-4fa8-bac9-54d025addd4a/volumes" Jun 03 20:48:48.169648 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.169555 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b80698-c573-4fb2-8784-701e32a6a0d0","Type":"ContainerStarted","Data":"007262889ed08a45737c51ba98437a602a670edb5e420dd62e556857e17e5012"} Jun 03 20:48:48.169648 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.169629 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b80698-c573-4fb2-8784-701e32a6a0d0","Type":"ContainerStarted","Data":"7d1390059900711547c4b313fdf1d1c909329f5fee79cc7b12afb79a180a200a"} Jun 03 20:48:48.170183 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.169675 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b80698-c573-4fb2-8784-701e32a6a0d0","Type":"ContainerStarted","Data":"92c1cd1a74f45c28c8c8d33350a891db6472c91c17876b15b276fdb167c55ac4"} Jun 03 20:48:48.170183 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.169719 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b80698-c573-4fb2-8784-701e32a6a0d0","Type":"ContainerStarted","Data":"5c26495e8ecba4e6018023d0e2601ebebe63b886e2005379e17a375b60eb86df"} Jun 03 20:48:48.170183 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.169761 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b80698-c573-4fb2-8784-701e32a6a0d0","Type":"ContainerStarted","Data":"1edfc18e400b4a3a562c2b3beccad8ff24bce05c074921e2c92783328b159b49"} Jun 03 20:48:48.170183 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.169807 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d6b80698-c573-4fb2-8784-701e32a6a0d0","Type":"ContainerStarted","Data":"02e4d08a7e70db3923101c8ff945ccecb8b6254959e1a30806608efa1d988af0"} Jun 03 20:48:48.197878 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.197814 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.178036587 podStartE2EDuration="2.197794306s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.757719ms" isStatefulPod=false podCreationTimestamp="2026-06-03 20:48:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:48:48.195207486 +0000 UTC m=+330.796434466" watchObservedRunningTime="2026-06-03 20:48:48.197794306 +0000 UTC m=+330.799021289" Jun 03 20:48:48.261608 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.261573 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:48:48.261944 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.261883 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="prometheus" containerID="cri-o://313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943" gracePeriod=600 Jun 03 20:48:48.261944 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.261917 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="kube-rbac-proxy-web" containerID="cri-o://d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba" gracePeriod=600 Jun 03 20:48:48.261944 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.261934 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="kube-rbac-proxy" containerID="cri-o://ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4" gracePeriod=600 Jun 03 20:48:48.262168 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.261922 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="thanos-sidecar" containerID="cri-o://dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f" gracePeriod=600 Jun 03 20:48:48.262168 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.261893 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45" gracePeriod=600 Jun 03 20:48:48.262168 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.261935 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="config-reloader" containerID="cri-o://df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5" gracePeriod=600 Jun 03 20:48:48.502530 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.502504 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:48.554659 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.554629 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-web-config\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.554848 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.554674 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-metrics-client-certs\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.554848 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.554694 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/519374e6-b71b-4d87-9fa2-56519b66cb54-config-out\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.554848 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.554714 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-trusted-ca-bundle\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.554848 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.554741 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-0\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.554848 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.554767 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-2\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.556638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.555104 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:48.556638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.555166 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-kubelet-serving-ca-bundle\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.556638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.555149 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:48.556638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.555233 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-kube-rbac-proxy\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.556638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.555267 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-config\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.556638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.555304 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/519374e6-b71b-4d87-9fa2-56519b66cb54-tls-assets\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.556638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.555573 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:48.556638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.555335 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-tls\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.556638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.555684 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-metrics-client-ca\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.556638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.555713 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-1\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.556638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.555762 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kg7f\" (UniqueName: \"kubernetes.io/projected/519374e6-b71b-4d87-9fa2-56519b66cb54-kube-api-access-8kg7f\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.556638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.555805 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-grpc-tls\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.556638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.555837 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-db\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.556638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.555874 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-thanos-prometheus-http-client-file\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.556638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.555944 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-serving-certs-ca-bundle\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.556638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.555989 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.556638 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.556014 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"519374e6-b71b-4d87-9fa2-56519b66cb54\" (UID: \"519374e6-b71b-4d87-9fa2-56519b66cb54\") " Jun 03 20:48:48.559139 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.556307 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.559139 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.556325 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.559139 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.556359 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.559139 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.556586 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:48.559139 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.557370 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:48.559139 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.557435 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/519374e6-b71b-4d87-9fa2-56519b66cb54-config-out" (OuterVolumeSpecName: "config-out") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:48:48.559139 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.557752 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:48.559139 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.557840 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:48.559139 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.558150 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:48:48.559139 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.558829 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:48:48.559679 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.559568 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-config" (OuterVolumeSpecName: "config") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:48.559842 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.559775 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/519374e6-b71b-4d87-9fa2-56519b66cb54-kube-api-access-8kg7f" (OuterVolumeSpecName: "kube-api-access-8kg7f") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "kube-api-access-8kg7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:48:48.559842 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.559807 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/519374e6-b71b-4d87-9fa2-56519b66cb54-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:48:48.560240 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.560209 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:48.560600 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.560412 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:48.560600 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.560453 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:48.560600 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.560454 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:48.560843 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.560813 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:48.560932 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.560899 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:48.571170 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.571142 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-web-config" (OuterVolumeSpecName: "web-config") pod "519374e6-b71b-4d87-9fa2-56519b66cb54" (UID: "519374e6-b71b-4d87-9fa2-56519b66cb54"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:48:48.657791 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.657754 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-metrics-client-ca\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.657791 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.657785 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.657791 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.657796 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kg7f\" (UniqueName: \"kubernetes.io/projected/519374e6-b71b-4d87-9fa2-56519b66cb54-kube-api-access-8kg7f\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.658026 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.657805 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-grpc-tls\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.658026 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.657814 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-db\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.658026 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.657822 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.658026 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.657831 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.658026 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.657839 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.658026 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.657848 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.658026 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.657858 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-web-config\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.658026 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.657868 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-metrics-client-certs\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.658026 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.657877 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/519374e6-b71b-4d87-9fa2-56519b66cb54-config-out\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.658026 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.657886 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/519374e6-b71b-4d87-9fa2-56519b66cb54-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.658026 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.657896 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-kube-rbac-proxy\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.658026 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.657904 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-config\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.658026 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.657914 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/519374e6-b71b-4d87-9fa2-56519b66cb54-tls-assets\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:48.658026 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:48.657922 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/519374e6-b71b-4d87-9fa2-56519b66cb54-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:48:49.182198 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.182147 2577 generic.go:356] "Generic (PLEG): container finished" podID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerID="1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45" exitCode=0 Jun 03 20:48:49.182644 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.182214 2577 generic.go:356] "Generic (PLEG): container finished" podID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerID="ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4" exitCode=0 Jun 03 20:48:49.182644 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.182222 2577 generic.go:356] "Generic (PLEG): container finished" podID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerID="d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba" exitCode=0 Jun 03 20:48:49.182644 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.182229 2577 generic.go:356] "Generic (PLEG): container finished" podID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerID="dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f" exitCode=0 Jun 03 20:48:49.182644 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.182235 2577 generic.go:356] "Generic (PLEG): container finished" podID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerID="df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5" exitCode=0 Jun 03 20:48:49.182644 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.182240 2577 generic.go:356] "Generic (PLEG): container finished" podID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerID="313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943" exitCode=0 Jun 03 20:48:49.182644 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.182162 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"519374e6-b71b-4d87-9fa2-56519b66cb54","Type":"ContainerDied","Data":"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45"} Jun 03 20:48:49.182644 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.182265 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.182644 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.182384 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"519374e6-b71b-4d87-9fa2-56519b66cb54","Type":"ContainerDied","Data":"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4"} Jun 03 20:48:49.182644 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.182421 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"519374e6-b71b-4d87-9fa2-56519b66cb54","Type":"ContainerDied","Data":"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba"} Jun 03 20:48:49.182644 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.182455 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"519374e6-b71b-4d87-9fa2-56519b66cb54","Type":"ContainerDied","Data":"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f"} Jun 03 20:48:49.182644 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.182465 2577 scope.go:117] "RemoveContainer" containerID="1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45" Jun 03 20:48:49.182644 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.182493 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"519374e6-b71b-4d87-9fa2-56519b66cb54","Type":"ContainerDied","Data":"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5"} Jun 03 20:48:49.182644 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.182531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"519374e6-b71b-4d87-9fa2-56519b66cb54","Type":"ContainerDied","Data":"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943"} Jun 03 20:48:49.182644 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.182570 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"519374e6-b71b-4d87-9fa2-56519b66cb54","Type":"ContainerDied","Data":"619deb6cc806e67ad1afd741c8b9d34c183aa64789d0bbea6a62b62b5c05b263"} Jun 03 20:48:49.191464 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.191446 2577 scope.go:117] "RemoveContainer" containerID="ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4" Jun 03 20:48:49.201019 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.200985 2577 scope.go:117] "RemoveContainer" containerID="d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba" Jun 03 20:48:49.208337 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.208313 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:48:49.209700 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.209679 2577 scope.go:117] "RemoveContainer" containerID="dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f" Jun 03 20:48:49.212335 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.212313 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:48:49.217728 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.217701 2577 scope.go:117] "RemoveContainer" containerID="df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5" Jun 03 20:48:49.224705 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.224687 2577 scope.go:117] "RemoveContainer" containerID="313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943" Jun 03 20:48:49.232062 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.232042 2577 scope.go:117] "RemoveContainer" containerID="0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2" Jun 03 20:48:49.239459 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.239437 2577 scope.go:117] "RemoveContainer" containerID="1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45" Jun 03 20:48:49.239762 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:48:49.239739 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45\": container with ID starting with 1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45 not found: ID does not exist" containerID="1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45" Jun 03 20:48:49.239833 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.239778 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45"} err="failed to get container status \"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45\": rpc error: code = NotFound desc = could not find container \"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45\": container with ID starting with 1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45 not found: ID does not exist" Jun 03 20:48:49.239833 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.239823 2577 scope.go:117] "RemoveContainer" containerID="ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4" Jun 03 20:48:49.240114 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:48:49.240084 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4\": container with ID starting with ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4 not found: ID does not exist" containerID="ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4" Jun 03 20:48:49.240183 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.240113 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4"} err="failed to get container status \"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4\": rpc error: code = NotFound desc = could not find container \"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4\": container with ID starting with ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4 not found: ID does not exist" Jun 03 20:48:49.240183 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.240133 2577 scope.go:117] "RemoveContainer" containerID="d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba" Jun 03 20:48:49.240506 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:48:49.240481 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba\": container with ID starting with d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba not found: ID does not exist" containerID="d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba" Jun 03 20:48:49.240593 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.240512 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba"} err="failed to get container status \"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba\": rpc error: code = NotFound desc = could not find container \"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba\": container with ID starting with d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba not found: ID does not exist" Jun 03 20:48:49.240593 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.240533 2577 scope.go:117] "RemoveContainer" containerID="dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f" Jun 03 20:48:49.240951 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:48:49.240851 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f\": container with ID starting with dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f not found: ID does not exist" containerID="dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f" Jun 03 20:48:49.240951 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.240882 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f"} err="failed to get container status \"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f\": rpc error: code = NotFound desc = could not find container \"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f\": container with ID starting with dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f not found: ID does not exist" Jun 03 20:48:49.240951 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.240903 2577 scope.go:117] "RemoveContainer" containerID="df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5" Jun 03 20:48:49.241263 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:48:49.241239 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5\": container with ID starting with df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5 not found: ID does not exist" containerID="df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5" Jun 03 20:48:49.241330 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.241271 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5"} err="failed to get container status \"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5\": rpc error: code = NotFound desc = could not find container \"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5\": container with ID starting with df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5 not found: ID does not exist" Jun 03 20:48:49.241330 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.241291 2577 scope.go:117] "RemoveContainer" containerID="313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943" Jun 03 20:48:49.241629 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:48:49.241584 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943\": container with ID starting with 313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943 not found: ID does not exist" containerID="313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943" Jun 03 20:48:49.241629 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.241606 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943"} err="failed to get container status \"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943\": rpc error: code = NotFound desc = could not find container \"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943\": container with ID starting with 313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943 not found: ID does not exist" Jun 03 20:48:49.241629 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.241621 2577 scope.go:117] "RemoveContainer" containerID="0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2" Jun 03 20:48:49.241875 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:48:49.241850 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2\": container with ID starting with 0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2 not found: ID does not exist" containerID="0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2" Jun 03 20:48:49.241916 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.241872 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2"} err="failed to get container status \"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2\": rpc error: code = NotFound desc = could not find container \"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2\": container with ID starting with 0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2 not found: ID does not exist" Jun 03 20:48:49.241916 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.241888 2577 scope.go:117] "RemoveContainer" containerID="1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45" Jun 03 20:48:49.242153 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.242132 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45"} err="failed to get container status \"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45\": rpc error: code = NotFound desc = could not find container \"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45\": container with ID starting with 1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45 not found: ID does not exist" Jun 03 20:48:49.242238 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.242155 2577 scope.go:117] "RemoveContainer" containerID="ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4" Jun 03 20:48:49.242426 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.242403 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4"} err="failed to get container status \"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4\": rpc error: code = NotFound desc = could not find container \"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4\": container with ID starting with ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4 not found: ID does not exist" Jun 03 20:48:49.242426 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.242424 2577 scope.go:117] "RemoveContainer" containerID="d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba" Jun 03 20:48:49.242663 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.242646 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:48:49.242710 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.242668 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba"} err="failed to get container status \"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba\": rpc error: code = NotFound desc = could not find container \"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba\": container with ID starting with d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba not found: ID does not exist" Jun 03 20:48:49.242710 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.242685 2577 scope.go:117] "RemoveContainer" containerID="dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f" Jun 03 20:48:49.242916 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.242893 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f"} err="failed to get container status \"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f\": rpc error: code = NotFound desc = could not find container \"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f\": container with ID starting with dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f not found: ID does not exist" Jun 03 20:48:49.242996 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.242924 2577 scope.go:117] "RemoveContainer" containerID="df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5" Jun 03 20:48:49.243035 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243001 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="kube-rbac-proxy-thanos" Jun 03 20:48:49.243035 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243018 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="kube-rbac-proxy-thanos" Jun 03 20:48:49.243105 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243040 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="prometheus" Jun 03 20:48:49.243105 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243048 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="prometheus" Jun 03 20:48:49.243105 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243064 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="config-reloader" Jun 03 20:48:49.243105 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243072 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="config-reloader" Jun 03 20:48:49.243105 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243095 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="thanos-sidecar" Jun 03 20:48:49.243105 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243102 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="thanos-sidecar" Jun 03 20:48:49.243296 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243115 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="kube-rbac-proxy" Jun 03 20:48:49.243296 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243120 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="kube-rbac-proxy" Jun 03 20:48:49.243296 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243126 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="init-config-reloader" Jun 03 20:48:49.243296 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243132 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="init-config-reloader" Jun 03 20:48:49.243296 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243137 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="kube-rbac-proxy-web" Jun 03 20:48:49.243296 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243142 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="kube-rbac-proxy-web" Jun 03 20:48:49.243296 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243206 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="kube-rbac-proxy-web" Jun 03 20:48:49.243296 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243216 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="kube-rbac-proxy" Jun 03 20:48:49.243296 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243135 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5"} err="failed to get container status \"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5\": rpc error: code = NotFound desc = could not find container \"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5\": container with ID starting with df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5 not found: ID does not exist" Jun 03 20:48:49.243296 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243238 2577 scope.go:117] "RemoveContainer" containerID="313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943" Jun 03 20:48:49.243296 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243223 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="prometheus" Jun 03 20:48:49.243296 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243288 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="kube-rbac-proxy-thanos" Jun 03 20:48:49.243296 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243299 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="thanos-sidecar" Jun 03 20:48:49.243808 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243308 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" containerName="config-reloader" Jun 03 20:48:49.243808 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243509 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943"} err="failed to get container status \"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943\": rpc error: code = NotFound desc = could not find container \"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943\": container with ID starting with 313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943 not found: ID does not exist" Jun 03 20:48:49.243808 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243536 2577 scope.go:117] "RemoveContainer" containerID="0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2" Jun 03 20:48:49.243808 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243756 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2"} err="failed to get container status \"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2\": rpc error: code = NotFound desc = could not find container \"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2\": container with ID starting with 0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2 not found: ID does not exist" Jun 03 20:48:49.243808 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243776 2577 scope.go:117] "RemoveContainer" containerID="1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45" Jun 03 20:48:49.243991 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243966 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45"} err="failed to get container status \"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45\": rpc error: code = NotFound desc = could not find container \"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45\": container with ID starting with 1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45 not found: ID does not exist" Jun 03 20:48:49.243991 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.243980 2577 scope.go:117] "RemoveContainer" containerID="ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4" Jun 03 20:48:49.244191 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.244172 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4"} err="failed to get container status \"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4\": rpc error: code = NotFound desc = could not find container \"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4\": container with ID starting with ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4 not found: ID does not exist" Jun 03 20:48:49.244248 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.244191 2577 scope.go:117] "RemoveContainer" containerID="d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba" Jun 03 20:48:49.244434 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.244417 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba"} err="failed to get container status \"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba\": rpc error: code = NotFound desc = could not find container \"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba\": container with ID starting with d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba not found: ID does not exist" Jun 03 20:48:49.244434 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.244433 2577 scope.go:117] "RemoveContainer" containerID="dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f" Jun 03 20:48:49.244614 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.244598 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f"} err="failed to get container status \"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f\": rpc error: code = NotFound desc = could not find container \"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f\": container with ID starting with dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f not found: ID does not exist" Jun 03 20:48:49.244658 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.244614 2577 scope.go:117] "RemoveContainer" containerID="df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5" Jun 03 20:48:49.244816 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.244800 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5"} err="failed to get container status \"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5\": rpc error: code = NotFound desc = could not find container \"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5\": container with ID starting with df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5 not found: ID does not exist" Jun 03 20:48:49.244859 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.244816 2577 scope.go:117] "RemoveContainer" containerID="313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943" Jun 03 20:48:49.245022 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.245004 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943"} err="failed to get container status \"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943\": rpc error: code = NotFound desc = could not find container \"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943\": container with ID starting with 313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943 not found: ID does not exist" Jun 03 20:48:49.245065 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.245024 2577 scope.go:117] "RemoveContainer" containerID="0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2" Jun 03 20:48:49.245205 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.245190 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2"} err="failed to get container status \"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2\": rpc error: code = NotFound desc = could not find container \"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2\": container with ID starting with 0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2 not found: ID does not exist" Jun 03 20:48:49.245247 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.245205 2577 scope.go:117] "RemoveContainer" containerID="1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45" Jun 03 20:48:49.245394 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.245372 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45"} err="failed to get container status \"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45\": rpc error: code = NotFound desc = could not find container \"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45\": container with ID starting with 1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45 not found: ID does not exist" Jun 03 20:48:49.245446 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.245395 2577 scope.go:117] "RemoveContainer" containerID="ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4" Jun 03 20:48:49.245571 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.245556 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4"} err="failed to get container status \"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4\": rpc error: code = NotFound desc = could not find container \"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4\": container with ID starting with ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4 not found: ID does not exist" Jun 03 20:48:49.245610 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.245571 2577 scope.go:117] "RemoveContainer" containerID="d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba" Jun 03 20:48:49.245739 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.245723 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba"} err="failed to get container status \"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba\": rpc error: code = NotFound desc = could not find container \"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba\": container with ID starting with d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba not found: ID does not exist" Jun 03 20:48:49.245776 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.245739 2577 scope.go:117] "RemoveContainer" containerID="dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f" Jun 03 20:48:49.245955 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.245937 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f"} err="failed to get container status \"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f\": rpc error: code = NotFound desc = could not find container \"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f\": container with ID starting with dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f not found: ID does not exist" Jun 03 20:48:49.245990 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.245957 2577 scope.go:117] "RemoveContainer" containerID="df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5" Jun 03 20:48:49.246189 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.246171 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5"} err="failed to get container status \"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5\": rpc error: code = NotFound desc = could not find container \"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5\": container with ID starting with df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5 not found: ID does not exist" Jun 03 20:48:49.246233 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.246191 2577 scope.go:117] "RemoveContainer" containerID="313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943" Jun 03 20:48:49.246434 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.246416 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943"} err="failed to get container status \"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943\": rpc error: code = NotFound desc = could not find container \"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943\": container with ID starting with 313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943 not found: ID does not exist" Jun 03 20:48:49.246482 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.246435 2577 scope.go:117] "RemoveContainer" containerID="0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2" Jun 03 20:48:49.246636 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.246620 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2"} err="failed to get container status \"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2\": rpc error: code = NotFound desc = could not find container \"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2\": container with ID starting with 0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2 not found: ID does not exist" Jun 03 20:48:49.246675 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.246636 2577 scope.go:117] "RemoveContainer" containerID="1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45" Jun 03 20:48:49.246822 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.246805 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45"} err="failed to get container status \"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45\": rpc error: code = NotFound desc = could not find container \"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45\": container with ID starting with 1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45 not found: ID does not exist" Jun 03 20:48:49.246861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.246823 2577 scope.go:117] "RemoveContainer" containerID="ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4" Jun 03 20:48:49.247004 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.246989 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4"} err="failed to get container status \"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4\": rpc error: code = NotFound desc = could not find container \"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4\": container with ID starting with ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4 not found: ID does not exist" Jun 03 20:48:49.247047 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.247004 2577 scope.go:117] "RemoveContainer" containerID="d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba" Jun 03 20:48:49.247178 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.247161 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba"} err="failed to get container status \"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba\": rpc error: code = NotFound desc = could not find container \"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba\": container with ID starting with d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba not found: ID does not exist" Jun 03 20:48:49.247216 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.247178 2577 scope.go:117] "RemoveContainer" containerID="dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f" Jun 03 20:48:49.247384 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.247365 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f"} err="failed to get container status \"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f\": rpc error: code = NotFound desc = could not find container \"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f\": container with ID starting with dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f not found: ID does not exist" Jun 03 20:48:49.247451 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.247385 2577 scope.go:117] "RemoveContainer" containerID="df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5" Jun 03 20:48:49.247605 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.247582 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5"} err="failed to get container status \"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5\": rpc error: code = NotFound desc = could not find container \"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5\": container with ID starting with df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5 not found: ID does not exist" Jun 03 20:48:49.247660 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.247635 2577 scope.go:117] "RemoveContainer" containerID="313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943" Jun 03 20:48:49.247897 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.247879 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943"} err="failed to get container status \"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943\": rpc error: code = NotFound desc = could not find container \"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943\": container with ID starting with 313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943 not found: ID does not exist" Jun 03 20:48:49.247955 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.247902 2577 scope.go:117] "RemoveContainer" containerID="0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2" Jun 03 20:48:49.248118 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.248102 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2"} err="failed to get container status \"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2\": rpc error: code = NotFound desc = could not find container \"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2\": container with ID starting with 0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2 not found: ID does not exist" Jun 03 20:48:49.248118 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.248117 2577 scope.go:117] "RemoveContainer" containerID="1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45" Jun 03 20:48:49.248354 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.248328 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45"} err="failed to get container status \"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45\": rpc error: code = NotFound desc = could not find container \"1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45\": container with ID starting with 1a7de057cdb902f1bc2022488fe0180a0645c63e062f13d6e1db1c390a637e45 not found: ID does not exist" Jun 03 20:48:49.248426 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.248362 2577 scope.go:117] "RemoveContainer" containerID="ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4" Jun 03 20:48:49.248569 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.248550 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4"} err="failed to get container status \"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4\": rpc error: code = NotFound desc = could not find container \"ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4\": container with ID starting with ae34a8d80b9a2d1a7d714ea92c071e1c15deb1ba6644884c591f2aa5361c92b4 not found: ID does not exist" Jun 03 20:48:49.248619 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.248569 2577 scope.go:117] "RemoveContainer" containerID="d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba" Jun 03 20:48:49.248764 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.248744 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba"} err="failed to get container status \"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba\": rpc error: code = NotFound desc = could not find container \"d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba\": container with ID starting with d0e65ba641c6fc5a015f70b3cbf4e0b6426343dc6021be72a93912070e325eba not found: ID does not exist" Jun 03 20:48:49.248828 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.248766 2577 scope.go:117] "RemoveContainer" containerID="dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f" Jun 03 20:48:49.248972 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.248954 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f"} err="failed to get container status \"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f\": rpc error: code = NotFound desc = could not find container \"dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f\": container with ID starting with dd1505e5cc04d13f3ea5acfc58a7650108a1973d670e9d3ed5f624a80b04fa3f not found: ID does not exist" Jun 03 20:48:49.249038 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.248974 2577 scope.go:117] "RemoveContainer" containerID="df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5" Jun 03 20:48:49.249089 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.249074 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.249232 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.249207 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5"} err="failed to get container status \"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5\": rpc error: code = NotFound desc = could not find container \"df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5\": container with ID starting with df36d0b1b68528f1f49c0ca058e3978eb0145bc8cb3dd62cb919700c5986f0b5 not found: ID does not exist" Jun 03 20:48:49.249232 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.249228 2577 scope.go:117] "RemoveContainer" containerID="313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943" Jun 03 20:48:49.249718 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.249696 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943"} err="failed to get container status \"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943\": rpc error: code = NotFound desc = could not find container \"313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943\": container with ID starting with 313a4f0cb34c485cd1e506542a9159709a87265583d3c7a448aec3886823b943 not found: ID does not exist" Jun 03 20:48:49.249804 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.249721 2577 scope.go:117] "RemoveContainer" containerID="0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2" Jun 03 20:48:49.249967 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.249946 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2"} err="failed to get container status \"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2\": rpc error: code = NotFound desc = could not find container \"0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2\": container with ID starting with 0356caf6b7a42285cdae52bfa77e7f3e7e9325160ca382d1e07cd9a56eff3eb2 not found: ID does not exist" Jun 03 20:48:49.252141 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.252111 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 20:48:49.252141 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.252120 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 20:48:49.252297 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.252120 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 20:48:49.252297 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.252163 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 20:48:49.252297 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.252227 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 20:48:49.252470 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.252118 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cwfzx\"" Jun 03 20:48:49.252528 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.252468 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 20:48:49.252528 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.252476 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 20:48:49.252528 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.252509 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 20:48:49.252528 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.252519 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 20:48:49.252949 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.252918 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 20:48:49.253056 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.253037 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 20:48:49.253125 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.253077 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 03 20:48:49.253385 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.253366 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-83pv6brsrq2a\"" Jun 03 20:48:49.254191 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.254172 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 03 20:48:49.255243 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.255225 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 20:48:49.257856 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.257838 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 20:48:49.264876 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.264856 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:48:49.364855 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.364817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e255420-665d-4c05-a5c2-d4bfd370cad5-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.364855 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.364855 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365064 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.364881 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365064 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.364906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365064 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.364965 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365064 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.365010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e255420-665d-4c05-a5c2-d4bfd370cad5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365064 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.365054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365221 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.365075 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e255420-665d-4c05-a5c2-d4bfd370cad5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365221 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.365092 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365221 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.365115 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365221 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.365151 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-config\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365221 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.365170 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365221 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.365185 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365221 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.365201 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365221 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.365220 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365461 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.365247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365461 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.365286 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365461 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.365315 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365461 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.365365 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dfnt\" (UniqueName: \"kubernetes.io/projected/0e255420-665d-4c05-a5c2-d4bfd370cad5-kube-api-access-6dfnt\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.365461 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.365421 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466096 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466050 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466294 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466106 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-config\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466294 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466179 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466294 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466218 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466294 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466241 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466294 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466274 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466594 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466594 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466594 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466594 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dfnt\" (UniqueName: \"kubernetes.io/projected/0e255420-665d-4c05-a5c2-d4bfd370cad5-kube-api-access-6dfnt\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466594 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466594 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e255420-665d-4c05-a5c2-d4bfd370cad5-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466594 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466589 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466913 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466616 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466913 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466643 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466913 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466675 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466913 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466700 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e255420-665d-4c05-a5c2-d4bfd370cad5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466913 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466913 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466783 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e255420-665d-4c05-a5c2-d4bfd370cad5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.466913 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.466813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.467242 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.467119 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.467242 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.467119 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.469278 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.469251 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.469420 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.469313 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.469420 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.469369 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-config\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.469897 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.469789 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.469897 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.469800 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.469897 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.469859 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.470375 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.470172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e255420-665d-4c05-a5c2-d4bfd370cad5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.470375 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.470358 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.470527 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.470406 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.470790 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.470720 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.471008 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.470983 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.471088 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.471023 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.471505 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.471486 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.471917 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.471896 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e255420-665d-4c05-a5c2-d4bfd370cad5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.471970 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.471897 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e255420-665d-4c05-a5c2-d4bfd370cad5-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.472719 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.472701 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e255420-665d-4c05-a5c2-d4bfd370cad5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.473501 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.473484 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e255420-665d-4c05-a5c2-d4bfd370cad5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.477386 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.477365 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dfnt\" (UniqueName: \"kubernetes.io/projected/0e255420-665d-4c05-a5c2-d4bfd370cad5-kube-api-access-6dfnt\") pod \"prometheus-k8s-0\" (UID: \"0e255420-665d-4c05-a5c2-d4bfd370cad5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.559569 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.559486 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:48:49.697603 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.697569 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 20:48:49.700532 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:48:49.700503 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e255420_665d_4c05_a5c2_d4bfd370cad5.slice/crio-1b02c7b30c40c8b0600893608086a61c9e89bf47ba2b8679b4fd2d12a307aaa2 WatchSource:0}: Error finding container 1b02c7b30c40c8b0600893608086a61c9e89bf47ba2b8679b4fd2d12a307aaa2: Status 404 returned error can't find the container with id 1b02c7b30c40c8b0600893608086a61c9e89bf47ba2b8679b4fd2d12a307aaa2 Jun 03 20:48:49.894527 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:49.894444 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="519374e6-b71b-4d87-9fa2-56519b66cb54" path="/var/lib/kubelet/pods/519374e6-b71b-4d87-9fa2-56519b66cb54/volumes" Jun 03 20:48:50.188528 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:50.188499 2577 generic.go:356] "Generic (PLEG): container finished" podID="0e255420-665d-4c05-a5c2-d4bfd370cad5" containerID="94f03db207ec14e645a6f91b5be7de2c421060aba893b66c738d843274dd72ea" exitCode=0 Jun 03 20:48:50.188924 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:50.188593 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e255420-665d-4c05-a5c2-d4bfd370cad5","Type":"ContainerDied","Data":"94f03db207ec14e645a6f91b5be7de2c421060aba893b66c738d843274dd72ea"} Jun 03 20:48:50.188924 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:50.188674 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e255420-665d-4c05-a5c2-d4bfd370cad5","Type":"ContainerStarted","Data":"1b02c7b30c40c8b0600893608086a61c9e89bf47ba2b8679b4fd2d12a307aaa2"} Jun 03 20:48:51.197279 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:51.197243 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e255420-665d-4c05-a5c2-d4bfd370cad5","Type":"ContainerStarted","Data":"d8cf6323d1e1fdd5cd8bea2501c0e58a17fa29f86df71ae5874c59bac795486e"} Jun 03 20:48:51.197741 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:51.197336 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e255420-665d-4c05-a5c2-d4bfd370cad5","Type":"ContainerStarted","Data":"d4a32eca76b6d359709d92f7be6d7d35ac5261893b4efe531cb012de676f5f8c"} Jun 03 20:48:51.197741 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:51.197378 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e255420-665d-4c05-a5c2-d4bfd370cad5","Type":"ContainerStarted","Data":"db02298dc4df05497936c06a304b916949593a5d065c7723f72d965fc28ade6f"} Jun 03 20:48:51.197741 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:51.197403 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e255420-665d-4c05-a5c2-d4bfd370cad5","Type":"ContainerStarted","Data":"fb68a6dbe90692934642bdf75ab894a44b82f89965da5920d0041feedfedd73d"} Jun 03 20:48:51.197741 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:51.197426 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e255420-665d-4c05-a5c2-d4bfd370cad5","Type":"ContainerStarted","Data":"b3fc81373dbead60b970e9d9cb98b22aee5656079c84f826e58e8b8bf0ef4be3"} Jun 03 20:48:51.197741 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:51.197450 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e255420-665d-4c05-a5c2-d4bfd370cad5","Type":"ContainerStarted","Data":"fff52fc81c38e83a224e2f8636b126d3cc0bf9288fba36cd420fa2c1769773f8"} Jun 03 20:48:51.227657 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:51.227604 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.208372969 podStartE2EDuration="2.227588223s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.215254ms" isStatefulPod=false podCreationTimestamp="2026-06-03 20:48:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:48:51.22504807 +0000 UTC m=+333.826275063" watchObservedRunningTime="2026-06-03 20:48:51.227588223 +0000 UTC m=+333.828815620" Jun 03 20:48:54.560097 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:48:54.560001 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:49:02.080202 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:02.080166 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-686ccb4947-zlb7q"] Jun 03 20:49:09.053794 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.053753 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" podUID="3869bb16-98d6-4fcf-810c-83d235e8670f" containerName="registry" containerID="cri-o://1d9e0fb3d6aa1638b233678e4b9359825032c67174896f0962cd10fb4ebebb10" gracePeriod=30 Jun 03 20:49:09.287800 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.287762 2577 generic.go:356] "Generic (PLEG): container finished" podID="3869bb16-98d6-4fcf-810c-83d235e8670f" containerID="1d9e0fb3d6aa1638b233678e4b9359825032c67174896f0962cd10fb4ebebb10" exitCode=0 Jun 03 20:49:09.287980 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.287828 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" event={"ID":"3869bb16-98d6-4fcf-810c-83d235e8670f","Type":"ContainerDied","Data":"1d9e0fb3d6aa1638b233678e4b9359825032c67174896f0962cd10fb4ebebb10"} Jun 03 20:49:09.308220 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.308163 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:49:09.356326 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.355796 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3869bb16-98d6-4fcf-810c-83d235e8670f-image-registry-private-configuration\") pod \"3869bb16-98d6-4fcf-810c-83d235e8670f\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " Jun 03 20:49:09.356326 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.355850 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-certificates\") pod \"3869bb16-98d6-4fcf-810c-83d235e8670f\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " Jun 03 20:49:09.356326 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.355878 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls\") pod \"3869bb16-98d6-4fcf-810c-83d235e8670f\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " Jun 03 20:49:09.356326 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.355906 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sn7sk\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-kube-api-access-sn7sk\") pod \"3869bb16-98d6-4fcf-810c-83d235e8670f\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " Jun 03 20:49:09.356326 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.355945 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3869bb16-98d6-4fcf-810c-83d235e8670f-trusted-ca\") pod \"3869bb16-98d6-4fcf-810c-83d235e8670f\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " Jun 03 20:49:09.356326 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.355975 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3869bb16-98d6-4fcf-810c-83d235e8670f-ca-trust-extracted\") pod \"3869bb16-98d6-4fcf-810c-83d235e8670f\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " Jun 03 20:49:09.356326 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.356043 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3869bb16-98d6-4fcf-810c-83d235e8670f-installation-pull-secrets\") pod \"3869bb16-98d6-4fcf-810c-83d235e8670f\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " Jun 03 20:49:09.356326 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.356116 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-bound-sa-token\") pod \"3869bb16-98d6-4fcf-810c-83d235e8670f\" (UID: \"3869bb16-98d6-4fcf-810c-83d235e8670f\") " Jun 03 20:49:09.357533 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.357254 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3869bb16-98d6-4fcf-810c-83d235e8670f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3869bb16-98d6-4fcf-810c-83d235e8670f" (UID: "3869bb16-98d6-4fcf-810c-83d235e8670f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:49:09.357681 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.357528 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3869bb16-98d6-4fcf-810c-83d235e8670f" (UID: "3869bb16-98d6-4fcf-810c-83d235e8670f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:49:09.359410 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.359373 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3869bb16-98d6-4fcf-810c-83d235e8670f" (UID: "3869bb16-98d6-4fcf-810c-83d235e8670f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:49:09.359537 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.359505 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3869bb16-98d6-4fcf-810c-83d235e8670f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3869bb16-98d6-4fcf-810c-83d235e8670f" (UID: "3869bb16-98d6-4fcf-810c-83d235e8670f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:49:09.360221 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.360181 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3869bb16-98d6-4fcf-810c-83d235e8670f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3869bb16-98d6-4fcf-810c-83d235e8670f" (UID: "3869bb16-98d6-4fcf-810c-83d235e8670f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:49:09.360555 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.360532 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3869bb16-98d6-4fcf-810c-83d235e8670f" (UID: "3869bb16-98d6-4fcf-810c-83d235e8670f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:49:09.360695 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.360660 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-kube-api-access-sn7sk" (OuterVolumeSpecName: "kube-api-access-sn7sk") pod "3869bb16-98d6-4fcf-810c-83d235e8670f" (UID: "3869bb16-98d6-4fcf-810c-83d235e8670f"). InnerVolumeSpecName "kube-api-access-sn7sk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:49:09.367981 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.367956 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3869bb16-98d6-4fcf-810c-83d235e8670f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3869bb16-98d6-4fcf-810c-83d235e8670f" (UID: "3869bb16-98d6-4fcf-810c-83d235e8670f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 20:49:09.457232 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.457191 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-bound-sa-token\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:49:09.457232 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.457225 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3869bb16-98d6-4fcf-810c-83d235e8670f-image-registry-private-configuration\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:49:09.457232 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.457239 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-certificates\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:49:09.457548 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.457252 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-registry-tls\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:49:09.457548 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.457264 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sn7sk\" (UniqueName: \"kubernetes.io/projected/3869bb16-98d6-4fcf-810c-83d235e8670f-kube-api-access-sn7sk\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:49:09.457548 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.457274 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3869bb16-98d6-4fcf-810c-83d235e8670f-trusted-ca\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:49:09.457548 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.457285 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3869bb16-98d6-4fcf-810c-83d235e8670f-ca-trust-extracted\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:49:09.457548 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:09.457297 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3869bb16-98d6-4fcf-810c-83d235e8670f-installation-pull-secrets\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:49:10.293295 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:10.293262 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" Jun 03 20:49:10.293729 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:10.293291 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b886f49b-c8rzs" event={"ID":"3869bb16-98d6-4fcf-810c-83d235e8670f","Type":"ContainerDied","Data":"d7bcf6b1fdee2295af8667696ef46469e9a56e514f7d92068fb195521d2ebb25"} Jun 03 20:49:10.293729 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:10.293392 2577 scope.go:117] "RemoveContainer" containerID="1d9e0fb3d6aa1638b233678e4b9359825032c67174896f0962cd10fb4ebebb10" Jun 03 20:49:10.311857 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:10.311828 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64b886f49b-c8rzs"] Jun 03 20:49:10.316167 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:10.316141 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64b886f49b-c8rzs"] Jun 03 20:49:11.894019 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:11.893986 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3869bb16-98d6-4fcf-810c-83d235e8670f" path="/var/lib/kubelet/pods/3869bb16-98d6-4fcf-810c-83d235e8670f/volumes" Jun 03 20:49:27.100916 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.100864 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-686ccb4947-zlb7q" podUID="716ab7dd-f6ac-4014-a223-5c0beacdfb3f" containerName="console" containerID="cri-o://cab3151a434c756f61e9be280c92d0851e074270ce8a54fce8ba19e8026750f0" gracePeriod=15 Jun 03 20:49:27.351443 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.351377 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:49:27.364823 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.364791 2577 generic.go:356] "Generic (PLEG): container finished" podID="716ab7dd-f6ac-4014-a223-5c0beacdfb3f" containerID="cab3151a434c756f61e9be280c92d0851e074270ce8a54fce8ba19e8026750f0" exitCode=0 Jun 03 20:49:27.364958 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.364831 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686ccb4947-zlb7q" Jun 03 20:49:27.364958 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.364878 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686ccb4947-zlb7q" event={"ID":"716ab7dd-f6ac-4014-a223-5c0beacdfb3f","Type":"ContainerDied","Data":"cab3151a434c756f61e9be280c92d0851e074270ce8a54fce8ba19e8026750f0"} Jun 03 20:49:27.365035 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.364973 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686ccb4947-zlb7q" event={"ID":"716ab7dd-f6ac-4014-a223-5c0beacdfb3f","Type":"ContainerDied","Data":"aef838ebd55cb4896a1a3956fa68de4d323ef00222978395284e17d1c1776d60"} Jun 03 20:49:27.365035 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.364998 2577 scope.go:117] "RemoveContainer" containerID="cab3151a434c756f61e9be280c92d0851e074270ce8a54fce8ba19e8026750f0" Jun 03 20:49:27.374571 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.374551 2577 scope.go:117] "RemoveContainer" containerID="cab3151a434c756f61e9be280c92d0851e074270ce8a54fce8ba19e8026750f0" Jun 03 20:49:27.374847 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:49:27.374827 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cab3151a434c756f61e9be280c92d0851e074270ce8a54fce8ba19e8026750f0\": container with ID starting with cab3151a434c756f61e9be280c92d0851e074270ce8a54fce8ba19e8026750f0 not found: ID does not exist" containerID="cab3151a434c756f61e9be280c92d0851e074270ce8a54fce8ba19e8026750f0" Jun 03 20:49:27.374912 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.374860 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cab3151a434c756f61e9be280c92d0851e074270ce8a54fce8ba19e8026750f0"} err="failed to get container status \"cab3151a434c756f61e9be280c92d0851e074270ce8a54fce8ba19e8026750f0\": rpc error: code = NotFound desc = could not find container \"cab3151a434c756f61e9be280c92d0851e074270ce8a54fce8ba19e8026750f0\": container with ID starting with cab3151a434c756f61e9be280c92d0851e074270ce8a54fce8ba19e8026750f0 not found: ID does not exist" Jun 03 20:49:27.414322 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.414285 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-trusted-ca-bundle\") pod \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " Jun 03 20:49:27.414514 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.414376 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-oauth-serving-cert\") pod \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " Jun 03 20:49:27.414514 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.414404 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-oauth-config\") pod \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " Jun 03 20:49:27.414514 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.414450 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-service-ca\") pod \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " Jun 03 20:49:27.414514 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.414477 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-serving-cert\") pod \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " Jun 03 20:49:27.414514 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.414512 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-config\") pod \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " Jun 03 20:49:27.414763 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.414542 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6bbq\" (UniqueName: \"kubernetes.io/projected/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-kube-api-access-k6bbq\") pod \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\" (UID: \"716ab7dd-f6ac-4014-a223-5c0beacdfb3f\") " Jun 03 20:49:27.414890 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.414754 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "716ab7dd-f6ac-4014-a223-5c0beacdfb3f" (UID: "716ab7dd-f6ac-4014-a223-5c0beacdfb3f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:49:27.414890 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.414879 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-service-ca" (OuterVolumeSpecName: "service-ca") pod "716ab7dd-f6ac-4014-a223-5c0beacdfb3f" (UID: "716ab7dd-f6ac-4014-a223-5c0beacdfb3f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:49:27.415014 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.414736 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "716ab7dd-f6ac-4014-a223-5c0beacdfb3f" (UID: "716ab7dd-f6ac-4014-a223-5c0beacdfb3f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:49:27.415014 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.414955 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-config" (OuterVolumeSpecName: "console-config") pod "716ab7dd-f6ac-4014-a223-5c0beacdfb3f" (UID: "716ab7dd-f6ac-4014-a223-5c0beacdfb3f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 20:49:27.415125 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.415107 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-trusted-ca-bundle\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:49:27.415181 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.415132 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-oauth-serving-cert\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:49:27.415181 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.415147 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-service-ca\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:49:27.415181 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.415162 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-config\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:49:27.416833 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.416803 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "716ab7dd-f6ac-4014-a223-5c0beacdfb3f" (UID: "716ab7dd-f6ac-4014-a223-5c0beacdfb3f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:49:27.416941 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.416860 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "716ab7dd-f6ac-4014-a223-5c0beacdfb3f" (UID: "716ab7dd-f6ac-4014-a223-5c0beacdfb3f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 20:49:27.416941 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.416903 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-kube-api-access-k6bbq" (OuterVolumeSpecName: "kube-api-access-k6bbq") pod "716ab7dd-f6ac-4014-a223-5c0beacdfb3f" (UID: "716ab7dd-f6ac-4014-a223-5c0beacdfb3f"). InnerVolumeSpecName "kube-api-access-k6bbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:49:27.515824 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.515780 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6bbq\" (UniqueName: \"kubernetes.io/projected/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-kube-api-access-k6bbq\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:49:27.515824 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.515816 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-oauth-config\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:49:27.515824 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.515830 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/716ab7dd-f6ac-4014-a223-5c0beacdfb3f-console-serving-cert\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:49:27.687796 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.687767 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-686ccb4947-zlb7q"] Jun 03 20:49:27.691470 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.691425 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-686ccb4947-zlb7q"] Jun 03 20:49:27.894106 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:27.894074 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="716ab7dd-f6ac-4014-a223-5c0beacdfb3f" path="/var/lib/kubelet/pods/716ab7dd-f6ac-4014-a223-5c0beacdfb3f/volumes" Jun 03 20:49:49.560462 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:49.560410 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:49:49.576254 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:49.576228 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:49:50.480621 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:49:50.480595 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 20:51:28.809449 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:28.809411 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-xmfdh"] Jun 03 20:51:28.809915 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:28.809741 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3869bb16-98d6-4fcf-810c-83d235e8670f" containerName="registry" Jun 03 20:51:28.809915 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:28.809752 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3869bb16-98d6-4fcf-810c-83d235e8670f" containerName="registry" Jun 03 20:51:28.809915 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:28.809769 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716ab7dd-f6ac-4014-a223-5c0beacdfb3f" containerName="console" Jun 03 20:51:28.809915 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:28.809775 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="716ab7dd-f6ac-4014-a223-5c0beacdfb3f" containerName="console" Jun 03 20:51:28.809915 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:28.809831 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3869bb16-98d6-4fcf-810c-83d235e8670f" containerName="registry" Jun 03 20:51:28.809915 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:28.809841 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="716ab7dd-f6ac-4014-a223-5c0beacdfb3f" containerName="console" Jun 03 20:51:28.812624 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:28.812609 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-xmfdh" Jun 03 20:51:28.815306 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:28.815283 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 20:51:28.816364 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:28.816331 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 20:51:28.816448 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:28.816336 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-bbtp8\"" Jun 03 20:51:28.820357 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:28.820317 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-xmfdh"] Jun 03 20:51:28.893292 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:28.893260 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6vqj\" (UniqueName: \"kubernetes.io/projected/e60cf7b0-2552-4fb7-b3d6-90e1f36586fd-kube-api-access-z6vqj\") pod \"cert-manager-59c77684cc-xmfdh\" (UID: \"e60cf7b0-2552-4fb7-b3d6-90e1f36586fd\") " pod="cert-manager/cert-manager-59c77684cc-xmfdh" Jun 03 20:51:28.893486 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:28.893306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e60cf7b0-2552-4fb7-b3d6-90e1f36586fd-bound-sa-token\") pod \"cert-manager-59c77684cc-xmfdh\" (UID: \"e60cf7b0-2552-4fb7-b3d6-90e1f36586fd\") " pod="cert-manager/cert-manager-59c77684cc-xmfdh" Jun 03 20:51:28.993845 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:28.993804 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e60cf7b0-2552-4fb7-b3d6-90e1f36586fd-bound-sa-token\") pod \"cert-manager-59c77684cc-xmfdh\" (UID: \"e60cf7b0-2552-4fb7-b3d6-90e1f36586fd\") " pod="cert-manager/cert-manager-59c77684cc-xmfdh" Jun 03 20:51:28.994029 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:28.993896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6vqj\" (UniqueName: \"kubernetes.io/projected/e60cf7b0-2552-4fb7-b3d6-90e1f36586fd-kube-api-access-z6vqj\") pod \"cert-manager-59c77684cc-xmfdh\" (UID: \"e60cf7b0-2552-4fb7-b3d6-90e1f36586fd\") " pod="cert-manager/cert-manager-59c77684cc-xmfdh" Jun 03 20:51:29.002261 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:29.002228 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e60cf7b0-2552-4fb7-b3d6-90e1f36586fd-bound-sa-token\") pod \"cert-manager-59c77684cc-xmfdh\" (UID: \"e60cf7b0-2552-4fb7-b3d6-90e1f36586fd\") " pod="cert-manager/cert-manager-59c77684cc-xmfdh" Jun 03 20:51:29.002409 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:29.002396 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6vqj\" (UniqueName: \"kubernetes.io/projected/e60cf7b0-2552-4fb7-b3d6-90e1f36586fd-kube-api-access-z6vqj\") pod \"cert-manager-59c77684cc-xmfdh\" (UID: \"e60cf7b0-2552-4fb7-b3d6-90e1f36586fd\") " pod="cert-manager/cert-manager-59c77684cc-xmfdh" Jun 03 20:51:29.133141 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:29.133048 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-xmfdh" Jun 03 20:51:29.271457 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:29.271434 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-xmfdh"] Jun 03 20:51:29.273743 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:51:29.273706 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode60cf7b0_2552_4fb7_b3d6_90e1f36586fd.slice/crio-b1bd9f703c6c0ae2323431fe1724f695504ae3f0df84f123fb846f5dc227f718 WatchSource:0}: Error finding container b1bd9f703c6c0ae2323431fe1724f695504ae3f0df84f123fb846f5dc227f718: Status 404 returned error can't find the container with id b1bd9f703c6c0ae2323431fe1724f695504ae3f0df84f123fb846f5dc227f718 Jun 03 20:51:29.275751 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:29.275733 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 20:51:29.880849 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:29.880810 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-xmfdh" event={"ID":"e60cf7b0-2552-4fb7-b3d6-90e1f36586fd","Type":"ContainerStarted","Data":"b1bd9f703c6c0ae2323431fe1724f695504ae3f0df84f123fb846f5dc227f718"} Jun 03 20:51:32.897999 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:32.897955 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-xmfdh" event={"ID":"e60cf7b0-2552-4fb7-b3d6-90e1f36586fd","Type":"ContainerStarted","Data":"d46f5a037ed72a12408366a5aa73e997aaf57ce2af3c2badf784a26fd70bc466"} Jun 03 20:51:32.916283 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:32.916232 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-xmfdh" podStartSLOduration=2.048625884 podStartE2EDuration="4.9162176s" totalImagesPullingTime="2.867591716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:51:32.91547216 +0000 UTC m=+495.516699139" watchObservedRunningTime="2026-06-03 20:51:32.9162176 +0000 UTC m=+495.517444580" Jun 03 20:51:48.916126 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:48.916092 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7"] Jun 03 20:51:48.920035 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:48.920009 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:48.923087 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:48.923061 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 20:51:48.923627 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:48.923603 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 20:51:48.923932 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:48.923651 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 20:51:48.924658 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:48.923688 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 20:51:48.924658 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:48.923713 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zlkj8\"" Jun 03 20:51:48.945230 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:48.945195 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7"] Jun 03 20:51:48.978586 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:48.978551 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/500910cf-e806-445d-8506-3d8f9ad74c4f-manifests\") pod \"opendatahub-operator-controller-manager-5965b9645d-lxgw7\" (UID: \"500910cf-e806-445d-8506-3d8f9ad74c4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:48.978740 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:48.978612 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/500910cf-e806-445d-8506-3d8f9ad74c4f-tmp\") pod \"opendatahub-operator-controller-manager-5965b9645d-lxgw7\" (UID: \"500910cf-e806-445d-8506-3d8f9ad74c4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:48.978740 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:48.978649 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xq59\" (UniqueName: \"kubernetes.io/projected/500910cf-e806-445d-8506-3d8f9ad74c4f-kube-api-access-9xq59\") pod \"opendatahub-operator-controller-manager-5965b9645d-lxgw7\" (UID: \"500910cf-e806-445d-8506-3d8f9ad74c4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:48.978740 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:48.978690 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/500910cf-e806-445d-8506-3d8f9ad74c4f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-lxgw7\" (UID: \"500910cf-e806-445d-8506-3d8f9ad74c4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:48.978874 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:48.978737 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/500910cf-e806-445d-8506-3d8f9ad74c4f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-lxgw7\" (UID: \"500910cf-e806-445d-8506-3d8f9ad74c4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:49.079367 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:49.079303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/500910cf-e806-445d-8506-3d8f9ad74c4f-tmp\") pod \"opendatahub-operator-controller-manager-5965b9645d-lxgw7\" (UID: \"500910cf-e806-445d-8506-3d8f9ad74c4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:49.079546 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:49.079383 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xq59\" (UniqueName: \"kubernetes.io/projected/500910cf-e806-445d-8506-3d8f9ad74c4f-kube-api-access-9xq59\") pod \"opendatahub-operator-controller-manager-5965b9645d-lxgw7\" (UID: \"500910cf-e806-445d-8506-3d8f9ad74c4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:49.079546 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:49.079439 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/500910cf-e806-445d-8506-3d8f9ad74c4f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-lxgw7\" (UID: \"500910cf-e806-445d-8506-3d8f9ad74c4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:49.079546 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:49.079478 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/500910cf-e806-445d-8506-3d8f9ad74c4f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-lxgw7\" (UID: \"500910cf-e806-445d-8506-3d8f9ad74c4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:49.079546 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:49.079522 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/500910cf-e806-445d-8506-3d8f9ad74c4f-manifests\") pod \"opendatahub-operator-controller-manager-5965b9645d-lxgw7\" (UID: \"500910cf-e806-445d-8506-3d8f9ad74c4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:49.079876 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:49.079850 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/500910cf-e806-445d-8506-3d8f9ad74c4f-manifests\") pod \"opendatahub-operator-controller-manager-5965b9645d-lxgw7\" (UID: \"500910cf-e806-445d-8506-3d8f9ad74c4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:49.081739 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:49.081713 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/500910cf-e806-445d-8506-3d8f9ad74c4f-tmp\") pod \"opendatahub-operator-controller-manager-5965b9645d-lxgw7\" (UID: \"500910cf-e806-445d-8506-3d8f9ad74c4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:49.081862 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:49.081842 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/500910cf-e806-445d-8506-3d8f9ad74c4f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-lxgw7\" (UID: \"500910cf-e806-445d-8506-3d8f9ad74c4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:49.081928 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:49.081906 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/500910cf-e806-445d-8506-3d8f9ad74c4f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5965b9645d-lxgw7\" (UID: \"500910cf-e806-445d-8506-3d8f9ad74c4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:49.090463 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:49.090443 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xq59\" (UniqueName: \"kubernetes.io/projected/500910cf-e806-445d-8506-3d8f9ad74c4f-kube-api-access-9xq59\") pod \"opendatahub-operator-controller-manager-5965b9645d-lxgw7\" (UID: \"500910cf-e806-445d-8506-3d8f9ad74c4f\") " pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:49.232291 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:49.232251 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:49.397963 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:49.397933 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7"] Jun 03 20:51:49.400473 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:51:49.400431 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod500910cf_e806_445d_8506_3d8f9ad74c4f.slice/crio-dced1835fa1111a395ad702e3c60bfb02fcafc971ef3a7846402b94ac459d1cc WatchSource:0}: Error finding container dced1835fa1111a395ad702e3c60bfb02fcafc971ef3a7846402b94ac459d1cc: Status 404 returned error can't find the container with id dced1835fa1111a395ad702e3c60bfb02fcafc971ef3a7846402b94ac459d1cc Jun 03 20:51:49.971966 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:49.971923 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" event={"ID":"500910cf-e806-445d-8506-3d8f9ad74c4f","Type":"ContainerStarted","Data":"dced1835fa1111a395ad702e3c60bfb02fcafc971ef3a7846402b94ac459d1cc"} Jun 03 20:51:52.988039 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:52.988003 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" event={"ID":"500910cf-e806-445d-8506-3d8f9ad74c4f","Type":"ContainerStarted","Data":"7c385f90aa4264b15354fafec0fa896a7071fe1ebac3b4e81a95e0999cc188cc"} Jun 03 20:51:53.993787 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:53.993698 2577 generic.go:356] "Generic (PLEG): container finished" podID="500910cf-e806-445d-8506-3d8f9ad74c4f" containerID="7c385f90aa4264b15354fafec0fa896a7071fe1ebac3b4e81a95e0999cc188cc" exitCode=0 Jun 03 20:51:53.993787 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:53.993767 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" event={"ID":"500910cf-e806-445d-8506-3d8f9ad74c4f","Type":"ContainerDied","Data":"7c385f90aa4264b15354fafec0fa896a7071fe1ebac3b4e81a95e0999cc188cc"} Jun 03 20:51:54.999876 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:54.999841 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" event={"ID":"500910cf-e806-445d-8506-3d8f9ad74c4f","Type":"ContainerStarted","Data":"e4be8b3ee0767205fbaed9430c40d63e100e4113a0ba78c508d3e564f77fe22b"} Jun 03 20:51:55.000261 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:55.000074 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:51:55.024119 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:51:55.024061 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" podStartSLOduration=2.870717157 podStartE2EDuration="7.024041344s" totalImagesPullingTime="3.096669643s" totalInitContainerRuntime="1.056654544s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:51:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:51:55.021301203 +0000 UTC m=+517.622528181" watchObservedRunningTime="2026-06-03 20:51:55.024041344 +0000 UTC m=+517.625268326" Jun 03 20:52:06.007244 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:06.007210 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5965b9645d-lxgw7" Jun 03 20:52:07.854294 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:07.854260 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586"] Jun 03 20:52:07.971809 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:07.971709 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586"] Jun 03 20:52:07.972131 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:07.971855 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" Jun 03 20:52:07.975732 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:07.975709 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 20:52:07.975866 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:07.975739 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 20:52:07.976904 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:07.976883 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 20:52:07.977015 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:07.976961 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 20:52:07.977082 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:07.977033 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 20:52:07.977082 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:07.977034 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6cslz\"" Jun 03 20:52:08.153814 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.153728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chb5z\" (UniqueName: \"kubernetes.io/projected/a2ef8638-36c4-4e57-8f6d-e44962cac61e-kube-api-access-chb5z\") pod \"lws-controller-manager-79d7d4f4f7-zv586\" (UID: \"a2ef8638-36c4-4e57-8f6d-e44962cac61e\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" Jun 03 20:52:08.153814 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.153784 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a2ef8638-36c4-4e57-8f6d-e44962cac61e-manager-config\") pod \"lws-controller-manager-79d7d4f4f7-zv586\" (UID: \"a2ef8638-36c4-4e57-8f6d-e44962cac61e\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" Jun 03 20:52:08.154092 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.153871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2ef8638-36c4-4e57-8f6d-e44962cac61e-cert\") pod \"lws-controller-manager-79d7d4f4f7-zv586\" (UID: \"a2ef8638-36c4-4e57-8f6d-e44962cac61e\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" Jun 03 20:52:08.154092 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.153927 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2ef8638-36c4-4e57-8f6d-e44962cac61e-metrics-cert\") pod \"lws-controller-manager-79d7d4f4f7-zv586\" (UID: \"a2ef8638-36c4-4e57-8f6d-e44962cac61e\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" Jun 03 20:52:08.254952 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.254913 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2ef8638-36c4-4e57-8f6d-e44962cac61e-cert\") pod \"lws-controller-manager-79d7d4f4f7-zv586\" (UID: \"a2ef8638-36c4-4e57-8f6d-e44962cac61e\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" Jun 03 20:52:08.255133 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.254959 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2ef8638-36c4-4e57-8f6d-e44962cac61e-metrics-cert\") pod \"lws-controller-manager-79d7d4f4f7-zv586\" (UID: \"a2ef8638-36c4-4e57-8f6d-e44962cac61e\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" Jun 03 20:52:08.255133 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.255008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chb5z\" (UniqueName: \"kubernetes.io/projected/a2ef8638-36c4-4e57-8f6d-e44962cac61e-kube-api-access-chb5z\") pod \"lws-controller-manager-79d7d4f4f7-zv586\" (UID: \"a2ef8638-36c4-4e57-8f6d-e44962cac61e\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" Jun 03 20:52:08.255133 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.255035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a2ef8638-36c4-4e57-8f6d-e44962cac61e-manager-config\") pod \"lws-controller-manager-79d7d4f4f7-zv586\" (UID: \"a2ef8638-36c4-4e57-8f6d-e44962cac61e\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" Jun 03 20:52:08.255769 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.255738 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a2ef8638-36c4-4e57-8f6d-e44962cac61e-manager-config\") pod \"lws-controller-manager-79d7d4f4f7-zv586\" (UID: \"a2ef8638-36c4-4e57-8f6d-e44962cac61e\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" Jun 03 20:52:08.257521 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.257500 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2ef8638-36c4-4e57-8f6d-e44962cac61e-cert\") pod \"lws-controller-manager-79d7d4f4f7-zv586\" (UID: \"a2ef8638-36c4-4e57-8f6d-e44962cac61e\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" Jun 03 20:52:08.257699 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.257675 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2ef8638-36c4-4e57-8f6d-e44962cac61e-metrics-cert\") pod \"lws-controller-manager-79d7d4f4f7-zv586\" (UID: \"a2ef8638-36c4-4e57-8f6d-e44962cac61e\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" Jun 03 20:52:08.270642 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.270609 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6d85b7bd-tdksq"] Jun 03 20:52:08.281664 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.281633 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chb5z\" (UniqueName: \"kubernetes.io/projected/a2ef8638-36c4-4e57-8f6d-e44962cac61e-kube-api-access-chb5z\") pod \"lws-controller-manager-79d7d4f4f7-zv586\" (UID: \"a2ef8638-36c4-4e57-8f6d-e44962cac61e\") " pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" Jun 03 20:52:08.281841 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.281826 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" Jun 03 20:52:08.293367 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.293323 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6d85b7bd-tdksq"] Jun 03 20:52:08.293478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.293463 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-tdksq" Jun 03 20:52:08.296811 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.296784 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 20:52:08.296993 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.296971 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 20:52:08.296993 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.296986 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 20:52:08.297209 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.297030 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wfrbp\"" Jun 03 20:52:08.297290 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.297229 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 20:52:08.444763 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.444737 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586"] Jun 03 20:52:08.447394 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:52:08.447366 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ef8638_36c4_4e57_8f6d_e44962cac61e.slice/crio-1dd94363eb7ecbf8866ecb27f4606b7bacca487e6e71d54d72017d398437fb59 WatchSource:0}: Error finding container 1dd94363eb7ecbf8866ecb27f4606b7bacca487e6e71d54d72017d398437fb59: Status 404 returned error can't find the container with id 1dd94363eb7ecbf8866ecb27f4606b7bacca487e6e71d54d72017d398437fb59 Jun 03 20:52:08.457422 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.457391 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjxmx\" (UniqueName: \"kubernetes.io/projected/0ea1f3a8-5686-4b4b-bd54-57fa3fad4999-kube-api-access-wjxmx\") pod \"kube-auth-proxy-5b6d85b7bd-tdksq\" (UID: \"0ea1f3a8-5686-4b4b-bd54-57fa3fad4999\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-tdksq" Jun 03 20:52:08.457526 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.457439 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ea1f3a8-5686-4b4b-bd54-57fa3fad4999-tmp\") pod \"kube-auth-proxy-5b6d85b7bd-tdksq\" (UID: \"0ea1f3a8-5686-4b4b-bd54-57fa3fad4999\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-tdksq" Jun 03 20:52:08.457590 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.457562 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea1f3a8-5686-4b4b-bd54-57fa3fad4999-tls-certs\") pod \"kube-auth-proxy-5b6d85b7bd-tdksq\" (UID: \"0ea1f3a8-5686-4b4b-bd54-57fa3fad4999\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-tdksq" Jun 03 20:52:08.558860 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.558827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea1f3a8-5686-4b4b-bd54-57fa3fad4999-tls-certs\") pod \"kube-auth-proxy-5b6d85b7bd-tdksq\" (UID: \"0ea1f3a8-5686-4b4b-bd54-57fa3fad4999\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-tdksq" Jun 03 20:52:08.559021 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.558928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjxmx\" (UniqueName: \"kubernetes.io/projected/0ea1f3a8-5686-4b4b-bd54-57fa3fad4999-kube-api-access-wjxmx\") pod \"kube-auth-proxy-5b6d85b7bd-tdksq\" (UID: \"0ea1f3a8-5686-4b4b-bd54-57fa3fad4999\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-tdksq" Jun 03 20:52:08.559021 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.558970 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ea1f3a8-5686-4b4b-bd54-57fa3fad4999-tmp\") pod \"kube-auth-proxy-5b6d85b7bd-tdksq\" (UID: \"0ea1f3a8-5686-4b4b-bd54-57fa3fad4999\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-tdksq" Jun 03 20:52:08.561185 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.561159 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ea1f3a8-5686-4b4b-bd54-57fa3fad4999-tmp\") pod \"kube-auth-proxy-5b6d85b7bd-tdksq\" (UID: \"0ea1f3a8-5686-4b4b-bd54-57fa3fad4999\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-tdksq" Jun 03 20:52:08.561369 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.561328 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea1f3a8-5686-4b4b-bd54-57fa3fad4999-tls-certs\") pod \"kube-auth-proxy-5b6d85b7bd-tdksq\" (UID: \"0ea1f3a8-5686-4b4b-bd54-57fa3fad4999\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-tdksq" Jun 03 20:52:08.566663 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.566643 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjxmx\" (UniqueName: \"kubernetes.io/projected/0ea1f3a8-5686-4b4b-bd54-57fa3fad4999-kube-api-access-wjxmx\") pod \"kube-auth-proxy-5b6d85b7bd-tdksq\" (UID: \"0ea1f3a8-5686-4b4b-bd54-57fa3fad4999\") " pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-tdksq" Jun 03 20:52:08.604144 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.604109 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-tdksq" Jun 03 20:52:08.746129 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:08.746006 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6d85b7bd-tdksq"] Jun 03 20:52:08.750683 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:52:08.750654 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea1f3a8_5686_4b4b_bd54_57fa3fad4999.slice/crio-8abd9ac9dbd3a2f3c5d2024f4ba5774d45d7b2c569edfd50b707f4934d24cd30 WatchSource:0}: Error finding container 8abd9ac9dbd3a2f3c5d2024f4ba5774d45d7b2c569edfd50b707f4934d24cd30: Status 404 returned error can't find the container with id 8abd9ac9dbd3a2f3c5d2024f4ba5774d45d7b2c569edfd50b707f4934d24cd30 Jun 03 20:52:09.063708 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:09.063604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" event={"ID":"a2ef8638-36c4-4e57-8f6d-e44962cac61e","Type":"ContainerStarted","Data":"1dd94363eb7ecbf8866ecb27f4606b7bacca487e6e71d54d72017d398437fb59"} Jun 03 20:52:09.067478 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:09.067442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-tdksq" event={"ID":"0ea1f3a8-5686-4b4b-bd54-57fa3fad4999","Type":"ContainerStarted","Data":"8abd9ac9dbd3a2f3c5d2024f4ba5774d45d7b2c569edfd50b707f4934d24cd30"} Jun 03 20:52:13.092454 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:13.092409 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" event={"ID":"a2ef8638-36c4-4e57-8f6d-e44962cac61e","Type":"ContainerStarted","Data":"e91b743bf3930d05ea01c2f027513b5bc1bf183f61ed3652fbab3bdd9e0890d2"} Jun 03 20:52:13.093166 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:13.092482 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" Jun 03 20:52:13.093959 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:13.093939 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-tdksq" event={"ID":"0ea1f3a8-5686-4b4b-bd54-57fa3fad4999","Type":"ContainerStarted","Data":"c20118670d87bd45bebdfb9d6b3a8e91f95891784b70b2781cd3d1b49c384dd6"} Jun 03 20:52:13.110690 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:13.110637 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" podStartSLOduration=2.252351504 podStartE2EDuration="6.110622113s" totalImagesPullingTime="3.858270609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:13.10962268 +0000 UTC m=+535.710849663" watchObservedRunningTime="2026-06-03 20:52:13.110622113 +0000 UTC m=+535.711849092" Jun 03 20:52:13.125678 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:13.125621 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b6d85b7bd-tdksq" podStartSLOduration=1.543474936 podStartE2EDuration="5.125601882s" totalImagesPullingTime="3.582126946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:52:13.125227608 +0000 UTC m=+535.726454592" watchObservedRunningTime="2026-06-03 20:52:13.125601882 +0000 UTC m=+535.726828864" Jun 03 20:52:24.101297 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:52:24.101261 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-79d7d4f4f7-zv586" Jun 03 20:53:17.894053 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:17.894019 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 20:53:17.894549 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:17.894023 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 20:53:52.059226 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.059190 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wdstl"] Jun 03 20:53:52.061907 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.061887 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cdc4bf97d-mnqkm"] Jun 03 20:53:52.062024 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.062008 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdstl" Jun 03 20:53:52.064673 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.064653 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.065512 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.065492 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wv9cj\"" Jun 03 20:53:52.065618 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.065601 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 20:53:52.065758 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.065741 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 20:53:52.067122 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.067106 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 20:53:52.067246 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.067227 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 20:53:52.067627 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.067604 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 20:53:52.067774 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.067756 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 20:53:52.067868 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.067710 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 20:53:52.067868 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.067722 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gqcfk\"" Jun 03 20:53:52.067975 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.067741 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 20:53:52.067975 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.067644 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 20:53:52.075803 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.075784 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wdstl"] Jun 03 20:53:52.075962 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.075942 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 20:53:52.078148 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.078129 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cdc4bf97d-mnqkm"] Jun 03 20:53:52.091938 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.091913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwj5w\" (UniqueName: \"kubernetes.io/projected/23c8428f-95e3-473d-b0a0-31ccf7aa7ea5-kube-api-access-lwj5w\") pod \"authorino-operator-75cc8d5cb7-wdstl\" (UID: \"23c8428f-95e3-473d-b0a0-31ccf7aa7ea5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdstl" Jun 03 20:53:52.193271 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.193234 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24539b12-3912-4ad1-9ed1-e3fbb08323ea-console-config\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.193457 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.193285 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24539b12-3912-4ad1-9ed1-e3fbb08323ea-console-oauth-config\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.193457 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.193402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwj5w\" (UniqueName: \"kubernetes.io/projected/23c8428f-95e3-473d-b0a0-31ccf7aa7ea5-kube-api-access-lwj5w\") pod \"authorino-operator-75cc8d5cb7-wdstl\" (UID: \"23c8428f-95e3-473d-b0a0-31ccf7aa7ea5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdstl" Jun 03 20:53:52.193457 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.193446 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24539b12-3912-4ad1-9ed1-e3fbb08323ea-console-serving-cert\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.193617 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.193465 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24539b12-3912-4ad1-9ed1-e3fbb08323ea-oauth-serving-cert\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.193617 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.193561 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24539b12-3912-4ad1-9ed1-e3fbb08323ea-service-ca\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.193617 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.193605 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24539b12-3912-4ad1-9ed1-e3fbb08323ea-trusted-ca-bundle\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.193773 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.193633 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knmbv\" (UniqueName: \"kubernetes.io/projected/24539b12-3912-4ad1-9ed1-e3fbb08323ea-kube-api-access-knmbv\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.203358 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.203310 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwj5w\" (UniqueName: \"kubernetes.io/projected/23c8428f-95e3-473d-b0a0-31ccf7aa7ea5-kube-api-access-lwj5w\") pod \"authorino-operator-75cc8d5cb7-wdstl\" (UID: \"23c8428f-95e3-473d-b0a0-31ccf7aa7ea5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdstl" Jun 03 20:53:52.294953 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.294912 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24539b12-3912-4ad1-9ed1-e3fbb08323ea-console-oauth-config\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.295196 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.295004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24539b12-3912-4ad1-9ed1-e3fbb08323ea-console-serving-cert\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.295196 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.295025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24539b12-3912-4ad1-9ed1-e3fbb08323ea-oauth-serving-cert\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.295196 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.295073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24539b12-3912-4ad1-9ed1-e3fbb08323ea-service-ca\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.295196 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.295099 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24539b12-3912-4ad1-9ed1-e3fbb08323ea-trusted-ca-bundle\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.295196 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.295124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knmbv\" (UniqueName: \"kubernetes.io/projected/24539b12-3912-4ad1-9ed1-e3fbb08323ea-kube-api-access-knmbv\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.295196 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.295173 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24539b12-3912-4ad1-9ed1-e3fbb08323ea-console-config\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.296091 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.296059 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24539b12-3912-4ad1-9ed1-e3fbb08323ea-service-ca\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.296301 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.296274 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24539b12-3912-4ad1-9ed1-e3fbb08323ea-trusted-ca-bundle\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.296745 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.296706 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24539b12-3912-4ad1-9ed1-e3fbb08323ea-console-config\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.297283 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.297253 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24539b12-3912-4ad1-9ed1-e3fbb08323ea-oauth-serving-cert\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.297946 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.297923 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24539b12-3912-4ad1-9ed1-e3fbb08323ea-console-oauth-config\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.298262 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.298240 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24539b12-3912-4ad1-9ed1-e3fbb08323ea-console-serving-cert\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.317770 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.316235 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knmbv\" (UniqueName: \"kubernetes.io/projected/24539b12-3912-4ad1-9ed1-e3fbb08323ea-kube-api-access-knmbv\") pod \"console-5cdc4bf97d-mnqkm\" (UID: \"24539b12-3912-4ad1-9ed1-e3fbb08323ea\") " pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.376988 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.376954 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdstl" Jun 03 20:53:52.383013 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.382983 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:53:52.575051 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.574929 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cdc4bf97d-mnqkm"] Jun 03 20:53:52.580107 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:53:52.580049 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24539b12_3912_4ad1_9ed1_e3fbb08323ea.slice/crio-82fe6ca6e215e90c1798646099d729c9736a473b03f42c9fd38313b8ff584463 WatchSource:0}: Error finding container 82fe6ca6e215e90c1798646099d729c9736a473b03f42c9fd38313b8ff584463: Status 404 returned error can't find the container with id 82fe6ca6e215e90c1798646099d729c9736a473b03f42c9fd38313b8ff584463 Jun 03 20:53:52.593384 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:52.593324 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wdstl"] Jun 03 20:53:52.596518 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:53:52.596489 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c8428f_95e3_473d_b0a0_31ccf7aa7ea5.slice/crio-23317b6f0fc2c62a7d4cef65e00ffb3b621722c35bb05c7769b3d71bba42cb0a WatchSource:0}: Error finding container 23317b6f0fc2c62a7d4cef65e00ffb3b621722c35bb05c7769b3d71bba42cb0a: Status 404 returned error can't find the container with id 23317b6f0fc2c62a7d4cef65e00ffb3b621722c35bb05c7769b3d71bba42cb0a Jun 03 20:53:53.568749 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:53.568710 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdc4bf97d-mnqkm" event={"ID":"24539b12-3912-4ad1-9ed1-e3fbb08323ea","Type":"ContainerStarted","Data":"7369be51ab1aba41939e8ea6d034404ff7c768a273f18aace2085e182fcd0c30"} Jun 03 20:53:53.569223 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:53.568806 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cdc4bf97d-mnqkm" event={"ID":"24539b12-3912-4ad1-9ed1-e3fbb08323ea","Type":"ContainerStarted","Data":"82fe6ca6e215e90c1798646099d729c9736a473b03f42c9fd38313b8ff584463"} Jun 03 20:53:53.570240 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:53.570204 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdstl" event={"ID":"23c8428f-95e3-473d-b0a0-31ccf7aa7ea5","Type":"ContainerStarted","Data":"23317b6f0fc2c62a7d4cef65e00ffb3b621722c35bb05c7769b3d71bba42cb0a"} Jun 03 20:53:53.597429 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:53.597372 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cdc4bf97d-mnqkm" podStartSLOduration=1.5973367010000001 podStartE2EDuration="1.597336701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:53:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:53:53.594971195 +0000 UTC m=+636.196198178" watchObservedRunningTime="2026-06-03 20:53:53.597336701 +0000 UTC m=+636.198563683" Jun 03 20:53:55.582875 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:55.582841 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdstl" event={"ID":"23c8428f-95e3-473d-b0a0-31ccf7aa7ea5","Type":"ContainerStarted","Data":"bd852ada691bfb3b6b0b9d63e871c4be9e8ee9428dcd5d6e85ed6b1eecf3e6bd"} Jun 03 20:53:55.583247 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:53:55.582904 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdstl" Jun 03 20:54:02.383961 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:02.383925 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:54:02.384439 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:02.384220 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:54:02.389542 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:02.389518 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:54:02.448789 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:02.448733 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdstl" podStartSLOduration=8.443167435 podStartE2EDuration="10.448715957s" totalImagesPullingTime="2.005548522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:53:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:53:55.610724758 +0000 UTC m=+638.211951776" watchObservedRunningTime="2026-06-03 20:54:02.448715957 +0000 UTC m=+645.049942939" Jun 03 20:54:02.623602 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:02.623572 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cdc4bf97d-mnqkm" Jun 03 20:54:06.592293 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:06.592258 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdstl" Jun 03 20:54:51.767790 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:51.767747 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-phgwm"] Jun 03 20:54:51.772265 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:51.772238 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-phgwm" Jun 03 20:54:51.775759 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:51.775738 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qq9b6\"" Jun 03 20:54:51.779809 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:51.779781 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-phgwm"] Jun 03 20:54:51.941826 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:51.941772 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rmwn\" (UniqueName: \"kubernetes.io/projected/f5d24f7a-9f7d-476e-83eb-36963caef69a-kube-api-access-7rmwn\") pod \"authorino-58cd955675-phgwm\" (UID: \"f5d24f7a-9f7d-476e-83eb-36963caef69a\") " pod="kuadrant-system/authorino-58cd955675-phgwm" Jun 03 20:54:52.043242 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:52.043145 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rmwn\" (UniqueName: \"kubernetes.io/projected/f5d24f7a-9f7d-476e-83eb-36963caef69a-kube-api-access-7rmwn\") pod \"authorino-58cd955675-phgwm\" (UID: \"f5d24f7a-9f7d-476e-83eb-36963caef69a\") " pod="kuadrant-system/authorino-58cd955675-phgwm" Jun 03 20:54:52.054662 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:52.054625 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rmwn\" (UniqueName: \"kubernetes.io/projected/f5d24f7a-9f7d-476e-83eb-36963caef69a-kube-api-access-7rmwn\") pod \"authorino-58cd955675-phgwm\" (UID: \"f5d24f7a-9f7d-476e-83eb-36963caef69a\") " pod="kuadrant-system/authorino-58cd955675-phgwm" Jun 03 20:54:52.082663 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:52.082630 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-phgwm" Jun 03 20:54:52.220317 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:52.220262 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-phgwm"] Jun 03 20:54:52.222877 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:54:52.222843 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5d24f7a_9f7d_476e_83eb_36963caef69a.slice/crio-0e38365ccf355273a1a651a5c75125776642ce9b16a7c716e1fe212366ac6c90 WatchSource:0}: Error finding container 0e38365ccf355273a1a651a5c75125776642ce9b16a7c716e1fe212366ac6c90: Status 404 returned error can't find the container with id 0e38365ccf355273a1a651a5c75125776642ce9b16a7c716e1fe212366ac6c90 Jun 03 20:54:52.859212 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:52.859164 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-phgwm" event={"ID":"f5d24f7a-9f7d-476e-83eb-36963caef69a","Type":"ContainerStarted","Data":"0e38365ccf355273a1a651a5c75125776642ce9b16a7c716e1fe212366ac6c90"} Jun 03 20:54:55.876357 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:55.876304 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-phgwm" event={"ID":"f5d24f7a-9f7d-476e-83eb-36963caef69a","Type":"ContainerStarted","Data":"6d61feec3cf6afa4af78a424d7bfb8ebb9e5e1f0b9baa63769d68fd6f9318b37"} Jun 03 20:54:55.894522 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:55.894473 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-phgwm" podStartSLOduration=2.226573368 podStartE2EDuration="4.894456535s" totalImagesPullingTime="2.667883167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:54:55.893693768 +0000 UTC m=+698.494920749" watchObservedRunningTime="2026-06-03 20:54:55.894456535 +0000 UTC m=+698.495683516" Jun 03 20:54:56.470580 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:56.470540 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-phgwm"] Jun 03 20:54:57.885569 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:57.885528 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-phgwm" podUID="f5d24f7a-9f7d-476e-83eb-36963caef69a" containerName="authorino" containerID="cri-o://6d61feec3cf6afa4af78a424d7bfb8ebb9e5e1f0b9baa63769d68fd6f9318b37" gracePeriod=30 Jun 03 20:54:58.143225 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:58.143164 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-phgwm" Jun 03 20:54:58.305600 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:58.305563 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rmwn\" (UniqueName: \"kubernetes.io/projected/f5d24f7a-9f7d-476e-83eb-36963caef69a-kube-api-access-7rmwn\") pod \"f5d24f7a-9f7d-476e-83eb-36963caef69a\" (UID: \"f5d24f7a-9f7d-476e-83eb-36963caef69a\") " Jun 03 20:54:58.307759 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:58.307731 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5d24f7a-9f7d-476e-83eb-36963caef69a-kube-api-access-7rmwn" (OuterVolumeSpecName: "kube-api-access-7rmwn") pod "f5d24f7a-9f7d-476e-83eb-36963caef69a" (UID: "f5d24f7a-9f7d-476e-83eb-36963caef69a"). InnerVolumeSpecName "kube-api-access-7rmwn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:54:58.406497 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:58.406406 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rmwn\" (UniqueName: \"kubernetes.io/projected/f5d24f7a-9f7d-476e-83eb-36963caef69a-kube-api-access-7rmwn\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 20:54:58.891556 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:58.891525 2577 generic.go:356] "Generic (PLEG): container finished" podID="f5d24f7a-9f7d-476e-83eb-36963caef69a" containerID="6d61feec3cf6afa4af78a424d7bfb8ebb9e5e1f0b9baa63769d68fd6f9318b37" exitCode=0 Jun 03 20:54:58.891992 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:58.891569 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-phgwm" Jun 03 20:54:58.891992 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:58.891624 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-phgwm" event={"ID":"f5d24f7a-9f7d-476e-83eb-36963caef69a","Type":"ContainerDied","Data":"6d61feec3cf6afa4af78a424d7bfb8ebb9e5e1f0b9baa63769d68fd6f9318b37"} Jun 03 20:54:58.891992 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:58.891665 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-phgwm" event={"ID":"f5d24f7a-9f7d-476e-83eb-36963caef69a","Type":"ContainerDied","Data":"0e38365ccf355273a1a651a5c75125776642ce9b16a7c716e1fe212366ac6c90"} Jun 03 20:54:58.891992 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:58.891682 2577 scope.go:117] "RemoveContainer" containerID="6d61feec3cf6afa4af78a424d7bfb8ebb9e5e1f0b9baa63769d68fd6f9318b37" Jun 03 20:54:58.900167 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:58.900147 2577 scope.go:117] "RemoveContainer" containerID="6d61feec3cf6afa4af78a424d7bfb8ebb9e5e1f0b9baa63769d68fd6f9318b37" Jun 03 20:54:58.900499 ip-10-0-128-196 kubenswrapper[2577]: E0603 20:54:58.900476 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d61feec3cf6afa4af78a424d7bfb8ebb9e5e1f0b9baa63769d68fd6f9318b37\": container with ID starting with 6d61feec3cf6afa4af78a424d7bfb8ebb9e5e1f0b9baa63769d68fd6f9318b37 not found: ID does not exist" containerID="6d61feec3cf6afa4af78a424d7bfb8ebb9e5e1f0b9baa63769d68fd6f9318b37" Jun 03 20:54:58.900561 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:58.900509 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d61feec3cf6afa4af78a424d7bfb8ebb9e5e1f0b9baa63769d68fd6f9318b37"} err="failed to get container status \"6d61feec3cf6afa4af78a424d7bfb8ebb9e5e1f0b9baa63769d68fd6f9318b37\": rpc error: code = NotFound desc = could not find container \"6d61feec3cf6afa4af78a424d7bfb8ebb9e5e1f0b9baa63769d68fd6f9318b37\": container with ID starting with 6d61feec3cf6afa4af78a424d7bfb8ebb9e5e1f0b9baa63769d68fd6f9318b37 not found: ID does not exist" Jun 03 20:54:58.915041 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:58.915007 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-phgwm"] Jun 03 20:54:58.920929 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:58.920902 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-phgwm"] Jun 03 20:54:59.895188 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:54:59.895156 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5d24f7a-9f7d-476e-83eb-36963caef69a" path="/var/lib/kubelet/pods/f5d24f7a-9f7d-476e-83eb-36963caef69a/volumes" Jun 03 20:55:11.958740 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:11.958707 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-d8vb8"] Jun 03 20:55:11.959202 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:11.959184 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d24f7a-9f7d-476e-83eb-36963caef69a" containerName="authorino" Jun 03 20:55:11.959250 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:11.959205 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d24f7a-9f7d-476e-83eb-36963caef69a" containerName="authorino" Jun 03 20:55:11.959305 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:11.959295 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d24f7a-9f7d-476e-83eb-36963caef69a" containerName="authorino" Jun 03 20:55:11.966100 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:11.966077 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-d8vb8" Jun 03 20:55:11.969885 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:11.969857 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hdhcr\"" Jun 03 20:55:11.970115 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:11.970098 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 20:55:11.972058 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:11.972028 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-d8vb8"] Jun 03 20:55:12.023790 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:12.023752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxgfq\" (UniqueName: \"kubernetes.io/projected/954c9c57-9ec9-4399-ab9b-95a2a05d89dc-kube-api-access-kxgfq\") pod \"postgres-69fb4594cf-d8vb8\" (UID: \"954c9c57-9ec9-4399-ab9b-95a2a05d89dc\") " pod="opendatahub/postgres-69fb4594cf-d8vb8" Jun 03 20:55:12.023961 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:12.023800 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/954c9c57-9ec9-4399-ab9b-95a2a05d89dc-data\") pod \"postgres-69fb4594cf-d8vb8\" (UID: \"954c9c57-9ec9-4399-ab9b-95a2a05d89dc\") " pod="opendatahub/postgres-69fb4594cf-d8vb8" Jun 03 20:55:12.124688 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:12.124649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxgfq\" (UniqueName: \"kubernetes.io/projected/954c9c57-9ec9-4399-ab9b-95a2a05d89dc-kube-api-access-kxgfq\") pod \"postgres-69fb4594cf-d8vb8\" (UID: \"954c9c57-9ec9-4399-ab9b-95a2a05d89dc\") " pod="opendatahub/postgres-69fb4594cf-d8vb8" Jun 03 20:55:12.124861 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:12.124705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/954c9c57-9ec9-4399-ab9b-95a2a05d89dc-data\") pod \"postgres-69fb4594cf-d8vb8\" (UID: \"954c9c57-9ec9-4399-ab9b-95a2a05d89dc\") " pod="opendatahub/postgres-69fb4594cf-d8vb8" Jun 03 20:55:12.125124 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:12.125102 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/954c9c57-9ec9-4399-ab9b-95a2a05d89dc-data\") pod \"postgres-69fb4594cf-d8vb8\" (UID: \"954c9c57-9ec9-4399-ab9b-95a2a05d89dc\") " pod="opendatahub/postgres-69fb4594cf-d8vb8" Jun 03 20:55:12.134136 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:12.134103 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxgfq\" (UniqueName: \"kubernetes.io/projected/954c9c57-9ec9-4399-ab9b-95a2a05d89dc-kube-api-access-kxgfq\") pod \"postgres-69fb4594cf-d8vb8\" (UID: \"954c9c57-9ec9-4399-ab9b-95a2a05d89dc\") " pod="opendatahub/postgres-69fb4594cf-d8vb8" Jun 03 20:55:12.278519 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:12.278416 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-d8vb8" Jun 03 20:55:12.418923 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:12.418886 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-d8vb8"] Jun 03 20:55:12.424443 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:55:12.424019 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod954c9c57_9ec9_4399_ab9b_95a2a05d89dc.slice/crio-1266548bea17a14220510fe7f5840cca21229e673aca437aa5cd62d8e6994fd4 WatchSource:0}: Error finding container 1266548bea17a14220510fe7f5840cca21229e673aca437aa5cd62d8e6994fd4: Status 404 returned error can't find the container with id 1266548bea17a14220510fe7f5840cca21229e673aca437aa5cd62d8e6994fd4 Jun 03 20:55:12.975839 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:12.975760 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-d8vb8" event={"ID":"954c9c57-9ec9-4399-ab9b-95a2a05d89dc","Type":"ContainerStarted","Data":"1266548bea17a14220510fe7f5840cca21229e673aca437aa5cd62d8e6994fd4"} Jun 03 20:55:18.006947 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:18.006908 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-d8vb8" event={"ID":"954c9c57-9ec9-4399-ab9b-95a2a05d89dc","Type":"ContainerStarted","Data":"337dd5098879330c7adc765f1da06250112dc54a5a29cf85365f810178893b8e"} Jun 03 20:55:18.007630 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:18.007015 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-d8vb8" Jun 03 20:55:18.025152 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:18.025099 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-d8vb8" podStartSLOduration=2.461009468 podStartE2EDuration="7.025084078s" totalImagesPullingTime="4.56407461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:55:18.023528685 +0000 UTC m=+720.624755667" watchObservedRunningTime="2026-06-03 20:55:18.025084078 +0000 UTC m=+720.626311058" Jun 03 20:55:24.043097 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:24.043066 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-d8vb8" Jun 03 20:55:34.374303 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:34.374249 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-wq682"] Jun 03 20:55:34.378143 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:34.378118 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-wq682" Jun 03 20:55:34.382511 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:34.382480 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 20:55:34.382673 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:34.382613 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-p8kkp\"" Jun 03 20:55:34.383602 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:34.383581 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 20:55:34.401245 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:34.401200 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-wq682"] Jun 03 20:55:34.540481 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:34.540444 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr6k6\" (UniqueName: \"kubernetes.io/projected/0616fe9e-808f-457c-8622-cc985789ea61-kube-api-access-xr6k6\") pod \"keycloak-operator-dd84cbf46-wq682\" (UID: \"0616fe9e-808f-457c-8622-cc985789ea61\") " pod="keycloak-system/keycloak-operator-dd84cbf46-wq682" Jun 03 20:55:34.641935 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:34.641844 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr6k6\" (UniqueName: \"kubernetes.io/projected/0616fe9e-808f-457c-8622-cc985789ea61-kube-api-access-xr6k6\") pod \"keycloak-operator-dd84cbf46-wq682\" (UID: \"0616fe9e-808f-457c-8622-cc985789ea61\") " pod="keycloak-system/keycloak-operator-dd84cbf46-wq682" Jun 03 20:55:34.654894 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:34.654854 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr6k6\" (UniqueName: \"kubernetes.io/projected/0616fe9e-808f-457c-8622-cc985789ea61-kube-api-access-xr6k6\") pod \"keycloak-operator-dd84cbf46-wq682\" (UID: \"0616fe9e-808f-457c-8622-cc985789ea61\") " pod="keycloak-system/keycloak-operator-dd84cbf46-wq682" Jun 03 20:55:34.692453 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:34.692396 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-wq682" Jun 03 20:55:34.829973 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:34.829945 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-wq682"] Jun 03 20:55:34.831533 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:55:34.831508 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0616fe9e_808f_457c_8622_cc985789ea61.slice/crio-fb4db27af506547018d85b0edf347cc7a35262552dd9b29d90eb126f5ebc861c WatchSource:0}: Error finding container fb4db27af506547018d85b0edf347cc7a35262552dd9b29d90eb126f5ebc861c: Status 404 returned error can't find the container with id fb4db27af506547018d85b0edf347cc7a35262552dd9b29d90eb126f5ebc861c Jun 03 20:55:35.090457 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:35.090424 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-wq682" event={"ID":"0616fe9e-808f-457c-8622-cc985789ea61","Type":"ContainerStarted","Data":"fb4db27af506547018d85b0edf347cc7a35262552dd9b29d90eb126f5ebc861c"} Jun 03 20:55:40.128021 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:40.127976 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-wq682" event={"ID":"0616fe9e-808f-457c-8622-cc985789ea61","Type":"ContainerStarted","Data":"d408fe0312a84d4467b1d831b2c69bf333fe8692645e495bf6e0a20b5b42a4ec"} Jun 03 20:55:40.147439 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:55:40.147381 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-dd84cbf46-wq682" podStartSLOduration=1.45959196 podStartE2EDuration="6.147364577s" totalImagesPullingTime="4.687772617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:55:40.145723762 +0000 UTC m=+742.746950744" watchObservedRunningTime="2026-06-03 20:55:40.147364577 +0000 UTC m=+742.748591550" Jun 03 20:58:17.929000 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:58:17.928969 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 20:58:17.930072 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:58:17.930051 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 20:59:59.375619 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.375583 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c8cb9d4df-fb9cf"] Jun 03 20:59:59.379227 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.379203 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c8cb9d4df-fb9cf" Jun 03 20:59:59.382024 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.381998 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 03 20:59:59.383068 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.383048 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 20:59:59.383203 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.383132 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qq9b6\"" Jun 03 20:59:59.390592 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.390568 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c8cb9d4df-fb9cf"] Jun 03 20:59:59.484238 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.484199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5e2ff39-ae16-44e9-b025-9aee4621a782-tls-cert\") pod \"authorino-7c8cb9d4df-fb9cf\" (UID: \"d5e2ff39-ae16-44e9-b025-9aee4621a782\") " pod="kuadrant-system/authorino-7c8cb9d4df-fb9cf" Jun 03 20:59:59.484472 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.484262 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4brsh\" (UniqueName: \"kubernetes.io/projected/d5e2ff39-ae16-44e9-b025-9aee4621a782-kube-api-access-4brsh\") pod \"authorino-7c8cb9d4df-fb9cf\" (UID: \"d5e2ff39-ae16-44e9-b025-9aee4621a782\") " pod="kuadrant-system/authorino-7c8cb9d4df-fb9cf" Jun 03 20:59:59.484472 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.484410 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d5e2ff39-ae16-44e9-b025-9aee4621a782-oidc-ca\") pod \"authorino-7c8cb9d4df-fb9cf\" (UID: \"d5e2ff39-ae16-44e9-b025-9aee4621a782\") " pod="kuadrant-system/authorino-7c8cb9d4df-fb9cf" Jun 03 20:59:59.585755 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.585713 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4brsh\" (UniqueName: \"kubernetes.io/projected/d5e2ff39-ae16-44e9-b025-9aee4621a782-kube-api-access-4brsh\") pod \"authorino-7c8cb9d4df-fb9cf\" (UID: \"d5e2ff39-ae16-44e9-b025-9aee4621a782\") " pod="kuadrant-system/authorino-7c8cb9d4df-fb9cf" Jun 03 20:59:59.585934 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.585806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d5e2ff39-ae16-44e9-b025-9aee4621a782-oidc-ca\") pod \"authorino-7c8cb9d4df-fb9cf\" (UID: \"d5e2ff39-ae16-44e9-b025-9aee4621a782\") " pod="kuadrant-system/authorino-7c8cb9d4df-fb9cf" Jun 03 20:59:59.585934 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.585877 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5e2ff39-ae16-44e9-b025-9aee4621a782-tls-cert\") pod \"authorino-7c8cb9d4df-fb9cf\" (UID: \"d5e2ff39-ae16-44e9-b025-9aee4621a782\") " pod="kuadrant-system/authorino-7c8cb9d4df-fb9cf" Jun 03 20:59:59.586462 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.586441 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d5e2ff39-ae16-44e9-b025-9aee4621a782-oidc-ca\") pod \"authorino-7c8cb9d4df-fb9cf\" (UID: \"d5e2ff39-ae16-44e9-b025-9aee4621a782\") " pod="kuadrant-system/authorino-7c8cb9d4df-fb9cf" Jun 03 20:59:59.588167 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.588149 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5e2ff39-ae16-44e9-b025-9aee4621a782-tls-cert\") pod \"authorino-7c8cb9d4df-fb9cf\" (UID: \"d5e2ff39-ae16-44e9-b025-9aee4621a782\") " pod="kuadrant-system/authorino-7c8cb9d4df-fb9cf" Jun 03 20:59:59.594969 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.594937 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4brsh\" (UniqueName: \"kubernetes.io/projected/d5e2ff39-ae16-44e9-b025-9aee4621a782-kube-api-access-4brsh\") pod \"authorino-7c8cb9d4df-fb9cf\" (UID: \"d5e2ff39-ae16-44e9-b025-9aee4621a782\") " pod="kuadrant-system/authorino-7c8cb9d4df-fb9cf" Jun 03 20:59:59.689144 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.689106 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c8cb9d4df-fb9cf" Jun 03 20:59:59.822073 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.822033 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c8cb9d4df-fb9cf"] Jun 03 20:59:59.825085 ip-10-0-128-196 kubenswrapper[2577]: W0603 20:59:59.825057 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5e2ff39_ae16_44e9_b025_9aee4621a782.slice/crio-e175608ae200918e22ee3f168a68c00a235f3dbd4b80b46bf7ab88b8833ddab6 WatchSource:0}: Error finding container e175608ae200918e22ee3f168a68c00a235f3dbd4b80b46bf7ab88b8833ddab6: Status 404 returned error can't find the container with id e175608ae200918e22ee3f168a68c00a235f3dbd4b80b46bf7ab88b8833ddab6 Jun 03 20:59:59.826397 ip-10-0-128-196 kubenswrapper[2577]: I0603 20:59:59.826378 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:00:00.154392 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:00.154292 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29675340-4cksx"] Jun 03 21:00:00.158881 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:00.158863 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675340-4cksx" Jun 03 21:00:00.161242 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:00.161213 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6tv84\"" Jun 03 21:00:00.165121 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:00.165090 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675340-4cksx"] Jun 03 21:00:00.292223 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:00.292035 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxhgq\" (UniqueName: \"kubernetes.io/projected/decab6a4-9304-45d1-ad9c-97b02dbf43fd-kube-api-access-wxhgq\") pod \"maas-api-key-cleanup-29675340-4cksx\" (UID: \"decab6a4-9304-45d1-ad9c-97b02dbf43fd\") " pod="opendatahub/maas-api-key-cleanup-29675340-4cksx" Jun 03 21:00:00.393254 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:00.393221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxhgq\" (UniqueName: \"kubernetes.io/projected/decab6a4-9304-45d1-ad9c-97b02dbf43fd-kube-api-access-wxhgq\") pod \"maas-api-key-cleanup-29675340-4cksx\" (UID: \"decab6a4-9304-45d1-ad9c-97b02dbf43fd\") " pod="opendatahub/maas-api-key-cleanup-29675340-4cksx" Jun 03 21:00:00.408191 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:00.408099 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c8cb9d4df-fb9cf" event={"ID":"d5e2ff39-ae16-44e9-b025-9aee4621a782","Type":"ContainerStarted","Data":"03a914112201cccdd15ba8730d190c0e9f41297999177c3e8b85e0420a97a372"} Jun 03 21:00:00.408191 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:00.408155 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c8cb9d4df-fb9cf" event={"ID":"d5e2ff39-ae16-44e9-b025-9aee4621a782","Type":"ContainerStarted","Data":"e175608ae200918e22ee3f168a68c00a235f3dbd4b80b46bf7ab88b8833ddab6"} Jun 03 21:00:00.409964 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:00.409931 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxhgq\" (UniqueName: \"kubernetes.io/projected/decab6a4-9304-45d1-ad9c-97b02dbf43fd-kube-api-access-wxhgq\") pod \"maas-api-key-cleanup-29675340-4cksx\" (UID: \"decab6a4-9304-45d1-ad9c-97b02dbf43fd\") " pod="opendatahub/maas-api-key-cleanup-29675340-4cksx" Jun 03 21:00:00.425312 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:00.425263 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c8cb9d4df-fb9cf" podStartSLOduration=0.956556345 podStartE2EDuration="1.425248033s" totalImagesPullingTime="468.691688ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 20:59:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:00:00.42357354 +0000 UTC m=+1003.024800534" watchObservedRunningTime="2026-06-03 21:00:00.425248033 +0000 UTC m=+1003.026475014" Jun 03 21:00:00.473401 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:00.473366 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675340-4cksx" Jun 03 21:00:00.618662 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:00.618633 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675340-4cksx"] Jun 03 21:00:00.622440 ip-10-0-128-196 kubenswrapper[2577]: W0603 21:00:00.622402 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddecab6a4_9304_45d1_ad9c_97b02dbf43fd.slice/crio-837c75ca4d6d04fff27a6286e01952e39a8ea3f5e2ced572ca8d90db962d5cf7 WatchSource:0}: Error finding container 837c75ca4d6d04fff27a6286e01952e39a8ea3f5e2ced572ca8d90db962d5cf7: Status 404 returned error can't find the container with id 837c75ca4d6d04fff27a6286e01952e39a8ea3f5e2ced572ca8d90db962d5cf7 Jun 03 21:00:01.414399 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:01.414336 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675340-4cksx" event={"ID":"decab6a4-9304-45d1-ad9c-97b02dbf43fd","Type":"ContainerStarted","Data":"837c75ca4d6d04fff27a6286e01952e39a8ea3f5e2ced572ca8d90db962d5cf7"} Jun 03 21:00:06.445307 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:06.445270 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675340-4cksx" event={"ID":"decab6a4-9304-45d1-ad9c-97b02dbf43fd","Type":"ContainerStarted","Data":"9a6b2578f6b06e5be804eaec087d155e172942fb6f378dde2036c85e29f9a186"} Jun 03 21:00:06.462162 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:06.462109 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29675340-4cksx" podStartSLOduration=1.042861899 podStartE2EDuration="6.46209393s" totalImagesPullingTime="5.419232031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:00:06.461004201 +0000 UTC m=+1009.062231183" watchObservedRunningTime="2026-06-03 21:00:06.46209393 +0000 UTC m=+1009.063320910" Jun 03 21:00:07.452437 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:07.452397 2577 generic.go:356] "Generic (PLEG): container finished" podID="decab6a4-9304-45d1-ad9c-97b02dbf43fd" containerID="9a6b2578f6b06e5be804eaec087d155e172942fb6f378dde2036c85e29f9a186" exitCode=0 Jun 03 21:00:07.452800 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:07.452487 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675340-4cksx" event={"ID":"decab6a4-9304-45d1-ad9c-97b02dbf43fd","Type":"ContainerDied","Data":"9a6b2578f6b06e5be804eaec087d155e172942fb6f378dde2036c85e29f9a186"} Jun 03 21:00:08.592363 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:08.592310 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675340-4cksx" Jun 03 21:00:08.675751 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:08.675716 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxhgq\" (UniqueName: \"kubernetes.io/projected/decab6a4-9304-45d1-ad9c-97b02dbf43fd-kube-api-access-wxhgq\") pod \"decab6a4-9304-45d1-ad9c-97b02dbf43fd\" (UID: \"decab6a4-9304-45d1-ad9c-97b02dbf43fd\") " Jun 03 21:00:08.678083 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:08.678061 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/decab6a4-9304-45d1-ad9c-97b02dbf43fd-kube-api-access-wxhgq" (OuterVolumeSpecName: "kube-api-access-wxhgq") pod "decab6a4-9304-45d1-ad9c-97b02dbf43fd" (UID: "decab6a4-9304-45d1-ad9c-97b02dbf43fd"). InnerVolumeSpecName "kube-api-access-wxhgq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:00:08.776690 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:08.776600 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxhgq\" (UniqueName: \"kubernetes.io/projected/decab6a4-9304-45d1-ad9c-97b02dbf43fd-kube-api-access-wxhgq\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 21:00:09.463268 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:09.463238 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675340-4cksx" Jun 03 21:00:09.463465 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:09.463237 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675340-4cksx" event={"ID":"decab6a4-9304-45d1-ad9c-97b02dbf43fd","Type":"ContainerDied","Data":"837c75ca4d6d04fff27a6286e01952e39a8ea3f5e2ced572ca8d90db962d5cf7"} Jun 03 21:00:09.463465 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:00:09.463383 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="837c75ca4d6d04fff27a6286e01952e39a8ea3f5e2ced572ca8d90db962d5cf7" Jun 03 21:03:17.966547 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:03:17.966520 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 21:03:17.968460 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:03:17.968439 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 21:08:18.004415 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:08:18.004388 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 21:08:18.018214 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:08:18.007692 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 21:13:18.037859 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:13:18.037739 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 21:13:18.046324 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:13:18.046303 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 21:15:00.141696 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:00.141655 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29675355-w7m45"] Jun 03 21:15:00.142307 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:00.142285 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="decab6a4-9304-45d1-ad9c-97b02dbf43fd" containerName="cleanup" Jun 03 21:15:00.142307 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:00.142305 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="decab6a4-9304-45d1-ad9c-97b02dbf43fd" containerName="cleanup" Jun 03 21:15:00.142489 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:00.142424 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="decab6a4-9304-45d1-ad9c-97b02dbf43fd" containerName="cleanup" Jun 03 21:15:00.145533 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:00.145514 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675355-w7m45" Jun 03 21:15:00.148105 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:00.148085 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6tv84\"" Jun 03 21:15:00.162513 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:00.162484 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675355-w7m45"] Jun 03 21:15:00.202008 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:00.201968 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnpzp\" (UniqueName: \"kubernetes.io/projected/0c16f33e-cf99-46ce-8dd2-e9b6e664226c-kube-api-access-mnpzp\") pod \"maas-api-key-cleanup-29675355-w7m45\" (UID: \"0c16f33e-cf99-46ce-8dd2-e9b6e664226c\") " pod="opendatahub/maas-api-key-cleanup-29675355-w7m45" Jun 03 21:15:00.303106 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:00.303067 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnpzp\" (UniqueName: \"kubernetes.io/projected/0c16f33e-cf99-46ce-8dd2-e9b6e664226c-kube-api-access-mnpzp\") pod \"maas-api-key-cleanup-29675355-w7m45\" (UID: \"0c16f33e-cf99-46ce-8dd2-e9b6e664226c\") " pod="opendatahub/maas-api-key-cleanup-29675355-w7m45" Jun 03 21:15:00.312233 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:00.312209 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnpzp\" (UniqueName: \"kubernetes.io/projected/0c16f33e-cf99-46ce-8dd2-e9b6e664226c-kube-api-access-mnpzp\") pod \"maas-api-key-cleanup-29675355-w7m45\" (UID: \"0c16f33e-cf99-46ce-8dd2-e9b6e664226c\") " pod="opendatahub/maas-api-key-cleanup-29675355-w7m45" Jun 03 21:15:00.455661 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:00.455624 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675355-w7m45" Jun 03 21:15:00.591205 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:00.591169 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675355-w7m45"] Jun 03 21:15:00.594381 ip-10-0-128-196 kubenswrapper[2577]: W0603 21:15:00.594356 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c16f33e_cf99_46ce_8dd2_e9b6e664226c.slice/crio-836089b55d8f98d01d79102b83fdc0730a947c7c9b97f3d9a43b714f9090c20d WatchSource:0}: Error finding container 836089b55d8f98d01d79102b83fdc0730a947c7c9b97f3d9a43b714f9090c20d: Status 404 returned error can't find the container with id 836089b55d8f98d01d79102b83fdc0730a947c7c9b97f3d9a43b714f9090c20d Jun 03 21:15:00.906120 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:00.906081 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675355-w7m45" event={"ID":"0c16f33e-cf99-46ce-8dd2-e9b6e664226c","Type":"ContainerStarted","Data":"2eb5ea51fdd21833482b2dee3e0eb9290c5ecc3b03ad5f1e33a1485ba5bcb8fa"} Jun 03 21:15:00.906297 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:00.906138 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675355-w7m45" event={"ID":"0c16f33e-cf99-46ce-8dd2-e9b6e664226c","Type":"ContainerStarted","Data":"836089b55d8f98d01d79102b83fdc0730a947c7c9b97f3d9a43b714f9090c20d"} Jun 03 21:15:00.923061 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:00.923008 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29675355-w7m45" podStartSLOduration=0.922989961 podStartE2EDuration="922.989961ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:15:00.922037219 +0000 UTC m=+1903.523264201" watchObservedRunningTime="2026-06-03 21:15:00.922989961 +0000 UTC m=+1903.524216943" Jun 03 21:15:01.914494 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:01.914402 2577 generic.go:356] "Generic (PLEG): container finished" podID="0c16f33e-cf99-46ce-8dd2-e9b6e664226c" containerID="2eb5ea51fdd21833482b2dee3e0eb9290c5ecc3b03ad5f1e33a1485ba5bcb8fa" exitCode=0 Jun 03 21:15:01.914882 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:01.914492 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675355-w7m45" event={"ID":"0c16f33e-cf99-46ce-8dd2-e9b6e664226c","Type":"ContainerDied","Data":"2eb5ea51fdd21833482b2dee3e0eb9290c5ecc3b03ad5f1e33a1485ba5bcb8fa"} Jun 03 21:15:03.050137 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:03.050111 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675355-w7m45" Jun 03 21:15:03.130710 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:03.130659 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnpzp\" (UniqueName: \"kubernetes.io/projected/0c16f33e-cf99-46ce-8dd2-e9b6e664226c-kube-api-access-mnpzp\") pod \"0c16f33e-cf99-46ce-8dd2-e9b6e664226c\" (UID: \"0c16f33e-cf99-46ce-8dd2-e9b6e664226c\") " Jun 03 21:15:03.132748 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:03.132723 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c16f33e-cf99-46ce-8dd2-e9b6e664226c-kube-api-access-mnpzp" (OuterVolumeSpecName: "kube-api-access-mnpzp") pod "0c16f33e-cf99-46ce-8dd2-e9b6e664226c" (UID: "0c16f33e-cf99-46ce-8dd2-e9b6e664226c"). InnerVolumeSpecName "kube-api-access-mnpzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 21:15:03.232010 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:03.231963 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnpzp\" (UniqueName: \"kubernetes.io/projected/0c16f33e-cf99-46ce-8dd2-e9b6e664226c-kube-api-access-mnpzp\") on node \"ip-10-0-128-196.ec2.internal\" DevicePath \"\"" Jun 03 21:15:03.925844 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:03.925816 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675355-w7m45" Jun 03 21:15:03.926009 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:03.925819 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675355-w7m45" event={"ID":"0c16f33e-cf99-46ce-8dd2-e9b6e664226c","Type":"ContainerDied","Data":"836089b55d8f98d01d79102b83fdc0730a947c7c9b97f3d9a43b714f9090c20d"} Jun 03 21:15:03.926009 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:15:03.925945 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="836089b55d8f98d01d79102b83fdc0730a947c7c9b97f3d9a43b714f9090c20d" Jun 03 21:18:18.070842 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:18:18.070725 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 21:18:18.079527 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:18:18.079508 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 21:22:55.810721 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:22:55.810684 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c8cb9d4df-fb9cf_d5e2ff39-ae16-44e9-b025-9aee4621a782/authorino/0.log" Jun 03 21:23:00.976272 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:00.976242 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675340-4cksx_decab6a4-9304-45d1-ad9c-97b02dbf43fd/cleanup/0.log" Jun 03 21:23:01.084120 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:01.084089 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675355-w7m45_0c16f33e-cf99-46ce-8dd2-e9b6e664226c/cleanup/0.log" Jun 03 21:23:01.851229 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:01.851197 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5965b9645d-lxgw7_500910cf-e806-445d-8506-3d8f9ad74c4f/copy-manifests/0.log" Jun 03 21:23:01.859649 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:01.859616 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5965b9645d-lxgw7_500910cf-e806-445d-8506-3d8f9ad74c4f/manager/0.log" Jun 03 21:23:01.969480 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:01.969447 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-d8vb8_954c9c57-9ec9-4399-ab9b-95a2a05d89dc/postgres/0.log" Jun 03 21:23:03.331934 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:03.331899 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c8cb9d4df-fb9cf_d5e2ff39-ae16-44e9-b025-9aee4621a782/authorino/0.log" Jun 03 21:23:03.473269 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:03.473238 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wdstl_23c8428f-95e3-473d-b0a0-31ccf7aa7ea5/manager/0.log" Jun 03 21:23:04.792444 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:04.792412 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6d85b7bd-tdksq_0ea1f3a8-5686-4b4b-bd54-57fa3fad4999/kube-auth-proxy/0.log" Jun 03 21:23:10.237896 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.237857 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pjqlg/must-gather-k2vng"] Jun 03 21:23:10.238304 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.238291 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c16f33e-cf99-46ce-8dd2-e9b6e664226c" containerName="cleanup" Jun 03 21:23:10.238304 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.238304 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c16f33e-cf99-46ce-8dd2-e9b6e664226c" containerName="cleanup" Jun 03 21:23:10.238417 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.238389 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c16f33e-cf99-46ce-8dd2-e9b6e664226c" containerName="cleanup" Jun 03 21:23:10.241102 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.241085 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjqlg/must-gather-k2vng" Jun 03 21:23:10.246006 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.245981 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pjqlg\"/\"default-dockercfg-jwvcn\"" Jun 03 21:23:10.246006 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.245997 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pjqlg\"/\"openshift-service-ca.crt\"" Jun 03 21:23:10.246215 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.246071 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pjqlg\"/\"kube-root-ca.crt\"" Jun 03 21:23:10.247506 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.247483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bb5t\" (UniqueName: \"kubernetes.io/projected/d7ad4dcf-dfd5-449a-9d29-3df5ef56f039-kube-api-access-7bb5t\") pod \"must-gather-k2vng\" (UID: \"d7ad4dcf-dfd5-449a-9d29-3df5ef56f039\") " pod="openshift-must-gather-pjqlg/must-gather-k2vng" Jun 03 21:23:10.247608 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.247526 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d7ad4dcf-dfd5-449a-9d29-3df5ef56f039-must-gather-output\") pod \"must-gather-k2vng\" (UID: \"d7ad4dcf-dfd5-449a-9d29-3df5ef56f039\") " pod="openshift-must-gather-pjqlg/must-gather-k2vng" Jun 03 21:23:10.266190 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.266159 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjqlg/must-gather-k2vng"] Jun 03 21:23:10.348214 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.348175 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bb5t\" (UniqueName: \"kubernetes.io/projected/d7ad4dcf-dfd5-449a-9d29-3df5ef56f039-kube-api-access-7bb5t\") pod \"must-gather-k2vng\" (UID: \"d7ad4dcf-dfd5-449a-9d29-3df5ef56f039\") " pod="openshift-must-gather-pjqlg/must-gather-k2vng" Jun 03 21:23:10.348448 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.348262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d7ad4dcf-dfd5-449a-9d29-3df5ef56f039-must-gather-output\") pod \"must-gather-k2vng\" (UID: \"d7ad4dcf-dfd5-449a-9d29-3df5ef56f039\") " pod="openshift-must-gather-pjqlg/must-gather-k2vng" Jun 03 21:23:10.348697 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.348675 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d7ad4dcf-dfd5-449a-9d29-3df5ef56f039-must-gather-output\") pod \"must-gather-k2vng\" (UID: \"d7ad4dcf-dfd5-449a-9d29-3df5ef56f039\") " pod="openshift-must-gather-pjqlg/must-gather-k2vng" Jun 03 21:23:10.357677 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.357648 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bb5t\" (UniqueName: \"kubernetes.io/projected/d7ad4dcf-dfd5-449a-9d29-3df5ef56f039-kube-api-access-7bb5t\") pod \"must-gather-k2vng\" (UID: \"d7ad4dcf-dfd5-449a-9d29-3df5ef56f039\") " pod="openshift-must-gather-pjqlg/must-gather-k2vng" Jun 03 21:23:10.550716 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.550612 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjqlg/must-gather-k2vng" Jun 03 21:23:10.688838 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.688803 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjqlg/must-gather-k2vng"] Jun 03 21:23:10.690955 ip-10-0-128-196 kubenswrapper[2577]: W0603 21:23:10.690925 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7ad4dcf_dfd5_449a_9d29_3df5ef56f039.slice/crio-65be6d4b5c0ea4e038d8b7475d5698d89028b3096e64d7af73b4fd5a4864c1b8 WatchSource:0}: Error finding container 65be6d4b5c0ea4e038d8b7475d5698d89028b3096e64d7af73b4fd5a4864c1b8: Status 404 returned error can't find the container with id 65be6d4b5c0ea4e038d8b7475d5698d89028b3096e64d7af73b4fd5a4864c1b8 Jun 03 21:23:10.692761 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:10.692745 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 21:23:11.390983 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:11.390946 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjqlg/must-gather-k2vng" event={"ID":"d7ad4dcf-dfd5-449a-9d29-3df5ef56f039","Type":"ContainerStarted","Data":"65be6d4b5c0ea4e038d8b7475d5698d89028b3096e64d7af73b4fd5a4864c1b8"} Jun 03 21:23:12.399666 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:12.399606 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjqlg/must-gather-k2vng" event={"ID":"d7ad4dcf-dfd5-449a-9d29-3df5ef56f039","Type":"ContainerStarted","Data":"a8b1a65febf926cafdb467edd5fbf2b407dd4ca5eb0c1c058bc2af641335bd26"} Jun 03 21:23:12.400185 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:12.399681 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjqlg/must-gather-k2vng" event={"ID":"d7ad4dcf-dfd5-449a-9d29-3df5ef56f039","Type":"ContainerStarted","Data":"c02f9cdd777c0bbe7656bc35c8752fb005778173993faef746e116a228eff43e"} Jun 03 21:23:12.423749 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:12.423675 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pjqlg/must-gather-k2vng" podStartSLOduration=1.7181913070000001 podStartE2EDuration="2.423652761s" totalImagesPullingTime="705.461454ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:23:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:23:12.418517226 +0000 UTC m=+2395.019744208" watchObservedRunningTime="2026-06-03 21:23:12.423652761 +0000 UTC m=+2395.024879744" Jun 03 21:23:13.418682 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:13.418645 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nz55h_78164361-9b18-423d-83eb-e2ddbaa78edd/global-pull-secret-syncer/0.log" Jun 03 21:23:13.555814 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:13.555774 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nklxt_c7e040c2-067d-4275-96b9-1ef76faa94da/konnectivity-agent/0.log" Jun 03 21:23:13.613780 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:13.613735 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-196.ec2.internal_1dca1cb65a4fa78fa52bf28f0a56768c/haproxy/0.log" Jun 03 21:23:18.194094 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:18.194062 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 21:23:18.209394 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:18.206464 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vfvrg_3686395b-19a4-4c36-b5ee-fdb263bc7a1d/ovn-acl-logging/0.log" Jun 03 21:23:19.393037 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:19.392985 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c8cb9d4df-fb9cf_d5e2ff39-ae16-44e9-b025-9aee4621a782/authorino/0.log" Jun 03 21:23:19.431835 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:19.431753 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wdstl_23c8428f-95e3-473d-b0a0-31ccf7aa7ea5/manager/0.log" Jun 03 21:23:21.340505 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:21.340445 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d6b80698-c573-4fb2-8784-701e32a6a0d0/alertmanager/0.log" Jun 03 21:23:21.370381 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:21.370333 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d6b80698-c573-4fb2-8784-701e32a6a0d0/config-reloader/0.log" Jun 03 21:23:21.399102 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:21.399073 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d6b80698-c573-4fb2-8784-701e32a6a0d0/kube-rbac-proxy-web/0.log" Jun 03 21:23:21.461026 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:21.460952 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d6b80698-c573-4fb2-8784-701e32a6a0d0/kube-rbac-proxy/0.log" Jun 03 21:23:21.493230 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:21.493086 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d6b80698-c573-4fb2-8784-701e32a6a0d0/kube-rbac-proxy-metric/0.log" Jun 03 21:23:21.522363 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:21.522319 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d6b80698-c573-4fb2-8784-701e32a6a0d0/prom-label-proxy/0.log" Jun 03 21:23:21.548424 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:21.548395 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d6b80698-c573-4fb2-8784-701e32a6a0d0/init-config-reloader/0.log" Jun 03 21:23:21.595908 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:21.595803 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-57769895dd-57lpw_a57c6adc-7ae5-4ab4-b440-27573322eedd/cluster-monitoring-operator/0.log" Jun 03 21:23:21.639334 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:21.639298 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-28hd9_e6403eb7-e4ca-46b6-bb6a-ad4529c61826/kube-state-metrics/0.log" Jun 03 21:23:21.662153 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:21.662109 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-28hd9_e6403eb7-e4ca-46b6-bb6a-ad4529c61826/kube-rbac-proxy-main/0.log" Jun 03 21:23:21.690558 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:21.690507 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-28hd9_e6403eb7-e4ca-46b6-bb6a-ad4529c61826/kube-rbac-proxy-self/0.log" Jun 03 21:23:21.823818 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:21.823790 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-74hl7_53c4e7d5-526b-43ef-ba73-f670065df44e/node-exporter/0.log" Jun 03 21:23:21.856026 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:21.855954 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-74hl7_53c4e7d5-526b-43ef-ba73-f670065df44e/kube-rbac-proxy/0.log" Jun 03 21:23:21.908466 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:21.908441 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-74hl7_53c4e7d5-526b-43ef-ba73-f670065df44e/init-textfile/0.log" Jun 03 21:23:22.255165 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:22.255097 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e255420-665d-4c05-a5c2-d4bfd370cad5/prometheus/0.log" Jun 03 21:23:22.280465 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:22.280423 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e255420-665d-4c05-a5c2-d4bfd370cad5/config-reloader/0.log" Jun 03 21:23:22.307769 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:22.307681 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e255420-665d-4c05-a5c2-d4bfd370cad5/thanos-sidecar/0.log" Jun 03 21:23:22.335532 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:22.335444 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e255420-665d-4c05-a5c2-d4bfd370cad5/kube-rbac-proxy-web/0.log" Jun 03 21:23:22.366530 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:22.366456 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e255420-665d-4c05-a5c2-d4bfd370cad5/kube-rbac-proxy/0.log" Jun 03 21:23:22.409421 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:22.409385 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e255420-665d-4c05-a5c2-d4bfd370cad5/kube-rbac-proxy-thanos/0.log" Jun 03 21:23:22.449628 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:22.449593 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e255420-665d-4c05-a5c2-d4bfd370cad5/init-config-reloader/0.log" Jun 03 21:23:22.545760 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:22.545669 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-fj8cq_b2ff2846-81e9-4e22-ab3b-1b4ac4cb5e93/prometheus-operator-admission-webhook/0.log" Jun 03 21:23:22.686820 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:22.686788 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cbdbff6d9-ktlst_a5a31666-6259-4990-82f0-b6eb577d3b32/thanos-query/0.log" Jun 03 21:23:22.713970 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:22.713924 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cbdbff6d9-ktlst_a5a31666-6259-4990-82f0-b6eb577d3b32/kube-rbac-proxy-web/0.log" Jun 03 21:23:22.744101 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:22.744071 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cbdbff6d9-ktlst_a5a31666-6259-4990-82f0-b6eb577d3b32/kube-rbac-proxy/0.log" Jun 03 21:23:22.768360 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:22.768314 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cbdbff6d9-ktlst_a5a31666-6259-4990-82f0-b6eb577d3b32/prom-label-proxy/0.log" Jun 03 21:23:22.796615 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:22.796498 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cbdbff6d9-ktlst_a5a31666-6259-4990-82f0-b6eb577d3b32/kube-rbac-proxy-rules/0.log" Jun 03 21:23:22.828822 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:22.828783 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cbdbff6d9-ktlst_a5a31666-6259-4990-82f0-b6eb577d3b32/kube-rbac-proxy-metrics/0.log" Jun 03 21:23:24.026043 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:24.025929 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-68d6b54856-cdm7x_9d436e2a-5481-4f64-9ba5-9e6eb39fcdb5/networking-console-plugin/0.log" Jun 03 21:23:25.516226 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.516180 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cdc4bf97d-mnqkm_24539b12-3912-4ad1-9ed1-e3fbb08323ea/console/0.log" Jun 03 21:23:25.632752 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.632707 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c"] Jun 03 21:23:25.641396 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.641362 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:25.659226 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.659181 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c"] Jun 03 21:23:25.713828 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.713783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7087b7c-408c-4be3-984f-b242cca4b78a-lib-modules\") pod \"perf-node-gather-daemonset-g4j7c\" (UID: \"d7087b7c-408c-4be3-984f-b242cca4b78a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:25.714050 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.713855 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thh5z\" (UniqueName: \"kubernetes.io/projected/d7087b7c-408c-4be3-984f-b242cca4b78a-kube-api-access-thh5z\") pod \"perf-node-gather-daemonset-g4j7c\" (UID: \"d7087b7c-408c-4be3-984f-b242cca4b78a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:25.714050 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.713881 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7087b7c-408c-4be3-984f-b242cca4b78a-sys\") pod \"perf-node-gather-daemonset-g4j7c\" (UID: \"d7087b7c-408c-4be3-984f-b242cca4b78a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:25.714050 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.714002 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7087b7c-408c-4be3-984f-b242cca4b78a-podres\") pod \"perf-node-gather-daemonset-g4j7c\" (UID: \"d7087b7c-408c-4be3-984f-b242cca4b78a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:25.714050 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.714043 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7087b7c-408c-4be3-984f-b242cca4b78a-proc\") pod \"perf-node-gather-daemonset-g4j7c\" (UID: \"d7087b7c-408c-4be3-984f-b242cca4b78a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:25.815203 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.815108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thh5z\" (UniqueName: \"kubernetes.io/projected/d7087b7c-408c-4be3-984f-b242cca4b78a-kube-api-access-thh5z\") pod \"perf-node-gather-daemonset-g4j7c\" (UID: \"d7087b7c-408c-4be3-984f-b242cca4b78a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:25.815203 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.815147 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7087b7c-408c-4be3-984f-b242cca4b78a-sys\") pod \"perf-node-gather-daemonset-g4j7c\" (UID: \"d7087b7c-408c-4be3-984f-b242cca4b78a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:25.815203 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.815201 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7087b7c-408c-4be3-984f-b242cca4b78a-podres\") pod \"perf-node-gather-daemonset-g4j7c\" (UID: \"d7087b7c-408c-4be3-984f-b242cca4b78a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:25.815568 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.815224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7087b7c-408c-4be3-984f-b242cca4b78a-proc\") pod \"perf-node-gather-daemonset-g4j7c\" (UID: \"d7087b7c-408c-4be3-984f-b242cca4b78a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:25.815568 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.815253 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7087b7c-408c-4be3-984f-b242cca4b78a-lib-modules\") pod \"perf-node-gather-daemonset-g4j7c\" (UID: \"d7087b7c-408c-4be3-984f-b242cca4b78a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:25.815568 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.815372 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7087b7c-408c-4be3-984f-b242cca4b78a-sys\") pod \"perf-node-gather-daemonset-g4j7c\" (UID: \"d7087b7c-408c-4be3-984f-b242cca4b78a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:25.815568 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.815401 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7087b7c-408c-4be3-984f-b242cca4b78a-podres\") pod \"perf-node-gather-daemonset-g4j7c\" (UID: \"d7087b7c-408c-4be3-984f-b242cca4b78a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:25.815568 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.815416 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7087b7c-408c-4be3-984f-b242cca4b78a-lib-modules\") pod \"perf-node-gather-daemonset-g4j7c\" (UID: \"d7087b7c-408c-4be3-984f-b242cca4b78a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:25.815568 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.815456 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7087b7c-408c-4be3-984f-b242cca4b78a-proc\") pod \"perf-node-gather-daemonset-g4j7c\" (UID: \"d7087b7c-408c-4be3-984f-b242cca4b78a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:25.824633 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.824605 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thh5z\" (UniqueName: \"kubernetes.io/projected/d7087b7c-408c-4be3-984f-b242cca4b78a-kube-api-access-thh5z\") pod \"perf-node-gather-daemonset-g4j7c\" (UID: \"d7087b7c-408c-4be3-984f-b242cca4b78a\") " pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:25.960373 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:25.960301 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:26.142111 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:26.141016 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c"] Jun 03 21:23:26.279454 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:26.279418 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-fgqmn_1a3565a2-ee2f-4973-b4f5-081d94ea18d0/volume-data-source-validator/0.log" Jun 03 21:23:26.530933 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:26.530885 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" event={"ID":"d7087b7c-408c-4be3-984f-b242cca4b78a","Type":"ContainerStarted","Data":"7291cf619aa612abba32da790744841dc566bd1b2d855c0784a6c169d7aff582"} Jun 03 21:23:26.531454 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:26.530961 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" event={"ID":"d7087b7c-408c-4be3-984f-b242cca4b78a","Type":"ContainerStarted","Data":"80d50c18d28a73a29eb00bf0366025dfc0e30fafe170718f589be57244756135"} Jun 03 21:23:26.531852 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:26.531811 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:26.553419 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:26.553333 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" podStartSLOduration=1.553310385 podStartE2EDuration="1.553310385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:23:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:23:26.551302461 +0000 UTC m=+2409.152529442" watchObservedRunningTime="2026-06-03 21:23:26.553310385 +0000 UTC m=+2409.154537366" Jun 03 21:23:27.386416 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:27.386390 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-px4nq_2d955896-e762-4a3b-9517-75622c75eafe/dns/0.log" Jun 03 21:23:27.410191 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:27.410157 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-px4nq_2d955896-e762-4a3b-9517-75622c75eafe/kube-rbac-proxy/0.log" Jun 03 21:23:27.485465 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:27.485435 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5f2ll_704afad7-2929-409b-a7ed-c877c45839ec/dns-node-resolver/0.log" Jun 03 21:23:28.147050 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:28.147025 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qmq99_3a9244b8-54da-477d-8860-1161ace67c83/node-ca/0.log" Jun 03 21:23:29.318854 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:29.318819 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6d85b7bd-tdksq_0ea1f3a8-5686-4b4b-bd54-57fa3fad4999/kube-auth-proxy/0.log" Jun 03 21:23:30.284478 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:30.284442 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bjbbr_618af87a-4eb4-4bc2-8f94-3915b3a005ff/serve-healthcheck-canary/0.log" Jun 03 21:23:30.823042 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:30.823005 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-mt8bs_39a33de3-9405-411b-8924-8ff39d3fc516/insights-operator/0.log" Jun 03 21:23:30.826334 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:30.826307 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-mt8bs_39a33de3-9405-411b-8924-8ff39d3fc516/insights-operator/1.log" Jun 03 21:23:30.848863 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:30.848836 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kt8vg_e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea/kube-rbac-proxy/0.log" Jun 03 21:23:30.876598 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:30.876569 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kt8vg_e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea/exporter/0.log" Jun 03 21:23:30.903278 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:30.903236 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kt8vg_e1d455b1-8c9f-47c6-bfa5-6b7745aa07ea/extractor/0.log" Jun 03 21:23:33.557538 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:33.557497 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pjqlg/perf-node-gather-daemonset-g4j7c" Jun 03 21:23:33.602942 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:33.602907 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675340-4cksx_decab6a4-9304-45d1-ad9c-97b02dbf43fd/cleanup/0.log" Jun 03 21:23:33.632814 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:33.632773 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675355-w7m45_0c16f33e-cf99-46ce-8dd2-e9b6e664226c/cleanup/0.log" Jun 03 21:23:34.027929 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:34.027893 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5965b9645d-lxgw7_500910cf-e806-445d-8506-3d8f9ad74c4f/manager/0.log" Jun 03 21:23:34.054398 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:34.054365 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5965b9645d-lxgw7_500910cf-e806-445d-8506-3d8f9ad74c4f/copy-manifests/0.log" Jun 03 21:23:34.084494 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:34.084461 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-d8vb8_954c9c57-9ec9-4399-ab9b-95a2a05d89dc/postgres/0.log" Jun 03 21:23:35.940702 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:35.940667 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-79d7d4f4f7-zv586_a2ef8638-36c4-4e57-8f6d-e44962cac61e/manager/0.log" Jun 03 21:23:39.216538 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:39.216501 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6d85b7bd-tdksq_0ea1f3a8-5686-4b4b-bd54-57fa3fad4999/kube-auth-proxy/0.log" Jun 03 21:23:40.687841 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:40.687812 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6d85b7bd-tdksq_0ea1f3a8-5686-4b4b-bd54-57fa3fad4999/kube-auth-proxy/0.log" Jun 03 21:23:41.388632 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:41.388594 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-9jzw4_9d5c4ec5-ee59-4b2f-92ef-f05064f53bc4/migrator/0.log" Jun 03 21:23:41.413072 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:41.413036 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-9jzw4_9d5c4ec5-ee59-4b2f-92ef-f05064f53bc4/graceful-termination/0.log" Jun 03 21:23:42.910268 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:42.910141 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6d85b7bd-tdksq_0ea1f3a8-5686-4b4b-bd54-57fa3fad4999/kube-auth-proxy/0.log" Jun 03 21:23:43.228829 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:43.228803 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5gsw_7868b106-9752-43d7-bb61-85e9a8fe78f1/kube-multus-additional-cni-plugins/0.log" Jun 03 21:23:43.261747 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:43.261713 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5gsw_7868b106-9752-43d7-bb61-85e9a8fe78f1/egress-router-binary-copy/0.log" Jun 03 21:23:43.286914 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:43.286886 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5gsw_7868b106-9752-43d7-bb61-85e9a8fe78f1/cni-plugins/0.log" Jun 03 21:23:43.312616 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:43.312522 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5gsw_7868b106-9752-43d7-bb61-85e9a8fe78f1/bond-cni-plugin/0.log" Jun 03 21:23:43.338631 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:43.338600 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5gsw_7868b106-9752-43d7-bb61-85e9a8fe78f1/routeoverride-cni/0.log" Jun 03 21:23:43.362478 ip-10-0-128-196 kubenswrapper[2577]: I0603 21:23:43.362449 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5gsw_7868b106-9752-43d7-bb61-85e9a8fe78f1/whereabouts-cni-bincopy/0.log"