Jun 12 21:43:33.153939 ip-10-0-128-93 systemd[1]: Starting Kubernetes Kubelet... Jun 12 21:43:33.551359 ip-10-0-128-93 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 21:43:33.551359 ip-10-0-128-93 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 21:43:33.551359 ip-10-0-128-93 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 21:43:33.551359 ip-10-0-128-93 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 21:43:33.551359 ip-10-0-128-93 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 21:43:33.553171 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.553102 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 21:43:33.557470 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557455 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:43:33.557470 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557469 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557473 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557477 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557480 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557482 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557485 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557488 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557491 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557494 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557496 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557500 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557503 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557506 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557511 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557515 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557523 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557526 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557529 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557532 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:43:33.557564 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557535 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557537 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557539 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557542 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557545 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557547 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557550 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557552 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557555 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557558 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557560 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557563 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557565 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557568 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557571 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557574 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557577 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557580 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557582 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557584 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:43:33.558081 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557587 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557589 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557592 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557595 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557597 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557600 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557602 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557605 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557607 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557610 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557613 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557616 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557619 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557621 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557625 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557628 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557630 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557633 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557636 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557638 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:43:33.558803 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557641 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557643 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557646 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557650 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557653 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557656 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557659 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557677 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557681 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557698 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557702 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557705 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557708 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557710 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557712 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557715 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557718 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557720 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557723 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557726 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:43:33.559332 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557728 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557731 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557734 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557737 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557739 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557742 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557746 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557751 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557755 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557757 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557760 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557763 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557766 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557768 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557771 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557773 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557775 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557778 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:43:33.559870 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.557780 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:43:33.560530 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560515 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:43:33.560560 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560531 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:43:33.560560 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560535 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:43:33.560560 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560538 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:43:33.560560 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560542 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:43:33.560560 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560545 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:43:33.560560 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560548 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:43:33.560560 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560551 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:43:33.560560 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560554 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:43:33.560560 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560557 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:43:33.560560 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560560 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:43:33.560560 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560563 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560566 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560570 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560572 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560575 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560577 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560580 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560586 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560588 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560591 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560594 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560596 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560598 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560601 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560604 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560606 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560609 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560611 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560614 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560616 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:43:33.560847 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560619 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560623 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560627 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560630 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560638 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560641 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560644 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560647 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560650 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560652 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560655 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560657 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560660 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560675 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560679 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560683 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560687 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560690 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560693 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:43:33.561337 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560697 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560702 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560705 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560708 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560710 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560713 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560716 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560718 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560721 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560724 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560726 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560729 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560731 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560734 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560737 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560740 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560742 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560745 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560748 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:43:33.561818 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560750 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560753 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560756 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560758 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560761 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560763 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560766 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560769 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560772 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560775 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560778 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560780 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560783 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560785 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560789 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560791 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560794 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560796 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560799 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560801 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:43:33.562272 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560804 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560806 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560809 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560811 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560814 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560816 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560820 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560823 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560825 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.560828 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561205 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561210 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561212 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561215 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561218 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561220 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561223 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561225 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561228 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561230 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:43:33.562760 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561233 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561236 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561240 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561244 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561247 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561250 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561254 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561257 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561259 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561262 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561265 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561269 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561271 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561274 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561277 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561279 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561282 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561285 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561287 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:43:33.563253 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561290 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561292 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561294 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561297 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561300 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561302 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561304 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561307 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561309 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561312 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561314 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561317 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561319 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561322 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561325 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561328 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561330 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561334 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561337 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561339 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:43:33.563730 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561342 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561345 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561348 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561351 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561353 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561356 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561358 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561361 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561363 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561366 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561368 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561372 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561376 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561378 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561381 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561384 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561387 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561389 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561392 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:43:33.564260 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561395 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561398 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561401 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561404 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561406 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561409 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561411 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561414 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561417 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561419 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561422 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561424 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561427 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561429 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561432 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561435 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561438 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561440 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561443 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561445 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:43:33.564740 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561448 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561452 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561455 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561457 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561460 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561462 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561465 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561467 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561470 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561472 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.561474 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561539 2563 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561546 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561553 2563 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561566 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561570 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561573 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561577 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561582 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561586 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561589 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 21:43:33.565217 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561592 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561596 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561599 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561602 2563 flags.go:64] FLAG: --cgroup-root="" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561604 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561607 2563 flags.go:64] FLAG: --client-ca-file="" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561610 2563 flags.go:64] FLAG: --cloud-provider="external" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561613 2563 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561618 2563 flags.go:64] FLAG: --cluster-domain="" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561621 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561624 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561627 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561630 2563 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561634 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561637 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561640 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561643 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561646 2563 flags.go:64] FLAG: --contention-profiling="false" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561649 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561652 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561655 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561658 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561674 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561678 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561681 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 21:43:33.565738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561684 2563 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561686 2563 flags.go:64] FLAG: --enable-server="true" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561689 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561693 2563 flags.go:64] FLAG: --event-burst="100" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561701 2563 flags.go:64] FLAG: --event-qps="50" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561704 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561707 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561710 2563 flags.go:64] FLAG: --eviction-hard="" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561714 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561717 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561719 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561722 2563 flags.go:64] FLAG: --eviction-soft="" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561725 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561728 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561732 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561735 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561738 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561740 2563 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561743 2563 flags.go:64] FLAG: --feature-gates="" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561747 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561750 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561753 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561756 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561759 2563 flags.go:64] FLAG: --healthz-port="10248" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561762 2563 flags.go:64] FLAG: --help="false" Jun 12 21:43:33.566327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561764 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-128-93.ec2.internal" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561767 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561770 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561773 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561776 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561780 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561782 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561785 2563 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561788 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561791 2563 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561793 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561798 2563 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561801 2563 flags.go:64] FLAG: --kube-reserved="" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561804 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561806 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561810 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561812 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561816 2563 flags.go:64] FLAG: --lock-file="" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561818 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561822 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561825 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561830 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561834 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561837 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 21:43:33.566962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561840 2563 flags.go:64] FLAG: --logging-format="text" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561843 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561846 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561849 2563 flags.go:64] FLAG: --manifest-url="" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561852 2563 flags.go:64] FLAG: --manifest-url-header="" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561856 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561859 2563 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561863 2563 flags.go:64] FLAG: --max-pods="110" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561866 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561869 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561872 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561875 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561878 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561880 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561883 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561890 2563 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561893 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561896 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561899 2563 flags.go:64] FLAG: --pod-cidr="" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561904 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561909 2563 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561912 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561915 2563 flags.go:64] FLAG: --pods-per-core="0" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561918 2563 flags.go:64] FLAG: --port="10250" Jun 12 21:43:33.567679 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561921 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561923 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fc087ba0774d0ccd" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561927 2563 flags.go:64] FLAG: --qos-reserved="" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561930 2563 flags.go:64] FLAG: --read-only-port="10255" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561933 2563 flags.go:64] FLAG: --register-node="true" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561935 2563 flags.go:64] FLAG: --register-with-taints="" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561939 2563 flags.go:64] FLAG: --registry-burst="10" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561942 2563 flags.go:64] FLAG: --registry-qps="5" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561945 2563 flags.go:64] FLAG: --reserved-cpus="" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561948 2563 flags.go:64] FLAG: --reserved-memory="" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561951 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561954 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561957 2563 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561960 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561962 2563 flags.go:64] FLAG: --runonce="false" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561965 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561968 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561971 2563 flags.go:64] FLAG: --seccomp-default="false" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561974 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561976 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561979 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561982 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561987 2563 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561990 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561993 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 21:43:33.568716 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561996 2563 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.561998 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.562001 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.562005 2563 flags.go:64] FLAG: --system-cgroups="" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.562008 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.562014 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.562017 2563 flags.go:64] FLAG: --tls-cert-file="" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.562020 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.562024 2563 flags.go:64] FLAG: --tls-min-version="" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.562027 2563 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.562030 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.562033 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.562036 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.562038 2563 flags.go:64] FLAG: --v="2" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.562042 2563 flags.go:64] FLAG: --version="false" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.562047 2563 flags.go:64] FLAG: --vmodule="" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.562050 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.562054 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562165 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562168 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562172 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562176 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562178 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:43:33.569772 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562181 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562184 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562187 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562189 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562192 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562195 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562198 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562201 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562204 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562206 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562209 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562211 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562215 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562218 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562220 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562223 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562225 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562228 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562230 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562233 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:43:33.570755 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562236 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562239 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562241 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562244 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562246 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562249 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562252 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562255 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562258 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562261 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562263 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562265 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562268 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562270 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562273 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562276 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562278 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562281 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562285 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562288 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:43:33.571558 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562290 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562293 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562295 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562298 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562302 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562305 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562308 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562310 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562313 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562315 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562318 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562321 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562323 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562326 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562328 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562331 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562333 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562336 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562339 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562341 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:43:33.572159 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562344 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562346 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562349 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562351 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562354 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562358 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562361 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562365 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562369 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562372 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562376 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562379 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562381 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562384 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562386 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562389 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562393 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562397 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:43:33.573017 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562400 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:43:33.573637 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562403 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:43:33.573637 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562406 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:43:33.573637 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562409 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:43:33.573637 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562412 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:43:33.573637 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562414 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:43:33.573637 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562417 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:43:33.573637 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562420 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:43:33.573637 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562423 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:43:33.573637 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562425 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:43:33.573637 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562428 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:43:33.573637 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562430 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:43:33.573637 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562433 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:43:33.573637 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562436 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:43:33.573637 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562439 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:43:33.573637 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.562441 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:43:33.574138 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.562949 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 21:43:33.574138 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.569906 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 21:43:33.574138 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.569924 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 21:43:33.574138 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.569943 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 21:43:33.574138 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.569952 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 21:43:33.574138 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570039 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:43:33.574138 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570047 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:43:33.574138 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570052 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:43:33.574138 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570057 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:43:33.574138 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570062 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:43:33.574138 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570067 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:43:33.574138 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570072 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:43:33.574138 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570076 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:43:33.574138 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570081 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:43:33.574138 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570086 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570090 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570095 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570099 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570103 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570108 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570112 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570116 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570120 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570124 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570129 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570133 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570137 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570141 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570146 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570150 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570154 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570158 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570163 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:43:33.574542 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570170 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570178 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570184 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570188 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570193 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570197 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570202 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570208 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570213 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570218 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570222 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570227 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570231 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570236 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570240 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570245 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570249 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570254 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570258 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570262 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:43:33.575139 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570267 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570271 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570275 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570279 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570283 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570287 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570292 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570296 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570300 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570305 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570309 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570314 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570318 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570323 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570330 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570336 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570341 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570345 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570349 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:43:33.575738 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570353 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570357 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570362 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570365 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570370 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570374 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570378 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570382 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570386 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570391 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570395 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570399 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570403 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570407 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570411 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570416 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570420 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570424 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570428 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570432 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:43:33.576263 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570436 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:43:33.576747 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570440 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:43:33.576747 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570444 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:43:33.576747 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570448 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:43:33.576747 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570452 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:43:33.576747 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570457 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:43:33.576747 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570461 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:43:33.576747 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570465 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:43:33.576747 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570470 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:43:33.576747 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570474 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:43:33.576747 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570479 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:43:33.576747 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570483 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:43:33.576747 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.570490 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 21:43:33.576747 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570704 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 21:43:33.576747 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570713 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 21:43:33.576747 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570717 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570722 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570727 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570732 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570736 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570741 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570745 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570750 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570754 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570758 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570762 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570766 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570770 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570774 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570778 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570782 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570786 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570790 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570794 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570798 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 21:43:33.577145 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570802 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570806 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570810 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570815 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570819 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570823 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570828 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570832 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570836 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570840 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570844 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570849 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570853 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570857 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570861 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570868 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570874 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570879 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570884 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 21:43:33.577917 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570888 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570893 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570897 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570902 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570906 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570911 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570915 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570920 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570924 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570929 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570940 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570945 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570949 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570953 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570957 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570962 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570966 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570970 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570974 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570978 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 21:43:33.578380 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570992 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.570996 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571000 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571004 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571008 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571012 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571017 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571021 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571025 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571029 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571033 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571037 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571043 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571048 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571052 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571057 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571061 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571065 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571069 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 21:43:33.578885 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571074 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571078 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571082 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571086 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571091 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571095 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571099 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571103 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571108 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571112 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571116 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571121 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571125 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571129 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571145 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571151 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571156 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571161 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 21:43:33.579350 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:33.571165 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 21:43:33.579804 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.571174 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 21:43:33.579804 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.571345 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 21:43:33.579804 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.573996 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 21:43:33.579804 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.575265 2563 server.go:1019] "Starting client certificate rotation" Jun 12 21:43:33.579804 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.575370 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 21:43:33.579804 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.576176 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 21:43:33.579804 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.578117 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 21:43:33.579980 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.579522 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 21:43:33.590528 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.590512 2563 log.go:25] "Validated CRI v1 runtime API" Jun 12 21:43:33.593462 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.593447 2563 log.go:25] "Validated CRI v1 image API" Jun 12 21:43:33.595429 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.595417 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 21:43:33.598854 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.598834 2563 fs.go:135] Filesystem UUIDs: map[449b7d39-49e8-403e-90cb-cd7c8bd6ebf2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9b1dc900-ada2-4404-87bf-76573e98bba0:/dev/nvme0n1p3] Jun 12 21:43:33.598900 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.598855 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 21:43:33.603264 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.603247 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 21:43:33.604501 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.604399 2563 manager.go:216] Machine: {Timestamp:2026-06-12 21:43:33.603295001 +0000 UTC m=+0.327578242 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3124657 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c3edea22af1628dcb7137bd3021a2 SystemUUID:ec2c3ede-a22a-f162-8dcb-7137bd3021a2 BootID:bf8bf3c9-46c0-41f9-b801-eeb6bf5c0a9e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:36:e7:ae:ce:fd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:36:e7:ae:ce:fd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:65:ee:21:ec:fd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 21:43:33.604501 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.604496 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 21:43:33.604640 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.604580 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 21:43:33.607536 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.607508 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 21:43:33.607671 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.607539 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-93.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 21:43:33.608747 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.608737 2563 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 21:43:33.608781 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.608749 2563 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 21:43:33.608781 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.608757 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 21:43:33.609428 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.609418 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 21:43:33.610617 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.610608 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 21:43:33.613640 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.613629 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 12 21:43:33.613763 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.613753 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 21:43:33.613805 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.613780 2563 kubelet.go:486] "Attempting to sync node with API server" Jun 12 21:43:33.613805 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.613789 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 21:43:33.613805 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.613802 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 21:43:33.613907 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.613811 2563 kubelet.go:398] "Adding apiserver pod source" Jun 12 21:43:33.613907 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.613819 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 21:43:33.614169 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.614158 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 21:43:33.614201 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.614182 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 21:43:33.616375 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.616359 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 21:43:33.617760 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.617744 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 21:43:33.617838 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.617774 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 21:43:33.617948 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.617937 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 21:43:33.617995 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.617952 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 21:43:33.617995 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.617959 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 21:43:33.617995 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.617964 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 21:43:33.617995 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.617975 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 21:43:33.618103 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.618002 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 21:43:33.618482 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.618473 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 21:43:33.618512 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.618482 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 21:43:33.618512 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.618488 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 21:43:33.618512 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.618493 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 21:43:33.618512 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.618507 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 21:43:33.618619 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.618515 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 21:43:33.618619 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.618536 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 21:43:33.618619 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.618544 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 21:43:33.621471 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.621455 2563 server.go:1268] "Started kubelet" Jun 12 21:43:33.621817 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.621693 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 21:43:33.621817 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.621655 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 21:43:33.621817 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.621772 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 21:43:33.622265 ip-10-0-128-93 systemd[1]: Started Kubernetes Kubelet. Jun 12 21:43:33.623475 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.623455 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 21:43:33.624449 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.624433 2563 server.go:310] "Adding debug handlers to kubelet server" Jun 12 21:43:33.627860 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.627843 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-93.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 21:43:33.627952 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.627903 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 21:43:33.628043 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.628024 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 21:43:33.628778 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.627879 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-93.ec2.internal.18b87378691730cb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-93.ec2.internal,UID:ip-10-0-128-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-93.ec2.internal,},FirstTimestamp:2026-06-12 21:43:33.621428427 +0000 UTC m=+0.345711668,LastTimestamp:2026-06-12 21:43:33.621428427 +0000 UTC m=+0.345711668,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-93.ec2.internal,}" Jun 12 21:43:33.629106 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.629089 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 21:43:33.629210 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.629193 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 21:43:33.629311 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.629210 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 21:43:33.629446 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.629327 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-93.ec2.internal\" not found" Jun 12 21:43:33.629921 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.629901 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 21:43:33.629921 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.629920 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 21:43:33.630058 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.629900 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 21:43:33.630058 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.630006 2563 reconstruct.go:97] "Volume reconstruction finished" Jun 12 21:43:33.630058 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.630015 2563 reconciler.go:29] "Reconciler: start to sync state" Jun 12 21:43:33.630702 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.630684 2563 factory.go:55] Registering systemd factory Jun 12 21:43:33.630702 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.630703 2563 factory.go:223] Registration of the systemd container factory successfully Jun 12 21:43:33.631006 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.630991 2563 factory.go:153] Registering CRI-O factory Jun 12 21:43:33.631055 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.631009 2563 factory.go:223] Registration of the crio container factory successfully Jun 12 21:43:33.631094 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.631074 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 21:43:33.631145 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.631099 2563 factory.go:103] Registering Raw factory Jun 12 21:43:33.631145 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.631110 2563 manager.go:1196] Started watching for new ooms in manager Jun 12 21:43:33.631501 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.631488 2563 manager.go:349] Starting recovery of all containers Jun 12 21:43:33.635777 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.635748 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 12 21:43:33.635915 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.635894 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 12 21:43:33.638507 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.638469 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 21:43:33.641124 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.641109 2563 manager.go:354] Recovery completed Jun 12 21:43:33.646357 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.646345 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:43:33.648153 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.648137 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-84xlt" Jun 12 21:43:33.648241 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.648230 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:43:33.648289 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.648253 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:43:33.648289 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.648263 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:43:33.648841 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.648769 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 21:43:33.648841 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.648782 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 21:43:33.648841 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.648786 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:43:33.648841 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.648797 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 12 21:43:33.649585 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.649569 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:43:33.649656 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.649592 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:43:33.649656 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.649601 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:43:33.650111 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.650096 2563 policy_none.go:49] "None policy: Start" Jun 12 21:43:33.650181 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.650136 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 21:43:33.650181 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.650149 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 21:43:33.650268 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.650165 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-93.ec2.internal.18b873786ab05205 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-93.ec2.internal,UID:ip-10-0-128-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-93.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-93.ec2.internal,},FirstTimestamp:2026-06-12 21:43:33.648241157 +0000 UTC m=+0.372524401,LastTimestamp:2026-06-12 21:43:33.648241157 +0000 UTC m=+0.372524401,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-93.ec2.internal,}" Jun 12 21:43:33.651219 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.651205 2563 policy_none.go:47] "Start" Jun 12 21:43:33.655170 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.655154 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-84xlt" Jun 12 21:43:33.657331 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.657275 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-93.ec2.internal.18b873786ab093b5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-93.ec2.internal,UID:ip-10-0-128-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-93.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-93.ec2.internal,},FirstTimestamp:2026-06-12 21:43:33.648257973 +0000 UTC m=+0.372541213,LastTimestamp:2026-06-12 21:43:33.648257973 +0000 UTC m=+0.372541213,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-93.ec2.internal,}" Jun 12 21:43:33.689406 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.689388 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 21:43:33.694218 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.689423 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 21:43:33.694218 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.689438 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 21:43:33.694218 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.689486 2563 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 12 21:43:33.694218 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.691723 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 21:43:33.694218 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.692296 2563 manager.go:337] "Starting Device Plugin manager" Jun 12 21:43:33.694218 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.692319 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 21:43:33.694218 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.692327 2563 server.go:87] "Starting device plugin registration server" Jun 12 21:43:33.694218 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.692548 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 21:43:33.694218 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.692557 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 21:43:33.694218 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.692760 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 21:43:33.694218 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.692878 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 21:43:33.694218 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.692888 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 21:43:33.694218 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.693223 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 21:43:33.694218 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.693261 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-93.ec2.internal\" not found" Jun 12 21:43:33.790221 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.790199 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-93.ec2.internal"] Jun 12 21:43:33.790273 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.790252 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:43:33.790974 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.790953 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:43:33.790974 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.790978 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:43:33.791118 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.790991 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:43:33.792279 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.792266 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:43:33.792934 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.792384 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal" Jun 12 21:43:33.792934 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.792407 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:43:33.792934 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.792753 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:43:33.793102 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.792996 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:43:33.793102 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.793024 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:43:33.793102 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.793043 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:43:33.793102 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.792998 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:43:33.793102 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.793097 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:43:33.793302 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.793109 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:43:33.793339 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.793315 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:43:33.793339 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.793331 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:43:33.793431 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.793340 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:43:33.793431 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.793356 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-93.ec2.internal" Jun 12 21:43:33.794605 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.794588 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-93.ec2.internal" Jun 12 21:43:33.794685 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.794622 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:43:33.795306 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.795290 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:43:33.795382 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.795318 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:43:33.795382 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.795327 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:43:33.801563 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.801533 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-93.ec2.internal" Jun 12 21:43:33.801563 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.801551 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-93.ec2.internal\": node \"ip-10-0-128-93.ec2.internal\" not found" Jun 12 21:43:33.817337 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.817320 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-93.ec2.internal\" not found" node="ip-10-0-128-93.ec2.internal" Jun 12 21:43:33.821652 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.821638 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-93.ec2.internal\" not found" node="ip-10-0-128-93.ec2.internal" Jun 12 21:43:33.826500 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.826488 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-93.ec2.internal\" not found" Jun 12 21:43:33.831718 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.831703 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6437f43ae319d7be8f4dd44aaefc0491-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal\" (UID: \"6437f43ae319d7be8f4dd44aaefc0491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal" Jun 12 21:43:33.831766 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.831725 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6437f43ae319d7be8f4dd44aaefc0491-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal\" (UID: \"6437f43ae319d7be8f4dd44aaefc0491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal" Jun 12 21:43:33.831766 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.831741 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66a2fc8e948c8d5135e0ca9ee3460e65-config\") pod \"kube-apiserver-proxy-ip-10-0-128-93.ec2.internal\" (UID: \"66a2fc8e948c8d5135e0ca9ee3460e65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-93.ec2.internal" Jun 12 21:43:33.926851 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:33.926833 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-93.ec2.internal\" not found" Jun 12 21:43:33.932172 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.932157 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6437f43ae319d7be8f4dd44aaefc0491-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal\" (UID: \"6437f43ae319d7be8f4dd44aaefc0491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal" Jun 12 21:43:33.932229 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.932180 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66a2fc8e948c8d5135e0ca9ee3460e65-config\") pod \"kube-apiserver-proxy-ip-10-0-128-93.ec2.internal\" (UID: \"66a2fc8e948c8d5135e0ca9ee3460e65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-93.ec2.internal" Jun 12 21:43:33.932229 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.932196 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6437f43ae319d7be8f4dd44aaefc0491-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal\" (UID: \"6437f43ae319d7be8f4dd44aaefc0491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal" Jun 12 21:43:33.932302 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.932262 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6437f43ae319d7be8f4dd44aaefc0491-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal\" (UID: \"6437f43ae319d7be8f4dd44aaefc0491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal" Jun 12 21:43:33.932337 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.932326 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6437f43ae319d7be8f4dd44aaefc0491-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal\" (UID: \"6437f43ae319d7be8f4dd44aaefc0491\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal" Jun 12 21:43:33.932371 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:33.932358 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66a2fc8e948c8d5135e0ca9ee3460e65-config\") pod \"kube-apiserver-proxy-ip-10-0-128-93.ec2.internal\" (UID: \"66a2fc8e948c8d5135e0ca9ee3460e65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-93.ec2.internal" Jun 12 21:43:34.027340 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:34.027315 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-93.ec2.internal\" not found" Jun 12 21:43:34.120040 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:34.119985 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal" Jun 12 21:43:34.125034 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:34.125017 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-93.ec2.internal" Jun 12 21:43:34.128155 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:34.128141 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-93.ec2.internal\" not found" Jun 12 21:43:34.228971 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:34.228940 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-93.ec2.internal\" not found" Jun 12 21:43:34.329379 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:34.329357 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-93.ec2.internal\" not found" Jun 12 21:43:34.429817 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:34.429762 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-93.ec2.internal\" not found" Jun 12 21:43:34.530222 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:34.530194 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-93.ec2.internal\" not found" Jun 12 21:43:34.574522 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:34.574503 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 21:43:34.575036 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:34.574617 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 21:43:34.630624 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:34.630606 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-93.ec2.internal\" not found" Jun 12 21:43:34.659147 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:34.658950 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 21:38:33 +0000 UTC" deadline="2028-01-01 16:51:27.064722029 +0000 UTC" Jun 12 21:43:34.659241 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:34.659149 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13627h7m52.405578311s" Jun 12 21:43:34.728194 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:34.728138 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 21:43:34.729044 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:34.729029 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasSufficientMemory" Jun 12 21:43:34.729128 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:34.729062 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 21:43:34.729128 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:34.729077 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeHasSufficientPID" Jun 12 21:43:34.731202 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:34.731186 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-93.ec2.internal\" not found" Jun 12 21:43:34.753503 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:34.753475 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6437f43ae319d7be8f4dd44aaefc0491.slice/crio-f7ea3c98e447438745e9ff735a8c8cd5306c0bee3eaa9307b27afcf521fc6cf4 WatchSource:0}: Error finding container f7ea3c98e447438745e9ff735a8c8cd5306c0bee3eaa9307b27afcf521fc6cf4: Status 404 returned error can't find the container with id f7ea3c98e447438745e9ff735a8c8cd5306c0bee3eaa9307b27afcf521fc6cf4 Jun 12 21:43:34.753995 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:34.753975 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a2fc8e948c8d5135e0ca9ee3460e65.slice/crio-7d0e47d7c25b2f139cf97ca159779529388063ff32266c4f61c437704b1fd68f WatchSource:0}: Error finding container 7d0e47d7c25b2f139cf97ca159779529388063ff32266c4f61c437704b1fd68f: Status 404 returned error can't find the container with id 7d0e47d7c25b2f139cf97ca159779529388063ff32266c4f61c437704b1fd68f Jun 12 21:43:34.758122 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:34.758108 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 21:43:34.832194 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:34.832159 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-93.ec2.internal\" not found" Jun 12 21:43:34.932747 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:34.932727 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-93.ec2.internal\" not found" Jun 12 21:43:35.033199 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:35.033160 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-93.ec2.internal\" not found" Jun 12 21:43:35.081184 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.081166 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 21:43:35.134056 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:35.134034 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-93.ec2.internal\" not found" Jun 12 21:43:35.189246 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.189227 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 21:43:35.204867 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.204848 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 21:43:35.230421 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.230402 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-93.ec2.internal" Jun 12 21:43:35.242123 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.242104 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 21:43:35.242965 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.242954 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal" Jun 12 21:43:35.254136 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.254121 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 21:43:35.547001 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.546821 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 21:43:35.615633 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.615609 2563 apiserver.go:52] "Watching apiserver" Jun 12 21:43:35.622451 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.622422 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 21:43:35.622891 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.622853 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-jjhkm","openshift-multus/network-metrics-daemon-kcq4r","openshift-network-diagnostics/network-check-target-5n2vz","openshift-network-operator/iptables-alerter-jwz9l","openshift-ovn-kubernetes/ovnkube-node-fnlbf","kube-system/global-pull-secret-syncer-pn5xz","kube-system/konnectivity-agent-t5rg9","kube-system/kube-apiserver-proxy-ip-10-0-128-93.ec2.internal","openshift-cluster-node-tuning-operator/tuned-jk7bg","openshift-dns/node-resolver-n2rwp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal","openshift-multus/multus-4b7w6","openshift-multus/multus-additional-cni-plugins-qd7gq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc"] Jun 12 21:43:35.625310 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.625285 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jjhkm" Jun 12 21:43:35.627372 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.627235 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 21:43:35.627584 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.627565 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sc5lx\"" Jun 12 21:43:35.627737 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.627719 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 21:43:35.627804 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.627772 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.628175 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.628155 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 21:43:35.629988 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.629961 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 21:43:35.630152 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.630135 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 21:43:35.630366 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.630331 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 21:43:35.630366 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.630342 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s6fwc\"" Jun 12 21:43:35.630724 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.630528 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:35.630724 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.630541 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 21:43:35.630724 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:35.630587 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:43:35.632117 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.632094 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.634526 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.634066 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 21:43:35.634526 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.634124 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 21:43:35.634526 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.634140 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7dqrz\"" Jun 12 21:43:35.634526 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.634375 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 21:43:35.634526 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.634401 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.634526 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.634502 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 21:43:35.634736 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.634558 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 21:43:35.636143 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.636124 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k6vjq\"" Jun 12 21:43:35.636532 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.636513 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 21:43:35.636754 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.636723 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.637545 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.637435 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 21:43:35.637545 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.637448 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 21:43:35.637840 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.637824 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 21:43:35.638087 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.638072 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 21:43:35.638327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.638312 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 21:43:35.638914 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.638812 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 21:43:35.638914 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.638825 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7fxmw\"" Jun 12 21:43:35.640206 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.639350 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t5rg9" Jun 12 21:43:35.640940 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.640881 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.640940 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.640913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-registration-dir\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.641104 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.640942 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-etc-selinux\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.641104 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.640963 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-sys-fs\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.641104 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.640998 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hh5k\" (UniqueName: \"kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k\") pod \"network-check-target-5n2vz\" (UID: \"3e0ffb25-9794-4397-9dee-7b6f4cd32e3b\") " pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:35.641104 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641026 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.641104 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641064 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.641354 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641107 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-socket-dir\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.641354 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641132 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-cnibin\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.641354 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641166 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.641354 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641207 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87wln\" (UniqueName: \"kubernetes.io/projected/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-kube-api-access-87wln\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.641354 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641222 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v6g9s\"" Jun 12 21:43:35.641354 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641268 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a539c62-3abf-4aa8-af59-c5193cd47800-host\") pod \"node-ca-jjhkm\" (UID: \"9a539c62-3abf-4aa8-af59-c5193cd47800\") " pod="openshift-image-registry/node-ca-jjhkm" Jun 12 21:43:35.641354 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-device-dir\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.641354 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-system-cni-dir\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.641354 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641323 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 21:43:35.641783 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641396 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-os-release\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.641783 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641404 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 21:43:35.641783 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641428 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-cni-binary-copy\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.641783 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641452 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9a539c62-3abf-4aa8-af59-c5193cd47800-serviceca\") pod \"node-ca-jjhkm\" (UID: \"9a539c62-3abf-4aa8-af59-c5193cd47800\") " pod="openshift-image-registry/node-ca-jjhkm" Jun 12 21:43:35.641783 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641493 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx924\" (UniqueName: \"kubernetes.io/projected/9a539c62-3abf-4aa8-af59-c5193cd47800-kube-api-access-bx924\") pod \"node-ca-jjhkm\" (UID: \"9a539c62-3abf-4aa8-af59-c5193cd47800\") " pod="openshift-image-registry/node-ca-jjhkm" Jun 12 21:43:35.641783 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641522 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4cb8\" (UniqueName: \"kubernetes.io/projected/2f45d449-7cd4-4b25-8972-69758824c534-kube-api-access-j4cb8\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.641783 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641574 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 21:43:35.642090 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.641933 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.643520 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.643489 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rklrs\"" Jun 12 21:43:35.643676 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.643648 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 21:43:35.643750 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.643696 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 21:43:35.646192 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.645855 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n2rwp" Jun 12 21:43:35.647789 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.647771 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 21:43:35.648371 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.648350 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gw7c4\"" Jun 12 21:43:35.648459 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.648396 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 21:43:35.649860 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.649113 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:35.649985 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:35.649960 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:43:35.653235 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.652929 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jwz9l" Jun 12 21:43:35.655075 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.654835 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 21:43:35.655075 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.654905 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 21:43:35.655075 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.654949 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 21:43:35.655270 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.655195 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:35.655270 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:35.655251 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:43:35.655467 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.655441 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mdzxs\"" Jun 12 21:43:35.661572 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.661552 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pqlpr" Jun 12 21:43:35.668946 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.668756 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pqlpr" Jun 12 21:43:35.694658 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.694614 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-93.ec2.internal" event={"ID":"66a2fc8e948c8d5135e0ca9ee3460e65","Type":"ContainerStarted","Data":"7d0e47d7c25b2f139cf97ca159779529388063ff32266c4f61c437704b1fd68f"} Jun 12 21:43:35.696155 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.696130 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal" event={"ID":"6437f43ae319d7be8f4dd44aaefc0491","Type":"ContainerStarted","Data":"f7ea3c98e447438745e9ff735a8c8cd5306c0bee3eaa9307b27afcf521fc6cf4"} Jun 12 21:43:35.731156 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.731134 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 21:43:35.742653 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.742631 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3cd3425f-322c-481d-bcdc-cbc7a9676764-hosts-file\") pod \"node-resolver-n2rwp\" (UID: \"3cd3425f-322c-481d-bcdc-cbc7a9676764\") " pod="openshift-dns/node-resolver-n2rwp" Jun 12 21:43:35.742768 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.742680 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-os-release\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.742768 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.742710 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-cni-binary-copy\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.742768 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.742739 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx924\" (UniqueName: \"kubernetes.io/projected/9a539c62-3abf-4aa8-af59-c5193cd47800-kube-api-access-bx924\") pod \"node-ca-jjhkm\" (UID: \"9a539c62-3abf-4aa8-af59-c5193cd47800\") " pod="openshift-image-registry/node-ca-jjhkm" Jun 12 21:43:35.742768 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.742762 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-var-lib-cni-multus\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.742966 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.742785 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8f7ac87-c842-4d2f-9307-1d3b28983356-host-slash\") pod \"iptables-alerter-jwz9l\" (UID: \"d8f7ac87-c842-4d2f-9307-1d3b28983356\") " pod="openshift-network-operator/iptables-alerter-jwz9l" Jun 12 21:43:35.742966 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.742808 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-run-systemd\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.742966 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.742835 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-kubernetes\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.742966 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.742890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs\") pod \"network-metrics-daemon-kcq4r\" (UID: \"a8029f62-78fe-46b2-8587-0c150c839d9c\") " pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:35.742966 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.742920 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-registration-dir\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.743139 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.742972 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-sys-fs\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.743139 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.742987 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-registration-dir\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.743139 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743006 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-hostroot\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.743139 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743031 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-systemd-units\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.743139 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743044 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-sys-fs\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.743139 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743054 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-etc-openvswitch\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.743139 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743081 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54b820c6-53e5-455b-8211-32e44f9a925c-dbus\") pod \"global-pull-secret-syncer-pn5xz\" (UID: \"54b820c6-53e5-455b-8211-32e44f9a925c\") " pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:35.743139 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743115 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87wln\" (UniqueName: \"kubernetes.io/projected/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-kube-api-access-87wln\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.743482 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-run-ovn\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.743482 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743257 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-host\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.743482 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743289 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zz6f\" (UniqueName: \"kubernetes.io/projected/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-kube-api-access-2zz6f\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.743482 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743327 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-system-cni-dir\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.743482 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743357 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-run-ovn-kubernetes\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.743482 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743405 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-system-cni-dir\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.743482 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743447 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d13fa689-39c1-4a87-8506-5a75fcf8ad40-ovnkube-script-lib\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.743482 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743472 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-run\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.743838 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743510 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-tuned\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.743838 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743557 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-run-k8s-cni-cncf-io\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.743838 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743576 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8a74036c-9a66-4f91-95a1-0ea1881ad2e2-konnectivity-ca\") pod \"konnectivity-agent-t5rg9\" (UID: \"8a74036c-9a66-4f91-95a1-0ea1881ad2e2\") " pod="kube-system/konnectivity-agent-t5rg9" Jun 12 21:43:35.743838 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743591 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-cni-bin\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.743838 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-sys\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.743838 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743647 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54b820c6-53e5-455b-8211-32e44f9a925c-kubelet-config\") pod \"global-pull-secret-syncer-pn5xz\" (UID: \"54b820c6-53e5-455b-8211-32e44f9a925c\") " pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:35.743838 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743685 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-run-netns\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.743838 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743710 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-node-log\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.743838 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743748 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-etc-selinux\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.743838 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743783 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.743838 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743808 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.744405 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.743868 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-etc-selinux\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.744405 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744078 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-system-cni-dir\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.744405 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744111 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-run-netns\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.744405 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744136 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.744405 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744161 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-kubelet\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.744405 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744225 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-socket-dir\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.744405 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744251 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.744405 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744357 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-socket-dir\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.744810 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744409 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.744810 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744427 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-multus-conf-dir\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.744810 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744431 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.744810 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d8f7ac87-c842-4d2f-9307-1d3b28983356-iptables-alerter-script\") pod \"iptables-alerter-jwz9l\" (UID: \"d8f7ac87-c842-4d2f-9307-1d3b28983356\") " pod="openshift-network-operator/iptables-alerter-jwz9l" Jun 12 21:43:35.744810 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744479 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d13fa689-39c1-4a87-8506-5a75fcf8ad40-ovnkube-config\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.744810 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744529 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrbpp\" (UniqueName: \"kubernetes.io/projected/d13fa689-39c1-4a87-8506-5a75fcf8ad40-kube-api-access-wrbpp\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.744810 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744553 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-tmp\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.744810 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744586 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a539c62-3abf-4aa8-af59-c5193cd47800-host\") pod \"node-ca-jjhkm\" (UID: \"9a539c62-3abf-4aa8-af59-c5193cd47800\") " pod="openshift-image-registry/node-ca-jjhkm" Jun 12 21:43:35.744810 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744626 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a539c62-3abf-4aa8-af59-c5193cd47800-host\") pod \"node-ca-jjhkm\" (UID: \"9a539c62-3abf-4aa8-af59-c5193cd47800\") " pod="openshift-image-registry/node-ca-jjhkm" Jun 12 21:43:35.744810 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744658 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-device-dir\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.744810 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744741 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-os-release\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.744810 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744766 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-cni-binary-copy\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.744810 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744791 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-cnibin\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.744810 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744800 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.744810 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744814 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-var-lib-cni-bin\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.745487 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-var-lib-kubelet\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.745487 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744874 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-multus-daemon-config\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.745487 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744889 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-os-release\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.745487 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744931 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-slash\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.745487 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.744985 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-var-lib-openvswitch\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.745487 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745010 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-cni-netd\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.745487 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745037 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cd3425f-322c-481d-bcdc-cbc7a9676764-tmp-dir\") pod \"node-resolver-n2rwp\" (UID: \"3cd3425f-322c-481d-bcdc-cbc7a9676764\") " pod="openshift-dns/node-resolver-n2rwp" Jun 12 21:43:35.745487 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745068 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hh5k\" (UniqueName: \"kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k\") pod \"network-check-target-5n2vz\" (UID: \"3e0ffb25-9794-4397-9dee-7b6f4cd32e3b\") " pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:35.745487 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745094 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-run-openvswitch\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.745487 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745195 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-device-dir\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.745487 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d13fa689-39c1-4a87-8506-5a75fcf8ad40-ovn-node-metrics-cert\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.745487 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745320 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-cni-binary-copy\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.745487 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745312 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmpk7\" (UniqueName: \"kubernetes.io/projected/a8029f62-78fe-46b2-8587-0c150c839d9c-kube-api-access-tmpk7\") pod \"network-metrics-daemon-kcq4r\" (UID: \"a8029f62-78fe-46b2-8587-0c150c839d9c\") " pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:35.745487 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745421 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-cnibin\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.745487 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745471 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-cnibin\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.746222 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-multus-socket-dir-parent\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.746222 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745536 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjf7h\" (UniqueName: \"kubernetes.io/projected/3cd3425f-322c-481d-bcdc-cbc7a9676764-kube-api-access-bjf7h\") pod \"node-resolver-n2rwp\" (UID: \"3cd3425f-322c-481d-bcdc-cbc7a9676764\") " pod="openshift-dns/node-resolver-n2rwp" Jun 12 21:43:35.746222 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745572 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-multus-cni-dir\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.746222 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745596 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-sysctl-conf\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.746222 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745617 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-systemd\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.746222 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745679 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9a539c62-3abf-4aa8-af59-c5193cd47800-serviceca\") pod \"node-ca-jjhkm\" (UID: \"9a539c62-3abf-4aa8-af59-c5193cd47800\") " pod="openshift-image-registry/node-ca-jjhkm" Jun 12 21:43:35.746222 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745711 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4cb8\" (UniqueName: \"kubernetes.io/projected/2f45d449-7cd4-4b25-8972-69758824c534-kube-api-access-j4cb8\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.746222 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745737 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-modprobe-d\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.746222 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745760 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret\") pod \"global-pull-secret-syncer-pn5xz\" (UID: \"54b820c6-53e5-455b-8211-32e44f9a925c\") " pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:35.746222 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745785 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-log-socket\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.746222 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745818 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.746222 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745863 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-run-multus-certs\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.746222 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745886 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwmbl\" (UniqueName: \"kubernetes.io/projected/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-kube-api-access-nwmbl\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.746222 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745920 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8a74036c-9a66-4f91-95a1-0ea1881ad2e2-agent-certs\") pod \"konnectivity-agent-t5rg9\" (UID: \"8a74036c-9a66-4f91-95a1-0ea1881ad2e2\") " pod="kube-system/konnectivity-agent-t5rg9" Jun 12 21:43:35.746222 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745943 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6pkx\" (UniqueName: \"kubernetes.io/projected/d8f7ac87-c842-4d2f-9307-1d3b28983356-kube-api-access-z6pkx\") pod \"iptables-alerter-jwz9l\" (UID: \"d8f7ac87-c842-4d2f-9307-1d3b28983356\") " pod="openshift-network-operator/iptables-alerter-jwz9l" Jun 12 21:43:35.746222 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.745969 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-sysctl-d\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.746790 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.746008 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-lib-modules\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.746790 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.746030 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-etc-kubernetes\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.746790 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.746100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d13fa689-39c1-4a87-8506-5a75fcf8ad40-env-overrides\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.746790 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.746106 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9a539c62-3abf-4aa8-af59-c5193cd47800-serviceca\") pod \"node-ca-jjhkm\" (UID: \"9a539c62-3abf-4aa8-af59-c5193cd47800\") " pod="openshift-image-registry/node-ca-jjhkm" Jun 12 21:43:35.746790 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.746035 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f45d449-7cd4-4b25-8972-69758824c534-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.746790 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.746124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-sysconfig\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.746790 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.746174 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-var-lib-kubelet\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.748801 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.748772 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 21:43:35.752135 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.752117 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx924\" (UniqueName: \"kubernetes.io/projected/9a539c62-3abf-4aa8-af59-c5193cd47800-kube-api-access-bx924\") pod \"node-ca-jjhkm\" (UID: \"9a539c62-3abf-4aa8-af59-c5193cd47800\") " pod="openshift-image-registry/node-ca-jjhkm" Jun 12 21:43:35.754593 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:35.754574 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:43:35.754593 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:35.754594 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:43:35.754765 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:35.754603 2563 projected.go:196] Error preparing data for projected volume kube-api-access-2hh5k for pod openshift-network-diagnostics/network-check-target-5n2vz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:43:35.754765 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:35.754690 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k podName:3e0ffb25-9794-4397-9dee-7b6f4cd32e3b nodeName:}" failed. No retries permitted until 2026-06-12 21:43:36.254638971 +0000 UTC m=+2.978922217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2hh5k" (UniqueName: "kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k") pod "network-check-target-5n2vz" (UID: "3e0ffb25-9794-4397-9dee-7b6f4cd32e3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:43:35.756415 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.756397 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87wln\" (UniqueName: \"kubernetes.io/projected/7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d-kube-api-access-87wln\") pod \"multus-additional-cni-plugins-qd7gq\" (UID: \"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d\") " pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.757190 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.757172 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4cb8\" (UniqueName: \"kubernetes.io/projected/2f45d449-7cd4-4b25-8972-69758824c534-kube-api-access-j4cb8\") pod \"aws-ebs-csi-driver-node-tn6kc\" (UID: \"2f45d449-7cd4-4b25-8972-69758824c534\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.847026 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.846950 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-run-openvswitch\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.847026 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.846979 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d13fa689-39c1-4a87-8506-5a75fcf8ad40-ovn-node-metrics-cert\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.847026 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.846995 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmpk7\" (UniqueName: \"kubernetes.io/projected/a8029f62-78fe-46b2-8587-0c150c839d9c-kube-api-access-tmpk7\") pod \"network-metrics-daemon-kcq4r\" (UID: \"a8029f62-78fe-46b2-8587-0c150c839d9c\") " pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:35.847026 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847015 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-multus-socket-dir-parent\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.847323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjf7h\" (UniqueName: \"kubernetes.io/projected/3cd3425f-322c-481d-bcdc-cbc7a9676764-kube-api-access-bjf7h\") pod \"node-resolver-n2rwp\" (UID: \"3cd3425f-322c-481d-bcdc-cbc7a9676764\") " pod="openshift-dns/node-resolver-n2rwp" Jun 12 21:43:35.847323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847065 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-multus-cni-dir\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.847323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847086 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-sysctl-conf\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.847323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847106 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-systemd\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.847323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847131 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-modprobe-d\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.847323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847154 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret\") pod \"global-pull-secret-syncer-pn5xz\" (UID: \"54b820c6-53e5-455b-8211-32e44f9a925c\") " pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:35.847323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847155 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-run-openvswitch\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.847323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847177 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-log-socket\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.847323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847201 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-run-multus-certs\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.847323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847221 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-multus-socket-dir-parent\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.847323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847225 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwmbl\" (UniqueName: \"kubernetes.io/projected/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-kube-api-access-nwmbl\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.847323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847256 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8a74036c-9a66-4f91-95a1-0ea1881ad2e2-agent-certs\") pod \"konnectivity-agent-t5rg9\" (UID: \"8a74036c-9a66-4f91-95a1-0ea1881ad2e2\") " pod="kube-system/konnectivity-agent-t5rg9" Jun 12 21:43:35.847323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6pkx\" (UniqueName: \"kubernetes.io/projected/d8f7ac87-c842-4d2f-9307-1d3b28983356-kube-api-access-z6pkx\") pod \"iptables-alerter-jwz9l\" (UID: \"d8f7ac87-c842-4d2f-9307-1d3b28983356\") " pod="openshift-network-operator/iptables-alerter-jwz9l" Jun 12 21:43:35.847323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847316 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-sysctl-d\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847340 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-lib-modules\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847375 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-etc-kubernetes\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847390 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-systemd\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847400 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d13fa689-39c1-4a87-8506-5a75fcf8ad40-env-overrides\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847346 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-sysctl-conf\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847424 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-log-socket\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847441 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-run-multus-certs\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847493 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-multus-cni-dir\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847394 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-modprobe-d\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847520 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-lib-modules\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847540 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-sysctl-d\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847562 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-sysconfig\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847590 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-sysconfig\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847593 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-etc-kubernetes\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847605 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-var-lib-kubelet\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:35.847567 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847649 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-var-lib-kubelet\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847699 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3cd3425f-322c-481d-bcdc-cbc7a9676764-hosts-file\") pod \"node-resolver-n2rwp\" (UID: \"3cd3425f-322c-481d-bcdc-cbc7a9676764\") " pod="openshift-dns/node-resolver-n2rwp" Jun 12 21:43:35.847998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-os-release\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.848901 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:35.847757 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret podName:54b820c6-53e5-455b-8211-32e44f9a925c nodeName:}" failed. No retries permitted until 2026-06-12 21:43:36.347738266 +0000 UTC m=+3.072021513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret") pod "global-pull-secret-syncer-pn5xz" (UID: "54b820c6-53e5-455b-8211-32e44f9a925c") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:43:35.848901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847781 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-os-release\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.848901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847775 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-cni-binary-copy\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.848901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847815 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-var-lib-cni-multus\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.848901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847825 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3cd3425f-322c-481d-bcdc-cbc7a9676764-hosts-file\") pod \"node-resolver-n2rwp\" (UID: \"3cd3425f-322c-481d-bcdc-cbc7a9676764\") " pod="openshift-dns/node-resolver-n2rwp" Jun 12 21:43:35.848901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847838 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8f7ac87-c842-4d2f-9307-1d3b28983356-host-slash\") pod \"iptables-alerter-jwz9l\" (UID: \"d8f7ac87-c842-4d2f-9307-1d3b28983356\") " pod="openshift-network-operator/iptables-alerter-jwz9l" Jun 12 21:43:35.848901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847862 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-run-systemd\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.848901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847883 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-var-lib-cni-multus\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.848901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847902 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-kubernetes\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.848901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847905 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8f7ac87-c842-4d2f-9307-1d3b28983356-host-slash\") pod \"iptables-alerter-jwz9l\" (UID: \"d8f7ac87-c842-4d2f-9307-1d3b28983356\") " pod="openshift-network-operator/iptables-alerter-jwz9l" Jun 12 21:43:35.848901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847949 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-run-systemd\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.848901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847957 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs\") pod \"network-metrics-daemon-kcq4r\" (UID: \"a8029f62-78fe-46b2-8587-0c150c839d9c\") " pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:35.848901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848011 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-hostroot\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.848901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.847949 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-kubernetes\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.848901 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:35.848024 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:43:35.848901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848042 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-systemd-units\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.848901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848057 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-hostroot\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.849709 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848064 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-etc-openvswitch\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.849709 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848091 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54b820c6-53e5-455b-8211-32e44f9a925c-dbus\") pod \"global-pull-secret-syncer-pn5xz\" (UID: \"54b820c6-53e5-455b-8211-32e44f9a925c\") " pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:35.849709 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848096 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-systemd-units\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.849709 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:35.848110 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs podName:a8029f62-78fe-46b2-8587-0c150c839d9c nodeName:}" failed. No retries permitted until 2026-06-12 21:43:36.348094414 +0000 UTC m=+3.072377659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs") pod "network-metrics-daemon-kcq4r" (UID: "a8029f62-78fe-46b2-8587-0c150c839d9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:43:35.849709 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848113 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d13fa689-39c1-4a87-8506-5a75fcf8ad40-env-overrides\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.849709 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848135 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-etc-openvswitch\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.849709 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848138 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54b820c6-53e5-455b-8211-32e44f9a925c-dbus\") pod \"global-pull-secret-syncer-pn5xz\" (UID: \"54b820c6-53e5-455b-8211-32e44f9a925c\") " pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:35.849709 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848148 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-run-ovn\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.849709 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848172 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-host\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.849709 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848195 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zz6f\" (UniqueName: \"kubernetes.io/projected/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-kube-api-access-2zz6f\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.849709 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848197 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-run-ovn\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.849709 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848237 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-run-ovn-kubernetes\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.849709 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848245 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-host\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.849709 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848258 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d13fa689-39c1-4a87-8506-5a75fcf8ad40-ovnkube-script-lib\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.849709 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848273 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-run\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.849709 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-tuned\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.849709 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848303 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-run-k8s-cni-cncf-io\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.850514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848307 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-run-ovn-kubernetes\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.850514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848320 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-cni-binary-copy\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.850514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8a74036c-9a66-4f91-95a1-0ea1881ad2e2-konnectivity-ca\") pod \"konnectivity-agent-t5rg9\" (UID: \"8a74036c-9a66-4f91-95a1-0ea1881ad2e2\") " pod="kube-system/konnectivity-agent-t5rg9" Jun 12 21:43:35.850514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848354 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-run\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.850514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848368 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-cni-bin\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.850514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848391 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-sys\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.850514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848415 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54b820c6-53e5-455b-8211-32e44f9a925c-kubelet-config\") pod \"global-pull-secret-syncer-pn5xz\" (UID: \"54b820c6-53e5-455b-8211-32e44f9a925c\") " pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:35.850514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848438 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-run-netns\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.850514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-node-log\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.850514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848474 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-cni-bin\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.850514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848488 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-system-cni-dir\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.850514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848525 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-run-netns\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.850514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848553 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.850514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848585 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-kubelet\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.850514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848610 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-multus-conf-dir\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.850514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848634 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d8f7ac87-c842-4d2f-9307-1d3b28983356-iptables-alerter-script\") pod \"iptables-alerter-jwz9l\" (UID: \"d8f7ac87-c842-4d2f-9307-1d3b28983356\") " pod="openshift-network-operator/iptables-alerter-jwz9l" Jun 12 21:43:35.850514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848657 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d13fa689-39c1-4a87-8506-5a75fcf8ad40-ovnkube-config\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848703 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrbpp\" (UniqueName: \"kubernetes.io/projected/d13fa689-39c1-4a87-8506-5a75fcf8ad40-kube-api-access-wrbpp\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848729 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8a74036c-9a66-4f91-95a1-0ea1881ad2e2-konnectivity-ca\") pod \"konnectivity-agent-t5rg9\" (UID: \"8a74036c-9a66-4f91-95a1-0ea1881ad2e2\") " pod="kube-system/konnectivity-agent-t5rg9" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848779 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-sys\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848796 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848849 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-kubelet\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848861 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d13fa689-39c1-4a87-8506-5a75fcf8ad40-ovnkube-script-lib\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848883 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-node-log\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848888 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-run-netns\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848851 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54b820c6-53e5-455b-8211-32e44f9a925c-kubelet-config\") pod \"global-pull-secret-syncer-pn5xz\" (UID: \"54b820c6-53e5-455b-8211-32e44f9a925c\") " pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848931 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-run-netns\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848943 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-run-k8s-cni-cncf-io\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848927 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-multus-conf-dir\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848729 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-tmp\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848976 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-system-cni-dir\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.848986 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-cnibin\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.849011 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-var-lib-cni-bin\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.849036 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-var-lib-kubelet\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.851203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.849061 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-multus-daemon-config\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.849085 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-slash\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.849117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-var-lib-openvswitch\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.849141 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-cni-netd\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.849165 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cd3425f-322c-481d-bcdc-cbc7a9676764-tmp-dir\") pod \"node-resolver-n2rwp\" (UID: \"3cd3425f-322c-481d-bcdc-cbc7a9676764\") " pod="openshift-dns/node-resolver-n2rwp" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.849383 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d13fa689-39c1-4a87-8506-5a75fcf8ad40-ovnkube-config\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.849506 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cd3425f-322c-481d-bcdc-cbc7a9676764-tmp-dir\") pod \"node-resolver-n2rwp\" (UID: \"3cd3425f-322c-481d-bcdc-cbc7a9676764\") " pod="openshift-dns/node-resolver-n2rwp" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.849792 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d8f7ac87-c842-4d2f-9307-1d3b28983356-iptables-alerter-script\") pod \"iptables-alerter-jwz9l\" (UID: \"d8f7ac87-c842-4d2f-9307-1d3b28983356\") " pod="openshift-network-operator/iptables-alerter-jwz9l" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.849859 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-var-lib-openvswitch\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.849888 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-multus-daemon-config\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.849906 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-slash\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.849950 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-var-lib-cni-bin\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.849961 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-cnibin\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.849984 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d13fa689-39c1-4a87-8506-5a75fcf8ad40-ovn-node-metrics-cert\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.849993 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d13fa689-39c1-4a87-8506-5a75fcf8ad40-host-cni-netd\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.850002 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-host-var-lib-kubelet\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.850379 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8a74036c-9a66-4f91-95a1-0ea1881ad2e2-agent-certs\") pod \"konnectivity-agent-t5rg9\" (UID: \"8a74036c-9a66-4f91-95a1-0ea1881ad2e2\") " pod="kube-system/konnectivity-agent-t5rg9" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.850741 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-etc-tuned\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.851886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.850955 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-tmp\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.855517 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.855469 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6pkx\" (UniqueName: \"kubernetes.io/projected/d8f7ac87-c842-4d2f-9307-1d3b28983356-kube-api-access-z6pkx\") pod \"iptables-alerter-jwz9l\" (UID: \"d8f7ac87-c842-4d2f-9307-1d3b28983356\") " pod="openshift-network-operator/iptables-alerter-jwz9l" Jun 12 21:43:35.856163 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.856139 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmpk7\" (UniqueName: \"kubernetes.io/projected/a8029f62-78fe-46b2-8587-0c150c839d9c-kube-api-access-tmpk7\") pod \"network-metrics-daemon-kcq4r\" (UID: \"a8029f62-78fe-46b2-8587-0c150c839d9c\") " pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:35.856269 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.856193 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjf7h\" (UniqueName: \"kubernetes.io/projected/3cd3425f-322c-481d-bcdc-cbc7a9676764-kube-api-access-bjf7h\") pod \"node-resolver-n2rwp\" (UID: \"3cd3425f-322c-481d-bcdc-cbc7a9676764\") " pod="openshift-dns/node-resolver-n2rwp" Jun 12 21:43:35.856490 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.856464 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zz6f\" (UniqueName: \"kubernetes.io/projected/5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1-kube-api-access-2zz6f\") pod \"tuned-jk7bg\" (UID: \"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1\") " pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.856791 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.856771 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwmbl\" (UniqueName: \"kubernetes.io/projected/0cb4ffdb-cf64-454c-af86-776a73f8d4c5-kube-api-access-nwmbl\") pod \"multus-4b7w6\" (UID: \"0cb4ffdb-cf64-454c-af86-776a73f8d4c5\") " pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.856946 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.856931 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrbpp\" (UniqueName: \"kubernetes.io/projected/d13fa689-39c1-4a87-8506-5a75fcf8ad40-kube-api-access-wrbpp\") pod \"ovnkube-node-fnlbf\" (UID: \"d13fa689-39c1-4a87-8506-5a75fcf8ad40\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.939041 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.939008 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jjhkm" Jun 12 21:43:35.946503 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.946475 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" Jun 12 21:43:35.954925 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.954903 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qd7gq" Jun 12 21:43:35.963588 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.963569 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:43:35.970205 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.970186 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4b7w6" Jun 12 21:43:35.977791 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.977774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t5rg9" Jun 12 21:43:35.986342 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.986327 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" Jun 12 21:43:35.994886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:35.994861 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n2rwp" Jun 12 21:43:36.002395 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:36.002381 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jwz9l" Jun 12 21:43:36.352398 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:36.352368 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs\") pod \"network-metrics-daemon-kcq4r\" (UID: \"a8029f62-78fe-46b2-8587-0c150c839d9c\") " pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:36.352575 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:36.352435 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hh5k\" (UniqueName: \"kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k\") pod \"network-check-target-5n2vz\" (UID: \"3e0ffb25-9794-4397-9dee-7b6f4cd32e3b\") " pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:36.352575 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:36.352468 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret\") pod \"global-pull-secret-syncer-pn5xz\" (UID: \"54b820c6-53e5-455b-8211-32e44f9a925c\") " pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:36.352575 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:36.352554 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:43:36.352781 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:36.352596 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:43:36.352781 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:36.352605 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:43:36.352781 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:36.352622 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs podName:a8029f62-78fe-46b2-8587-0c150c839d9c nodeName:}" failed. No retries permitted until 2026-06-12 21:43:37.352600182 +0000 UTC m=+4.076883420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs") pod "network-metrics-daemon-kcq4r" (UID: "a8029f62-78fe-46b2-8587-0c150c839d9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:43:36.352781 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:36.352630 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:43:36.352781 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:36.352641 2563 projected.go:196] Error preparing data for projected volume kube-api-access-2hh5k for pod openshift-network-diagnostics/network-check-target-5n2vz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:43:36.352781 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:36.352649 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret podName:54b820c6-53e5-455b-8211-32e44f9a925c nodeName:}" failed. No retries permitted until 2026-06-12 21:43:37.352633806 +0000 UTC m=+4.076917035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret") pod "global-pull-secret-syncer-pn5xz" (UID: "54b820c6-53e5-455b-8211-32e44f9a925c") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:43:36.352781 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:36.352692 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k podName:3e0ffb25-9794-4397-9dee-7b6f4cd32e3b nodeName:}" failed. No retries permitted until 2026-06-12 21:43:37.35267825 +0000 UTC m=+4.076961478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2hh5k" (UniqueName: "kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k") pod "network-check-target-5n2vz" (UID: "3e0ffb25-9794-4397-9dee-7b6f4cd32e3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:43:36.671899 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:36.671869 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 21:38:35 +0000 UTC" deadline="2028-03-05 16:42:43.43237626 +0000 UTC" Jun 12 21:43:36.671899 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:36.671895 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15162h59m6.760484564s" Jun 12 21:43:36.690093 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:36.690069 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:36.690231 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:36.690189 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:43:36.783195 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:36.783167 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cd3425f_322c_481d_bcdc_cbc7a9676764.slice/crio-73410e821b499352003ff7561e4b9e47a9da40e2eb0c1ee318309cedac25404c WatchSource:0}: Error finding container 73410e821b499352003ff7561e4b9e47a9da40e2eb0c1ee318309cedac25404c: Status 404 returned error can't find the container with id 73410e821b499352003ff7561e4b9e47a9da40e2eb0c1ee318309cedac25404c Jun 12 21:43:36.784556 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:36.784532 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a74036c_9a66_4f91_95a1_0ea1881ad2e2.slice/crio-17d4a463a712c0a28043d798f2f05c508f4115638466348c17c928f42538b9cf WatchSource:0}: Error finding container 17d4a463a712c0a28043d798f2f05c508f4115638466348c17c928f42538b9cf: Status 404 returned error can't find the container with id 17d4a463a712c0a28043d798f2f05c508f4115638466348c17c928f42538b9cf Jun 12 21:43:36.786151 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:36.786070 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4a7f67_5716_491d_a76a_e2f8ec4c5dd1.slice/crio-14781d70a5e2d9fcd13c61cfe7fc35f5d725060f04f545a99ef7d67744e7a2f1 WatchSource:0}: Error finding container 14781d70a5e2d9fcd13c61cfe7fc35f5d725060f04f545a99ef7d67744e7a2f1: Status 404 returned error can't find the container with id 14781d70a5e2d9fcd13c61cfe7fc35f5d725060f04f545a99ef7d67744e7a2f1 Jun 12 21:43:36.786933 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:36.786911 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f45d449_7cd4_4b25_8972_69758824c534.slice/crio-e95c9e2632cbe521d60187f7ae7098670258d4e5142fc30eb59390a2d1187520 WatchSource:0}: Error finding container e95c9e2632cbe521d60187f7ae7098670258d4e5142fc30eb59390a2d1187520: Status 404 returned error can't find the container with id e95c9e2632cbe521d60187f7ae7098670258d4e5142fc30eb59390a2d1187520 Jun 12 21:43:36.789746 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:36.789724 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd13fa689_39c1_4a87_8506_5a75fcf8ad40.slice/crio-fde2934ad3ca0f2002e95a63d2437d499047ada6ed06efd8ea25f68ea682859e WatchSource:0}: Error finding container fde2934ad3ca0f2002e95a63d2437d499047ada6ed06efd8ea25f68ea682859e: Status 404 returned error can't find the container with id fde2934ad3ca0f2002e95a63d2437d499047ada6ed06efd8ea25f68ea682859e Jun 12 21:43:36.791837 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:36.791801 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb4ffdb_cf64_454c_af86_776a73f8d4c5.slice/crio-84dd2584515a8a36fc9838cdc513530871f94a1df2c758a389a5053e514c35a0 WatchSource:0}: Error finding container 84dd2584515a8a36fc9838cdc513530871f94a1df2c758a389a5053e514c35a0: Status 404 returned error can't find the container with id 84dd2584515a8a36fc9838cdc513530871f94a1df2c758a389a5053e514c35a0 Jun 12 21:43:36.792247 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:36.792224 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd3ee46_fbcf_48c9_9159_4ee1fe57a78d.slice/crio-c6d3ff2aafed672012e42c7ebb832d81e67c8224330ef100bc2e5b861ed12251 WatchSource:0}: Error finding container c6d3ff2aafed672012e42c7ebb832d81e67c8224330ef100bc2e5b861ed12251: Status 404 returned error can't find the container with id c6d3ff2aafed672012e42c7ebb832d81e67c8224330ef100bc2e5b861ed12251 Jun 12 21:43:36.792828 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:36.792804 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8f7ac87_c842_4d2f_9307_1d3b28983356.slice/crio-ef5f2cc18795fab27f99c6205e3b5c249e98c6e4b68374451724fa071c5f0246 WatchSource:0}: Error finding container ef5f2cc18795fab27f99c6205e3b5c249e98c6e4b68374451724fa071c5f0246: Status 404 returned error can't find the container with id ef5f2cc18795fab27f99c6205e3b5c249e98c6e4b68374451724fa071c5f0246 Jun 12 21:43:36.812943 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:43:36.812919 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a539c62_3abf_4aa8_af59_c5193cd47800.slice/crio-b4d7a121d71c75333748ea648649cb7f39a61a4ecc273e190a4020dd138eb699 WatchSource:0}: Error finding container b4d7a121d71c75333748ea648649cb7f39a61a4ecc273e190a4020dd138eb699: Status 404 returned error can't find the container with id b4d7a121d71c75333748ea648649cb7f39a61a4ecc273e190a4020dd138eb699 Jun 12 21:43:37.360918 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.360839 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs\") pod \"network-metrics-daemon-kcq4r\" (UID: \"a8029f62-78fe-46b2-8587-0c150c839d9c\") " pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:37.361051 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.360928 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hh5k\" (UniqueName: \"kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k\") pod \"network-check-target-5n2vz\" (UID: \"3e0ffb25-9794-4397-9dee-7b6f4cd32e3b\") " pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:37.361051 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.360968 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret\") pod \"global-pull-secret-syncer-pn5xz\" (UID: \"54b820c6-53e5-455b-8211-32e44f9a925c\") " pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:37.361133 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:37.361051 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:43:37.361133 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:37.361115 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:43:37.361133 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:37.361129 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:43:37.361262 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:37.361140 2563 projected.go:196] Error preparing data for projected volume kube-api-access-2hh5k for pod openshift-network-diagnostics/network-check-target-5n2vz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:43:37.361262 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:37.361117 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs podName:a8029f62-78fe-46b2-8587-0c150c839d9c nodeName:}" failed. No retries permitted until 2026-06-12 21:43:39.361099666 +0000 UTC m=+6.085382913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs") pod "network-metrics-daemon-kcq4r" (UID: "a8029f62-78fe-46b2-8587-0c150c839d9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:43:37.361262 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:37.361183 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k podName:3e0ffb25-9794-4397-9dee-7b6f4cd32e3b nodeName:}" failed. No retries permitted until 2026-06-12 21:43:39.361172916 +0000 UTC m=+6.085456145 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2hh5k" (UniqueName: "kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k") pod "network-check-target-5n2vz" (UID: "3e0ffb25-9794-4397-9dee-7b6f4cd32e3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:43:37.361262 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:37.361052 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:43:37.361262 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:37.361215 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret podName:54b820c6-53e5-455b-8211-32e44f9a925c nodeName:}" failed. No retries permitted until 2026-06-12 21:43:39.361207172 +0000 UTC m=+6.085490400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret") pod "global-pull-secret-syncer-pn5xz" (UID: "54b820c6-53e5-455b-8211-32e44f9a925c") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:43:37.672419 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.672286 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 21:38:35 +0000 UTC" deadline="2028-01-14 22:38:45.40402507 +0000 UTC" Jun 12 21:43:37.672419 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.672345 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13944h55m7.731684345s" Jun 12 21:43:37.692683 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.691388 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:37.692683 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:37.691507 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:43:37.692683 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.691979 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:37.692683 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:37.692084 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:43:37.712767 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.712682 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jjhkm" event={"ID":"9a539c62-3abf-4aa8-af59-c5193cd47800","Type":"ContainerStarted","Data":"b4d7a121d71c75333748ea648649cb7f39a61a4ecc273e190a4020dd138eb699"} Jun 12 21:43:37.718913 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.718835 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qd7gq" event={"ID":"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d","Type":"ContainerStarted","Data":"c6d3ff2aafed672012e42c7ebb832d81e67c8224330ef100bc2e5b861ed12251"} Jun 12 21:43:37.730851 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.730787 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4b7w6" event={"ID":"0cb4ffdb-cf64-454c-af86-776a73f8d4c5","Type":"ContainerStarted","Data":"84dd2584515a8a36fc9838cdc513530871f94a1df2c758a389a5053e514c35a0"} Jun 12 21:43:37.733455 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.733431 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" event={"ID":"d13fa689-39c1-4a87-8506-5a75fcf8ad40","Type":"ContainerStarted","Data":"fde2934ad3ca0f2002e95a63d2437d499047ada6ed06efd8ea25f68ea682859e"} Jun 12 21:43:37.750699 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.750659 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" event={"ID":"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1","Type":"ContainerStarted","Data":"14781d70a5e2d9fcd13c61cfe7fc35f5d725060f04f545a99ef7d67744e7a2f1"} Jun 12 21:43:37.755342 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.755318 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t5rg9" event={"ID":"8a74036c-9a66-4f91-95a1-0ea1881ad2e2","Type":"ContainerStarted","Data":"17d4a463a712c0a28043d798f2f05c508f4115638466348c17c928f42538b9cf"} Jun 12 21:43:37.762610 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.762587 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n2rwp" event={"ID":"3cd3425f-322c-481d-bcdc-cbc7a9676764","Type":"ContainerStarted","Data":"73410e821b499352003ff7561e4b9e47a9da40e2eb0c1ee318309cedac25404c"} Jun 12 21:43:37.774588 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.774562 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-93.ec2.internal" event={"ID":"66a2fc8e948c8d5135e0ca9ee3460e65","Type":"ContainerStarted","Data":"d179c34aa10d5ce63988115e84e67bfbc031903fde7f54d9e7e0a38956e579b6"} Jun 12 21:43:37.777525 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.777501 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jwz9l" event={"ID":"d8f7ac87-c842-4d2f-9307-1d3b28983356","Type":"ContainerStarted","Data":"ef5f2cc18795fab27f99c6205e3b5c249e98c6e4b68374451724fa071c5f0246"} Jun 12 21:43:37.790093 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.790001 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" event={"ID":"2f45d449-7cd4-4b25-8972-69758824c534","Type":"ContainerStarted","Data":"e95c9e2632cbe521d60187f7ae7098670258d4e5142fc30eb59390a2d1187520"} Jun 12 21:43:37.791001 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.790957 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-93.ec2.internal" podStartSLOduration=2.790941447 podStartE2EDuration="2.790941447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:43:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:43:37.790072259 +0000 UTC m=+4.514355511" watchObservedRunningTime="2026-06-12 21:43:37.790941447 +0000 UTC m=+4.515224699" Jun 12 21:43:37.797883 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.797138 2563 generic.go:356] "Generic (PLEG): container finished" podID="6437f43ae319d7be8f4dd44aaefc0491" containerID="e418a03cf88387ca5590217ed7ea61e88494aa2c0febd4029004560be8770391" exitCode=0 Jun 12 21:43:37.797883 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:37.797171 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal" event={"ID":"6437f43ae319d7be8f4dd44aaefc0491","Type":"ContainerDied","Data":"e418a03cf88387ca5590217ed7ea61e88494aa2c0febd4029004560be8770391"} Jun 12 21:43:38.690087 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:38.690057 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:38.690529 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:38.690180 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:43:38.813028 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:38.812991 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal" event={"ID":"6437f43ae319d7be8f4dd44aaefc0491","Type":"ContainerStarted","Data":"9c1258ca5b4d033e455a3e2f0a4f573fe3f2af9efa04171a753d6ec4e1bfc3c8"} Jun 12 21:43:39.378135 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:39.378094 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret\") pod \"global-pull-secret-syncer-pn5xz\" (UID: \"54b820c6-53e5-455b-8211-32e44f9a925c\") " pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:39.378323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:39.378159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs\") pod \"network-metrics-daemon-kcq4r\" (UID: \"a8029f62-78fe-46b2-8587-0c150c839d9c\") " pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:39.378323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:39.378224 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hh5k\" (UniqueName: \"kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k\") pod \"network-check-target-5n2vz\" (UID: \"3e0ffb25-9794-4397-9dee-7b6f4cd32e3b\") " pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:39.378439 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:39.378363 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:43:39.378439 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:39.378385 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:43:39.378439 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:39.378398 2563 projected.go:196] Error preparing data for projected volume kube-api-access-2hh5k for pod openshift-network-diagnostics/network-check-target-5n2vz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:43:39.378584 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:39.378454 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k podName:3e0ffb25-9794-4397-9dee-7b6f4cd32e3b nodeName:}" failed. No retries permitted until 2026-06-12 21:43:43.378437336 +0000 UTC m=+10.102720587 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2hh5k" (UniqueName: "kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k") pod "network-check-target-5n2vz" (UID: "3e0ffb25-9794-4397-9dee-7b6f4cd32e3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:43:39.379002 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:39.378983 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:43:39.379094 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:39.379036 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret podName:54b820c6-53e5-455b-8211-32e44f9a925c nodeName:}" failed. No retries permitted until 2026-06-12 21:43:43.379022081 +0000 UTC m=+10.103305314 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret") pod "global-pull-secret-syncer-pn5xz" (UID: "54b820c6-53e5-455b-8211-32e44f9a925c") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:43:39.379155 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:39.379095 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:43:39.379155 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:39.379128 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs podName:a8029f62-78fe-46b2-8587-0c150c839d9c nodeName:}" failed. No retries permitted until 2026-06-12 21:43:43.379116179 +0000 UTC m=+10.103399415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs") pod "network-metrics-daemon-kcq4r" (UID: "a8029f62-78fe-46b2-8587-0c150c839d9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:43:39.692997 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:39.692293 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:39.692997 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:39.692409 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:43:39.692997 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:39.692795 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:39.692997 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:39.692900 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:43:40.690425 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:40.689946 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:40.690425 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:40.690092 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:43:41.692184 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:41.692084 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:41.692644 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:41.692245 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:43:41.692644 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:41.692329 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:41.692644 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:41.692421 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:43:42.690589 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:42.690561 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:42.690771 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:42.690687 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:43:43.413851 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:43.413808 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hh5k\" (UniqueName: \"kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k\") pod \"network-check-target-5n2vz\" (UID: \"3e0ffb25-9794-4397-9dee-7b6f4cd32e3b\") " pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:43.414241 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:43.413871 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret\") pod \"global-pull-secret-syncer-pn5xz\" (UID: \"54b820c6-53e5-455b-8211-32e44f9a925c\") " pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:43.414241 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:43.413911 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs\") pod \"network-metrics-daemon-kcq4r\" (UID: \"a8029f62-78fe-46b2-8587-0c150c839d9c\") " pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:43.414241 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:43.413987 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:43:43.414241 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:43.414012 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:43:43.414241 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:43.414025 2563 projected.go:196] Error preparing data for projected volume kube-api-access-2hh5k for pod openshift-network-diagnostics/network-check-target-5n2vz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:43:43.414241 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:43.414034 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:43:43.414241 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:43.414083 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k podName:3e0ffb25-9794-4397-9dee-7b6f4cd32e3b nodeName:}" failed. No retries permitted until 2026-06-12 21:43:51.414065123 +0000 UTC m=+18.138348354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2hh5k" (UniqueName: "kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k") pod "network-check-target-5n2vz" (UID: "3e0ffb25-9794-4397-9dee-7b6f4cd32e3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:43:43.414241 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:43.414104 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs podName:a8029f62-78fe-46b2-8587-0c150c839d9c nodeName:}" failed. No retries permitted until 2026-06-12 21:43:51.41409313 +0000 UTC m=+18.138376363 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs") pod "network-metrics-daemon-kcq4r" (UID: "a8029f62-78fe-46b2-8587-0c150c839d9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:43:43.414241 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:43.414113 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:43:43.414241 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:43.414150 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret podName:54b820c6-53e5-455b-8211-32e44f9a925c nodeName:}" failed. No retries permitted until 2026-06-12 21:43:51.414136604 +0000 UTC m=+18.138419832 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret") pod "global-pull-secret-syncer-pn5xz" (UID: "54b820c6-53e5-455b-8211-32e44f9a925c") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:43:43.691863 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:43.691346 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:43.691863 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:43.691464 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:43:43.691863 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:43.691587 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:43.691863 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:43.691739 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:43:44.690025 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:44.689771 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:44.690455 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:44.690086 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:43:45.691319 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:45.690803 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:45.691319 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:45.690954 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:43:45.691319 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:45.691000 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:45.691319 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:45.691135 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:43:46.690084 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:46.690047 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:46.690276 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:46.690181 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:43:47.689948 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:47.689922 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:47.689948 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:47.689949 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:47.690402 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:47.690048 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:43:47.690402 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:47.690173 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:43:48.690540 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:48.690511 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:48.690938 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:48.690613 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:43:49.690341 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:49.690304 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:49.690502 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:49.690426 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:43:49.690502 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:49.690481 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:49.690912 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:49.690607 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:43:50.690629 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:50.690596 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:50.690985 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:50.690701 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:43:51.472594 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:51.472532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret\") pod \"global-pull-secret-syncer-pn5xz\" (UID: \"54b820c6-53e5-455b-8211-32e44f9a925c\") " pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:51.472864 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:51.472609 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs\") pod \"network-metrics-daemon-kcq4r\" (UID: \"a8029f62-78fe-46b2-8587-0c150c839d9c\") " pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:51.472864 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:51.472657 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hh5k\" (UniqueName: \"kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k\") pod \"network-check-target-5n2vz\" (UID: \"3e0ffb25-9794-4397-9dee-7b6f4cd32e3b\") " pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:51.472864 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:51.472771 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:43:51.472864 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:51.472790 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:43:51.472864 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:51.472808 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:43:51.472864 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:51.472819 2563 projected.go:196] Error preparing data for projected volume kube-api-access-2hh5k for pod openshift-network-diagnostics/network-check-target-5n2vz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:43:51.472864 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:51.472772 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:43:51.472864 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:51.472842 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs podName:a8029f62-78fe-46b2-8587-0c150c839d9c nodeName:}" failed. No retries permitted until 2026-06-12 21:44:07.472822113 +0000 UTC m=+34.197105342 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs") pod "network-metrics-daemon-kcq4r" (UID: "a8029f62-78fe-46b2-8587-0c150c839d9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:43:51.472864 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:51.472867 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k podName:3e0ffb25-9794-4397-9dee-7b6f4cd32e3b nodeName:}" failed. No retries permitted until 2026-06-12 21:44:07.472853782 +0000 UTC m=+34.197137009 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2hh5k" (UniqueName: "kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k") pod "network-check-target-5n2vz" (UID: "3e0ffb25-9794-4397-9dee-7b6f4cd32e3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:43:51.473312 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:51.472888 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret podName:54b820c6-53e5-455b-8211-32e44f9a925c nodeName:}" failed. No retries permitted until 2026-06-12 21:44:07.472878579 +0000 UTC m=+34.197162026 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret") pod "global-pull-secret-syncer-pn5xz" (UID: "54b820c6-53e5-455b-8211-32e44f9a925c") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:43:51.690132 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:51.690103 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:51.690132 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:51.690129 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:51.690363 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:51.690229 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:43:51.690363 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:51.690343 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:43:52.690500 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:52.690468 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:52.690916 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:52.690592 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:43:53.690755 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:53.690724 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:53.691204 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:53.690836 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:43:53.691204 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:53.690853 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:53.691204 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:53.690988 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:43:54.690563 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:54.690534 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:54.690774 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:54.690631 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:43:55.690351 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.690187 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:55.690493 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:55.690407 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:43:55.690748 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.690723 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:55.690865 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:55.690838 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:43:55.843055 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.843022 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" event={"ID":"2f45d449-7cd4-4b25-8972-69758824c534","Type":"ContainerStarted","Data":"f8a42894b2cb548a3bc9a68c21c39977535fa1d0b29a3ee4e374621a490fb1ec"} Jun 12 21:43:55.844498 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.844474 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jjhkm" event={"ID":"9a539c62-3abf-4aa8-af59-c5193cd47800","Type":"ContainerStarted","Data":"bd053d900780999ad9836d96860ef32b008933516aa3892bd84a653f6f5dae63"} Jun 12 21:43:55.846016 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.845994 2563 generic.go:356] "Generic (PLEG): container finished" podID="7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d" containerID="8651d90538b9f83fe66557a0f8e62ac165cdc42ea741fd511e5c37c9820bc9de" exitCode=0 Jun 12 21:43:55.846108 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.846064 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qd7gq" event={"ID":"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d","Type":"ContainerDied","Data":"8651d90538b9f83fe66557a0f8e62ac165cdc42ea741fd511e5c37c9820bc9de"} Jun 12 21:43:55.850999 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.850970 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4b7w6" event={"ID":"0cb4ffdb-cf64-454c-af86-776a73f8d4c5","Type":"ContainerStarted","Data":"37dc900cf4d948325c18b36f9cafafbc09a9be27d923235aa4a5042a5f47fa08"} Jun 12 21:43:55.854799 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.854771 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnlbf_d13fa689-39c1-4a87-8506-5a75fcf8ad40/ovn-acl-logging/0.log" Jun 12 21:43:55.855221 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.855193 2563 generic.go:356] "Generic (PLEG): container finished" podID="d13fa689-39c1-4a87-8506-5a75fcf8ad40" containerID="9002e2da7f07870f743be3a74ec1c199fd84728de7de39e8df2acc8ae1bd073d" exitCode=1 Jun 12 21:43:55.855295 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.855251 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" event={"ID":"d13fa689-39c1-4a87-8506-5a75fcf8ad40","Type":"ContainerDied","Data":"9002e2da7f07870f743be3a74ec1c199fd84728de7de39e8df2acc8ae1bd073d"} Jun 12 21:43:55.855345 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.855313 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" event={"ID":"d13fa689-39c1-4a87-8506-5a75fcf8ad40","Type":"ContainerStarted","Data":"adc3a42950ec9d7514b9719f0f911612864c406922582d83f24e60310c86f7f6"} Jun 12 21:43:55.856821 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.856795 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" event={"ID":"5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1","Type":"ContainerStarted","Data":"a44bf29b6c737a4cd2f5c1b6b7a66f4a16eeb8f515789db0511c1e05bfe6daa6"} Jun 12 21:43:55.857673 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.857624 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-93.ec2.internal" podStartSLOduration=20.85761326 podStartE2EDuration="20.85761326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:43:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:43:38.827237198 +0000 UTC m=+5.551520450" watchObservedRunningTime="2026-06-12 21:43:55.85761326 +0000 UTC m=+22.581896511" Jun 12 21:43:55.858006 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.857973 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jjhkm" podStartSLOduration=4.25946314 podStartE2EDuration="22.857965277s" totalImagesPullingTime="18.598502137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:43:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:43:55.857382903 +0000 UTC m=+22.581666153" watchObservedRunningTime="2026-06-12 21:43:55.857965277 +0000 UTC m=+22.582248529" Jun 12 21:43:55.858736 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.858466 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t5rg9" event={"ID":"8a74036c-9a66-4f91-95a1-0ea1881ad2e2","Type":"ContainerStarted","Data":"a250243b0673cfe9289e05739de6e7a1fcb73f656d0dde8e44e8d74218381ef9"} Jun 12 21:43:55.859968 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.859947 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n2rwp" event={"ID":"3cd3425f-322c-481d-bcdc-cbc7a9676764","Type":"ContainerStarted","Data":"618c5cc5b955147301a5ce57ee4dc4d258fcd5e2c038574e9df7733d90b64ec1"} Jun 12 21:43:55.872337 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.872304 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jk7bg" podStartSLOduration=3.223708462 podStartE2EDuration="21.872292585s" totalImagesPullingTime="18.648584123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:43:55.871778121 +0000 UTC m=+22.596061371" watchObservedRunningTime="2026-06-12 21:43:55.872292585 +0000 UTC m=+22.596575850" Jun 12 21:43:55.927351 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.927309 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4b7w6" podStartSLOduration=4.284212596 podStartE2EDuration="22.927295701s" totalImagesPullingTime="18.643083105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:43:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:43:55.92690889 +0000 UTC m=+22.651192141" watchObservedRunningTime="2026-06-12 21:43:55.927295701 +0000 UTC m=+22.651578950" Jun 12 21:43:55.944266 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.944229 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t5rg9" podStartSLOduration=8.005628146 podStartE2EDuration="21.94421629s" totalImagesPullingTime="13.938588144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:43:55.943903937 +0000 UTC m=+22.668187187" watchObservedRunningTime="2026-06-12 21:43:55.94421629 +0000 UTC m=+22.668499540" Jun 12 21:43:55.959721 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:55.959652 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n2rwp" podStartSLOduration=3.330805762 podStartE2EDuration="21.959639637s" totalImagesPullingTime="18.628833875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:43:55.95957429 +0000 UTC m=+22.683857540" watchObservedRunningTime="2026-06-12 21:43:55.959639637 +0000 UTC m=+22.683922887" Jun 12 21:43:56.690099 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:56.690057 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:56.690270 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:56.690177 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:43:56.864985 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:56.864955 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnlbf_d13fa689-39c1-4a87-8506-5a75fcf8ad40/ovn-acl-logging/0.log" Jun 12 21:43:56.865499 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:56.865462 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" event={"ID":"d13fa689-39c1-4a87-8506-5a75fcf8ad40","Type":"ContainerStarted","Data":"183ab9095843a9b438cb3a9d97cad3c420744a6ad263b5c05d81e64120ebbd3a"} Jun 12 21:43:56.865620 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:56.865558 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" event={"ID":"d13fa689-39c1-4a87-8506-5a75fcf8ad40","Type":"ContainerStarted","Data":"3e53a9447961f129f33f599eac1dd27b2cf17553376fed66f18884d4626ba33b"} Jun 12 21:43:56.865620 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:56.865608 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" event={"ID":"d13fa689-39c1-4a87-8506-5a75fcf8ad40","Type":"ContainerStarted","Data":"26c1043506b13285675b57f540532c28d81e934b2157e911b6677e93e232c3d3"} Jun 12 21:43:56.865736 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:56.865656 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" event={"ID":"d13fa689-39c1-4a87-8506-5a75fcf8ad40","Type":"ContainerStarted","Data":"409051bab28214449394053d050b439f514483e54463dd389aa275ac2891f563"} Jun 12 21:43:57.088011 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:57.087989 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 21:43:57.690681 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:57.690639 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:57.690848 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:57.690776 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:43:57.690848 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:57.690838 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:57.691020 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:57.690982 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:43:57.705415 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:57.705342 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T21:43:57.088005914Z","UUID":"bc7a5a8d-1eb2-41fa-a0ce-108f202e0db4","Handler":null,"Name":"","Endpoint":""} Jun 12 21:43:57.706873 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:57.706847 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 21:43:57.706963 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:57.706893 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 21:43:57.869114 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:57.869055 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jwz9l" event={"ID":"d8f7ac87-c842-4d2f-9307-1d3b28983356","Type":"ContainerStarted","Data":"0e848abd63eccfea392a1492a9a0e5764f2b7b91d08bf39659c35f6bf1c72e99"} Jun 12 21:43:57.871085 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:57.871060 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" event={"ID":"2f45d449-7cd4-4b25-8972-69758824c534","Type":"ContainerStarted","Data":"76f1eb459708a59269250815349bedd04a84d719ba171cb73706884fa3be8967"} Jun 12 21:43:57.882168 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:57.882115 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jwz9l" podStartSLOduration=5.256591358 podStartE2EDuration="23.882097157s" totalImagesPullingTime="18.625505799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:43:57.881653946 +0000 UTC m=+24.605937192" watchObservedRunningTime="2026-06-12 21:43:57.882097157 +0000 UTC m=+24.606380408" Jun 12 21:43:58.690128 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:58.690060 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:43:58.690271 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:58.690154 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:43:58.876609 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:58.876585 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnlbf_d13fa689-39c1-4a87-8506-5a75fcf8ad40/ovn-acl-logging/0.log" Jun 12 21:43:58.877327 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:58.877093 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" event={"ID":"d13fa689-39c1-4a87-8506-5a75fcf8ad40","Type":"ContainerStarted","Data":"495f2f04a333d74d6e9d4fb9ad7c4ad741789c88197f37f4babab2be2ae8d254"} Jun 12 21:43:58.879714 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:58.879686 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" event={"ID":"2f45d449-7cd4-4b25-8972-69758824c534","Type":"ContainerStarted","Data":"6624636f8b1fd602f74bfff1d3a0ea584e50e501438fe272feccb50647c364c3"} Jun 12 21:43:58.898322 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:58.898273 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tn6kc" podStartSLOduration=5.253185611 podStartE2EDuration="25.898255401s" totalImagesPullingTime="20.64506979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:43:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:43:58.897407504 +0000 UTC m=+25.621690779" watchObservedRunningTime="2026-06-12 21:43:58.898255401 +0000 UTC m=+25.622538655" Jun 12 21:43:59.690379 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:59.690345 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:43:59.690535 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:43:59.690383 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:43:59.690535 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:59.690475 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:43:59.690642 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:43:59.690616 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:44:00.691258 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:00.690619 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:44:00.691258 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:00.690898 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:44:00.746816 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:00.746788 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t5rg9" Jun 12 21:44:00.747306 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:00.747290 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t5rg9" Jun 12 21:44:00.885418 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:00.885337 2563 generic.go:356] "Generic (PLEG): container finished" podID="7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d" containerID="bd7b6fb14cd931373502362206dfa9c7337bd0467f3746bcf9a9c7e1b184f590" exitCode=0 Jun 12 21:44:00.885514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:00.885430 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qd7gq" event={"ID":"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d","Type":"ContainerDied","Data":"bd7b6fb14cd931373502362206dfa9c7337bd0467f3746bcf9a9c7e1b184f590"} Jun 12 21:44:00.888796 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:00.888780 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnlbf_d13fa689-39c1-4a87-8506-5a75fcf8ad40/ovn-acl-logging/0.log" Jun 12 21:44:00.889210 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:00.889186 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" event={"ID":"d13fa689-39c1-4a87-8506-5a75fcf8ad40","Type":"ContainerStarted","Data":"b073ed8036b98129f67396292cdd9df4d536f497428644ecec511be634fa4741"} Jun 12 21:44:00.889518 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:00.889370 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t5rg9" Jun 12 21:44:00.889518 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:00.889416 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:44:00.889518 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:00.889468 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:44:00.889705 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:00.889557 2563 scope.go:117] "RemoveContainer" containerID="9002e2da7f07870f743be3a74ec1c199fd84728de7de39e8df2acc8ae1bd073d" Jun 12 21:44:00.889856 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:00.889834 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t5rg9" Jun 12 21:44:00.905155 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:00.905133 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:44:00.905361 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:00.905346 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:44:01.691292 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:01.690751 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:44:01.691292 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:01.690770 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:44:01.691292 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:01.690922 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:44:01.691292 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:01.690980 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:44:01.893795 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:01.893763 2563 generic.go:356] "Generic (PLEG): container finished" podID="7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d" containerID="0b1633cff1c8d378c063116c4cd06abf6e73420a81d7016608c6b8eeb7704fdc" exitCode=0 Jun 12 21:44:01.893938 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:01.893859 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qd7gq" event={"ID":"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d","Type":"ContainerDied","Data":"0b1633cff1c8d378c063116c4cd06abf6e73420a81d7016608c6b8eeb7704fdc"} Jun 12 21:44:01.899931 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:01.899913 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnlbf_d13fa689-39c1-4a87-8506-5a75fcf8ad40/ovn-acl-logging/0.log" Jun 12 21:44:01.900292 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:01.900268 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" event={"ID":"d13fa689-39c1-4a87-8506-5a75fcf8ad40","Type":"ContainerStarted","Data":"1832725c541f0ac7ff792b424e851634e25f6c1b7a7396a81d60a3aa81c37740"} Jun 12 21:44:01.900381 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:01.900370 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 21:44:01.946893 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:01.946798 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" podStartSLOduration=10.235170324 podStartE2EDuration="28.946782092s" totalImagesPullingTime="18.711611768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:43:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:44:01.94598884 +0000 UTC m=+28.670272117" watchObservedRunningTime="2026-06-12 21:44:01.946782092 +0000 UTC m=+28.671065341" Jun 12 21:44:02.443030 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:02.442798 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pn5xz"] Jun 12 21:44:02.443172 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:02.443087 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:44:02.443227 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:02.443198 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:44:02.443362 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:02.443342 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5n2vz"] Jun 12 21:44:02.443436 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:02.443426 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:44:02.443529 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:02.443515 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:44:02.445260 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:02.445239 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kcq4r"] Jun 12 21:44:02.445356 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:02.445310 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:44:02.445401 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:02.445383 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:44:02.904833 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:02.904776 2563 generic.go:356] "Generic (PLEG): container finished" podID="7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d" containerID="82bab8c221142877b08b14cc9044263dc5c9a36749f239e1c58e3ec1a09c3f30" exitCode=0 Jun 12 21:44:02.905161 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:02.904851 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qd7gq" event={"ID":"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d","Type":"ContainerDied","Data":"82bab8c221142877b08b14cc9044263dc5c9a36749f239e1c58e3ec1a09c3f30"} Jun 12 21:44:02.905161 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:02.904951 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 21:44:03.011009 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:03.010984 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:44:03.691268 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:03.691234 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:44:03.691429 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:03.691366 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:44:04.690043 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:04.689966 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:44:04.690577 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:04.689966 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:44:04.690577 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:04.690098 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:44:04.690577 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:04.690243 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:44:05.689988 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:05.689958 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:44:05.690126 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:05.690094 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:44:06.690558 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:06.690530 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:44:06.691056 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:06.690640 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:44:06.691056 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:06.690699 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:44:06.691056 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:06.690819 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:44:07.508483 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:07.508446 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hh5k\" (UniqueName: \"kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k\") pod \"network-check-target-5n2vz\" (UID: \"3e0ffb25-9794-4397-9dee-7b6f4cd32e3b\") " pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:44:07.508825 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:07.508502 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret\") pod \"global-pull-secret-syncer-pn5xz\" (UID: \"54b820c6-53e5-455b-8211-32e44f9a925c\") " pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:44:07.508825 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:07.508542 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs\") pod \"network-metrics-daemon-kcq4r\" (UID: \"a8029f62-78fe-46b2-8587-0c150c839d9c\") " pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:44:07.508825 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:07.508637 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 21:44:07.508825 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:07.508652 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:44:07.508825 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:07.508681 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 21:44:07.508825 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:07.508697 2563 projected.go:196] Error preparing data for projected volume kube-api-access-2hh5k for pod openshift-network-diagnostics/network-check-target-5n2vz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:44:07.508825 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:07.508653 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 21:44:07.508825 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:07.508734 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs podName:a8029f62-78fe-46b2-8587-0c150c839d9c nodeName:}" failed. No retries permitted until 2026-06-12 21:44:39.50871401 +0000 UTC m=+66.232997243 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs") pod "network-metrics-daemon-kcq4r" (UID: "a8029f62-78fe-46b2-8587-0c150c839d9c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 21:44:07.508825 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:07.508782 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k podName:3e0ffb25-9794-4397-9dee-7b6f4cd32e3b nodeName:}" failed. No retries permitted until 2026-06-12 21:44:39.508764681 +0000 UTC m=+66.233047915 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2hh5k" (UniqueName: "kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k") pod "network-check-target-5n2vz" (UID: "3e0ffb25-9794-4397-9dee-7b6f4cd32e3b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 21:44:07.508825 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:07.508805 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret podName:54b820c6-53e5-455b-8211-32e44f9a925c nodeName:}" failed. No retries permitted until 2026-06-12 21:44:39.508795319 +0000 UTC m=+66.233078554 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret") pod "global-pull-secret-syncer-pn5xz" (UID: "54b820c6-53e5-455b-8211-32e44f9a925c") : object "kube-system"/"original-pull-secret" not registered Jun 12 21:44:07.689752 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:07.689694 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:44:07.689920 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:07.689830 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:44:08.689774 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:08.689585 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:44:08.690294 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:08.689643 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:44:08.690294 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:08.689867 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5n2vz" podUID="3e0ffb25-9794-4397-9dee-7b6f4cd32e3b" Jun 12 21:44:08.690294 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:08.689923 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn5xz" podUID="54b820c6-53e5-455b-8211-32e44f9a925c" Jun 12 21:44:08.922020 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:08.921996 2563 generic.go:356] "Generic (PLEG): container finished" podID="7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d" containerID="91a5a46a98e16d99763434a7dbe327b90cc3c2abf21dec760921c75d03fe4bfc" exitCode=0 Jun 12 21:44:08.922123 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:08.922043 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qd7gq" event={"ID":"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d","Type":"ContainerDied","Data":"91a5a46a98e16d99763434a7dbe327b90cc3c2abf21dec760921c75d03fe4bfc"} Jun 12 21:44:09.082640 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.082621 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-93.ec2.internal" event="NodeReady" Jun 12 21:44:09.082768 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.082758 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 21:44:09.116183 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.116159 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-dsh99"] Jun 12 21:44:09.127903 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.127884 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67655dfb86-drdz2"] Jun 12 21:44:09.128024 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.128007 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:44:09.129894 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.129877 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hxwcc\"" Jun 12 21:44:09.130099 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.130087 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 12 21:44:09.130314 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.130299 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 12 21:44:09.142082 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.142063 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-dsh99"] Jun 12 21:44:09.142176 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.142092 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vgf7j"] Jun 12 21:44:09.142216 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.142175 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.144491 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.144467 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 12 21:44:09.144576 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.144559 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 12 21:44:09.144780 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.144767 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fhwss\"" Jun 12 21:44:09.145026 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.145008 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 12 21:44:09.149710 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.149695 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 12 21:44:09.156135 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.156109 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67655dfb86-drdz2"] Jun 12 21:44:09.156245 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.156149 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-b2hff"] Jun 12 21:44:09.156408 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.156392 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:09.158359 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.158341 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b2mnf\"" Jun 12 21:44:09.158434 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.158372 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 21:44:09.158733 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.158718 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 21:44:09.168202 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.168186 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b2hff"] Jun 12 21:44:09.168270 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.168214 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vgf7j"] Jun 12 21:44:09.168308 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.168275 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b2hff" Jun 12 21:44:09.170485 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.170470 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4vrj7\"" Jun 12 21:44:09.170564 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.170504 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 21:44:09.170564 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.170521 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 21:44:09.170564 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.170534 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 21:44:09.224285 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.224260 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-image-registry-private-configuration\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.282141 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.282113 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-t5rg9_8a74036c-9a66-4f91-95a1-0ea1881ad2e2/konnectivity-agent/0.log" limit=1024 Jun 12 21:44:09.325068 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.325041 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf4wk\" (UniqueName: \"kubernetes.io/projected/6fd56879-c834-4b56-be2d-b20295f24c56-kube-api-access-bf4wk\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:09.325149 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.325076 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e6c3e41-23ae-4616-a236-48770e4b5462-nginx-conf\") pod \"networking-console-plugin-867b76cb74-dsh99\" (UID: \"7e6c3e41-23ae-4616-a236-48770e4b5462\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:44:09.325149 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.325116 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-bound-sa-token\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.325264 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.325145 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:09.325264 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.325173 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-installation-pull-secrets\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.325264 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.325218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fd56879-c834-4b56-be2d-b20295f24c56-config-volume\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:09.325411 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.325263 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-image-registry-private-configuration\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.325411 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.325298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fd56879-c834-4b56-be2d-b20295f24c56-tmp-dir\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:09.325411 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.325324 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-dsh99\" (UID: \"7e6c3e41-23ae-4616-a236-48770e4b5462\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:44:09.325411 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.325363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-ca-trust-extracted\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.325411 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.325385 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91a20919-5d74-44b4-b238-7238a4e5f890-cert\") pod \"ingress-canary-b2hff\" (UID: \"91a20919-5d74-44b4-b238-7238a4e5f890\") " pod="openshift-ingress-canary/ingress-canary-b2hff" Jun 12 21:44:09.325593 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.325408 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49ckw\" (UniqueName: \"kubernetes.io/projected/91a20919-5d74-44b4-b238-7238a4e5f890-kube-api-access-49ckw\") pod \"ingress-canary-b2hff\" (UID: \"91a20919-5d74-44b4-b238-7238a4e5f890\") " pod="openshift-ingress-canary/ingress-canary-b2hff" Jun 12 21:44:09.325593 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.325487 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-certificates\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.325593 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.325518 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-trusted-ca\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.325593 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.325545 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.325593 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.325560 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5scwj\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-kube-api-access-5scwj\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.329298 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.329271 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-image-registry-private-configuration\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.368452 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.366300 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-t5rg9_8a74036c-9a66-4f91-95a1-0ea1881ad2e2/konnectivity-agent/0.log" limit=1024 Jun 12 21:44:09.425869 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.425848 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-bound-sa-token\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.425935 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.425875 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:09.425935 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.425895 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-installation-pull-secrets\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.425935 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.425919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fd56879-c834-4b56-be2d-b20295f24c56-config-volume\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:09.426088 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.425943 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fd56879-c834-4b56-be2d-b20295f24c56-tmp-dir\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:09.426088 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.426055 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-dsh99\" (UID: \"7e6c3e41-23ae-4616-a236-48770e4b5462\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:44:09.426182 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.426108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-ca-trust-extracted\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.426182 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.426133 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91a20919-5d74-44b4-b238-7238a4e5f890-cert\") pod \"ingress-canary-b2hff\" (UID: \"91a20919-5d74-44b4-b238-7238a4e5f890\") " pod="openshift-ingress-canary/ingress-canary-b2hff" Jun 12 21:44:09.426182 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:09.426164 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 21:44:09.426326 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.426212 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fd56879-c834-4b56-be2d-b20295f24c56-tmp-dir\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:09.426326 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:09.426220 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 21:44:09.426326 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:09.426225 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls podName:6fd56879-c834-4b56-be2d-b20295f24c56 nodeName:}" failed. No retries permitted until 2026-06-12 21:44:09.926205752 +0000 UTC m=+36.650488998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls") pod "dns-default-vgf7j" (UID: "6fd56879-c834-4b56-be2d-b20295f24c56") : secret "dns-default-metrics-tls" not found Jun 12 21:44:09.426326 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.426167 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49ckw\" (UniqueName: \"kubernetes.io/projected/91a20919-5d74-44b4-b238-7238a4e5f890-kube-api-access-49ckw\") pod \"ingress-canary-b2hff\" (UID: \"91a20919-5d74-44b4-b238-7238a4e5f890\") " pod="openshift-ingress-canary/ingress-canary-b2hff" Jun 12 21:44:09.426326 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.426295 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-certificates\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.426326 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.426326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-trusted-ca\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.426690 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.426356 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.426690 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.426381 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5scwj\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-kube-api-access-5scwj\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.426690 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:09.426426 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert podName:7e6c3e41-23ae-4616-a236-48770e4b5462 nodeName:}" failed. No retries permitted until 2026-06-12 21:44:09.92640331 +0000 UTC m=+36.650686548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-dsh99" (UID: "7e6c3e41-23ae-4616-a236-48770e4b5462") : secret "networking-console-plugin-cert" not found Jun 12 21:44:09.426690 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.426452 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf4wk\" (UniqueName: \"kubernetes.io/projected/6fd56879-c834-4b56-be2d-b20295f24c56-kube-api-access-bf4wk\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:09.426690 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.426485 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e6c3e41-23ae-4616-a236-48770e4b5462-nginx-conf\") pod \"networking-console-plugin-867b76cb74-dsh99\" (UID: \"7e6c3e41-23ae-4616-a236-48770e4b5462\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:44:09.426690 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.426515 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-ca-trust-extracted\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.426690 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.426535 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6fd56879-c834-4b56-be2d-b20295f24c56-config-volume\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:09.426690 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:09.426616 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 21:44:09.426690 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:09.426628 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67655dfb86-drdz2: secret "image-registry-tls" not found Jun 12 21:44:09.427168 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:09.426706 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls podName:d98d8dfe-ae15-4606-acf8-2b1d55d48b9e nodeName:}" failed. No retries permitted until 2026-06-12 21:44:09.926688299 +0000 UTC m=+36.650971551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls") pod "image-registry-67655dfb86-drdz2" (UID: "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e") : secret "image-registry-tls" not found Jun 12 21:44:09.427308 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.427283 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e6c3e41-23ae-4616-a236-48770e4b5462-nginx-conf\") pod \"networking-console-plugin-867b76cb74-dsh99\" (UID: \"7e6c3e41-23ae-4616-a236-48770e4b5462\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:44:09.427767 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.427746 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-certificates\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.427815 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.427747 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-trusted-ca\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.428531 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.428513 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91a20919-5d74-44b4-b238-7238a4e5f890-cert\") pod \"ingress-canary-b2hff\" (UID: \"91a20919-5d74-44b4-b238-7238a4e5f890\") " pod="openshift-ingress-canary/ingress-canary-b2hff" Jun 12 21:44:09.428603 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.428534 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-installation-pull-secrets\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.436115 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.436091 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49ckw\" (UniqueName: \"kubernetes.io/projected/91a20919-5d74-44b4-b238-7238a4e5f890-kube-api-access-49ckw\") pod \"ingress-canary-b2hff\" (UID: \"91a20919-5d74-44b4-b238-7238a4e5f890\") " pod="openshift-ingress-canary/ingress-canary-b2hff" Jun 12 21:44:09.436601 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.436583 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf4wk\" (UniqueName: \"kubernetes.io/projected/6fd56879-c834-4b56-be2d-b20295f24c56-kube-api-access-bf4wk\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:09.438385 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.438366 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-bound-sa-token\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.438459 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.438439 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5scwj\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-kube-api-access-5scwj\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.489715 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.489680 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b2hff" Jun 12 21:44:09.689772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.689712 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:44:09.692108 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.692086 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zhmdq\"" Jun 12 21:44:09.692448 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.692086 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 21:44:09.719070 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.719047 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b2hff"] Jun 12 21:44:09.722762 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:44:09.722737 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a20919_5d74_44b4_b238_7238a4e5f890.slice/crio-f8dc1f2d3ab1103be04beed41b407a09a50c727dbba6510207a533be8e7af79c WatchSource:0}: Error finding container f8dc1f2d3ab1103be04beed41b407a09a50c727dbba6510207a533be8e7af79c: Status 404 returned error can't find the container with id f8dc1f2d3ab1103be04beed41b407a09a50c727dbba6510207a533be8e7af79c Jun 12 21:44:09.924887 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.924862 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b2hff" event={"ID":"91a20919-5d74-44b4-b238-7238a4e5f890","Type":"ContainerStarted","Data":"f8dc1f2d3ab1103be04beed41b407a09a50c727dbba6510207a533be8e7af79c"} Jun 12 21:44:09.927724 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.927701 2563 generic.go:356] "Generic (PLEG): container finished" podID="7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d" containerID="3268559f57f4aaa1dc3e1d9e6afd8be682dcdc2aeec4f4b6f1547a15d31be955" exitCode=0 Jun 12 21:44:09.927799 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.927742 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qd7gq" event={"ID":"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d","Type":"ContainerDied","Data":"3268559f57f4aaa1dc3e1d9e6afd8be682dcdc2aeec4f4b6f1547a15d31be955"} Jun 12 21:44:09.929815 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.929798 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-dsh99\" (UID: \"7e6c3e41-23ae-4616-a236-48770e4b5462\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:44:09.929901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.929841 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:09.929901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:09.929865 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:09.930000 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:09.929941 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 21:44:09.930000 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:09.929945 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 21:44:09.930000 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:09.929962 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67655dfb86-drdz2: secret "image-registry-tls" not found Jun 12 21:44:09.930000 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:09.929950 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 21:44:09.930000 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:09.929992 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls podName:6fd56879-c834-4b56-be2d-b20295f24c56 nodeName:}" failed. No retries permitted until 2026-06-12 21:44:10.929974431 +0000 UTC m=+37.654257681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls") pod "dns-default-vgf7j" (UID: "6fd56879-c834-4b56-be2d-b20295f24c56") : secret "dns-default-metrics-tls" not found Jun 12 21:44:09.930148 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:09.930010 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert podName:7e6c3e41-23ae-4616-a236-48770e4b5462 nodeName:}" failed. No retries permitted until 2026-06-12 21:44:10.929998324 +0000 UTC m=+37.654281562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-dsh99" (UID: "7e6c3e41-23ae-4616-a236-48770e4b5462") : secret "networking-console-plugin-cert" not found Jun 12 21:44:09.930148 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:09.930021 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls podName:d98d8dfe-ae15-4606-acf8-2b1d55d48b9e nodeName:}" failed. No retries permitted until 2026-06-12 21:44:10.930015327 +0000 UTC m=+37.654298554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls") pod "image-registry-67655dfb86-drdz2" (UID: "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e") : secret "image-registry-tls" not found Jun 12 21:44:10.690236 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:10.690203 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:44:10.690400 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:10.690203 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:44:10.692928 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:10.692902 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 21:44:10.693491 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:10.693466 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 21:44:10.693491 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:10.693477 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-855fz\"" Jun 12 21:44:10.693800 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:10.693785 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 21:44:10.933780 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:10.933750 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qd7gq" event={"ID":"7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d","Type":"ContainerStarted","Data":"45d2b8a5d98ca609a99dcacf9ba238e354fd8d64fb791212be4184567d8a673b"} Jun 12 21:44:10.935258 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:10.935229 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-dsh99\" (UID: \"7e6c3e41-23ae-4616-a236-48770e4b5462\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:44:10.935388 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:10.935320 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:10.935388 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:10.935366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:10.935388 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:10.935377 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 21:44:10.935549 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:10.935438 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert podName:7e6c3e41-23ae-4616-a236-48770e4b5462 nodeName:}" failed. No retries permitted until 2026-06-12 21:44:12.93541951 +0000 UTC m=+39.659702763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-dsh99" (UID: "7e6c3e41-23ae-4616-a236-48770e4b5462") : secret "networking-console-plugin-cert" not found Jun 12 21:44:10.935549 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:10.935458 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 21:44:10.935549 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:10.935476 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67655dfb86-drdz2: secret "image-registry-tls" not found Jun 12 21:44:10.935549 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:10.935486 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 21:44:10.935549 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:10.935532 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls podName:d98d8dfe-ae15-4606-acf8-2b1d55d48b9e nodeName:}" failed. No retries permitted until 2026-06-12 21:44:12.935515204 +0000 UTC m=+39.659798452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls") pod "image-registry-67655dfb86-drdz2" (UID: "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e") : secret "image-registry-tls" not found Jun 12 21:44:10.935549 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:10.935551 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls podName:6fd56879-c834-4b56-be2d-b20295f24c56 nodeName:}" failed. No retries permitted until 2026-06-12 21:44:12.935542261 +0000 UTC m=+39.659825491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls") pod "dns-default-vgf7j" (UID: "6fd56879-c834-4b56-be2d-b20295f24c56") : secret "dns-default-metrics-tls" not found Jun 12 21:44:10.956234 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:10.956156 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qd7gq" podStartSLOduration=7.612752059 podStartE2EDuration="37.956142799s" totalImagesPullingTime="30.34339074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:43:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:44:10.95549276 +0000 UTC m=+37.679776009" watchObservedRunningTime="2026-06-12 21:44:10.956142799 +0000 UTC m=+37.680426049" Jun 12 21:44:11.076041 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:11.076009 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-t5rg9_8a74036c-9a66-4f91-95a1-0ea1881ad2e2/konnectivity-agent/0.log" limit=1024 Jun 12 21:44:11.128761 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:11.128735 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-t5rg9_8a74036c-9a66-4f91-95a1-0ea1881ad2e2/konnectivity-agent/0.log" limit=1024 Jun 12 21:44:11.685504 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:11.685468 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-t5rg9_8a74036c-9a66-4f91-95a1-0ea1881ad2e2/konnectivity-agent/0.log" limit=1024 Jun 12 21:44:11.782699 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:11.782648 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-t5rg9_8a74036c-9a66-4f91-95a1-0ea1881ad2e2/konnectivity-agent/0.log" limit=1024 Jun 12 21:44:12.939196 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:12.939163 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b2hff" event={"ID":"91a20919-5d74-44b4-b238-7238a4e5f890","Type":"ContainerStarted","Data":"52b1b7586ba2d3aca4f7b607e6c3fb8087fd253018f0ed69fc75114c2c061b13"} Jun 12 21:44:12.951158 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:12.951132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-dsh99\" (UID: \"7e6c3e41-23ae-4616-a236-48770e4b5462\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:44:12.951269 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:12.951206 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:12.951269 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:12.951244 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:12.951363 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:12.951348 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 21:44:12.951398 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:12.951361 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 21:44:12.951398 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:12.951384 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 21:44:12.951460 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:12.951401 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67655dfb86-drdz2: secret "image-registry-tls" not found Jun 12 21:44:12.951460 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:12.951410 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls podName:6fd56879-c834-4b56-be2d-b20295f24c56 nodeName:}" failed. No retries permitted until 2026-06-12 21:44:16.95139683 +0000 UTC m=+43.675680071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls") pod "dns-default-vgf7j" (UID: "6fd56879-c834-4b56-be2d-b20295f24c56") : secret "dns-default-metrics-tls" not found Jun 12 21:44:12.951460 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:12.951433 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert podName:7e6c3e41-23ae-4616-a236-48770e4b5462 nodeName:}" failed. No retries permitted until 2026-06-12 21:44:16.951417843 +0000 UTC m=+43.675701084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-dsh99" (UID: "7e6c3e41-23ae-4616-a236-48770e4b5462") : secret "networking-console-plugin-cert" not found Jun 12 21:44:12.951460 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:12.951448 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls podName:d98d8dfe-ae15-4606-acf8-2b1d55d48b9e nodeName:}" failed. No retries permitted until 2026-06-12 21:44:16.951439509 +0000 UTC m=+43.675722737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls") pod "image-registry-67655dfb86-drdz2" (UID: "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e") : secret "image-registry-tls" not found Jun 12 21:44:12.955514 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:12.955473 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-b2hff" podStartSLOduration=1.555650155 podStartE2EDuration="3.955457664s" totalImagesPullingTime="2.399807509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:44:12.955322961 +0000 UTC m=+39.679606222" watchObservedRunningTime="2026-06-12 21:44:12.955457664 +0000 UTC m=+39.679740915" Jun 12 21:44:14.166550 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:14.166519 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-t5rg9_8a74036c-9a66-4f91-95a1-0ea1881ad2e2/konnectivity-agent/0.log" limit=1024 Jun 12 21:44:16.978965 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:16.978932 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-dsh99\" (UID: \"7e6c3e41-23ae-4616-a236-48770e4b5462\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:44:16.979330 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:16.978984 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:16.979330 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:16.979066 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 21:44:16.979330 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:16.979067 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 21:44:16.979330 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:16.979088 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:16.979330 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:16.979075 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67655dfb86-drdz2: secret "image-registry-tls" not found Jun 12 21:44:16.979330 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:16.979153 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 21:44:16.979330 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:16.979127 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert podName:7e6c3e41-23ae-4616-a236-48770e4b5462 nodeName:}" failed. No retries permitted until 2026-06-12 21:44:24.979111201 +0000 UTC m=+51.703394429 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-dsh99" (UID: "7e6c3e41-23ae-4616-a236-48770e4b5462") : secret "networking-console-plugin-cert" not found Jun 12 21:44:16.979330 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:16.979207 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls podName:d98d8dfe-ae15-4606-acf8-2b1d55d48b9e nodeName:}" failed. No retries permitted until 2026-06-12 21:44:24.979173279 +0000 UTC m=+51.703456517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls") pod "image-registry-67655dfb86-drdz2" (UID: "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e") : secret "image-registry-tls" not found Jun 12 21:44:16.979330 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:16.979230 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls podName:6fd56879-c834-4b56-be2d-b20295f24c56 nodeName:}" failed. No retries permitted until 2026-06-12 21:44:24.979219852 +0000 UTC m=+51.703503085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls") pod "dns-default-vgf7j" (UID: "6fd56879-c834-4b56-be2d-b20295f24c56") : secret "dns-default-metrics-tls" not found Jun 12 21:44:25.037310 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:25.037280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:25.037795 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:25.037318 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:25.037795 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:25.037360 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-dsh99\" (UID: \"7e6c3e41-23ae-4616-a236-48770e4b5462\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:44:25.037795 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:25.037415 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 21:44:25.037795 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:25.037429 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67655dfb86-drdz2: secret "image-registry-tls" not found Jun 12 21:44:25.037795 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:25.037441 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 21:44:25.037795 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:25.037474 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls podName:d98d8dfe-ae15-4606-acf8-2b1d55d48b9e nodeName:}" failed. No retries permitted until 2026-06-12 21:44:41.037458985 +0000 UTC m=+67.761742212 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls") pod "image-registry-67655dfb86-drdz2" (UID: "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e") : secret "image-registry-tls" not found Jun 12 21:44:25.037795 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:25.037442 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 21:44:25.037795 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:25.037488 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls podName:6fd56879-c834-4b56-be2d-b20295f24c56 nodeName:}" failed. No retries permitted until 2026-06-12 21:44:41.037482043 +0000 UTC m=+67.761765271 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls") pod "dns-default-vgf7j" (UID: "6fd56879-c834-4b56-be2d-b20295f24c56") : secret "dns-default-metrics-tls" not found Jun 12 21:44:25.037795 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:25.037505 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert podName:7e6c3e41-23ae-4616-a236-48770e4b5462 nodeName:}" failed. No retries permitted until 2026-06-12 21:44:41.037492907 +0000 UTC m=+67.761776139 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-dsh99" (UID: "7e6c3e41-23ae-4616-a236-48770e4b5462") : secret "networking-console-plugin-cert" not found Jun 12 21:44:33.917041 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:33.917014 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnlbf" Jun 12 21:44:39.536806 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:39.536771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hh5k\" (UniqueName: \"kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k\") pod \"network-check-target-5n2vz\" (UID: \"3e0ffb25-9794-4397-9dee-7b6f4cd32e3b\") " pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:44:39.537306 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:39.536814 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret\") pod \"global-pull-secret-syncer-pn5xz\" (UID: \"54b820c6-53e5-455b-8211-32e44f9a925c\") " pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:44:39.537306 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:39.536860 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs\") pod \"network-metrics-daemon-kcq4r\" (UID: \"a8029f62-78fe-46b2-8587-0c150c839d9c\") " pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:44:39.538951 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:39.538932 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 21:44:39.539179 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:39.539165 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 21:44:39.539219 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:39.539192 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 21:44:39.547979 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:39.547961 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 21:44:39.548050 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:39.548037 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs podName:a8029f62-78fe-46b2-8587-0c150c839d9c nodeName:}" failed. No retries permitted until 2026-06-12 21:45:43.548018109 +0000 UTC m=+130.272301337 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs") pod "network-metrics-daemon-kcq4r" (UID: "a8029f62-78fe-46b2-8587-0c150c839d9c") : secret "metrics-daemon-secret" not found Jun 12 21:44:39.550006 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:39.549987 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 21:44:39.551160 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:39.551141 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54b820c6-53e5-455b-8211-32e44f9a925c-original-pull-secret\") pod \"global-pull-secret-syncer-pn5xz\" (UID: \"54b820c6-53e5-455b-8211-32e44f9a925c\") " pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:44:39.560623 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:39.560601 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hh5k\" (UniqueName: \"kubernetes.io/projected/3e0ffb25-9794-4397-9dee-7b6f4cd32e3b-kube-api-access-2hh5k\") pod \"network-check-target-5n2vz\" (UID: \"3e0ffb25-9794-4397-9dee-7b6f4cd32e3b\") " pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:44:39.802430 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:39.802374 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn5xz" Jun 12 21:44:39.810784 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:39.810760 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-855fz\"" Jun 12 21:44:39.819305 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:39.819288 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:44:39.957178 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:39.957152 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pn5xz"] Jun 12 21:44:39.960500 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:44:39.960480 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54b820c6_53e5_455b_8211_32e44f9a925c.slice/crio-4acc53493a3c3fee74c256ff87217ed618b7bbbe8540ce0d8a63e3aaff6716c9 WatchSource:0}: Error finding container 4acc53493a3c3fee74c256ff87217ed618b7bbbe8540ce0d8a63e3aaff6716c9: Status 404 returned error can't find the container with id 4acc53493a3c3fee74c256ff87217ed618b7bbbe8540ce0d8a63e3aaff6716c9 Jun 12 21:44:39.997610 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:39.997573 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pn5xz" event={"ID":"54b820c6-53e5-455b-8211-32e44f9a925c","Type":"ContainerStarted","Data":"4acc53493a3c3fee74c256ff87217ed618b7bbbe8540ce0d8a63e3aaff6716c9"} Jun 12 21:44:39.998529 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:39.998508 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5n2vz"] Jun 12 21:44:40.001353 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:44:40.001328 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e0ffb25_9794_4397_9dee_7b6f4cd32e3b.slice/crio-5389a889f6fca75cf15693a3fd6fc277b5a7dd26627c604be1def1aef253719b WatchSource:0}: Error finding container 5389a889f6fca75cf15693a3fd6fc277b5a7dd26627c604be1def1aef253719b: Status 404 returned error can't find the container with id 5389a889f6fca75cf15693a3fd6fc277b5a7dd26627c604be1def1aef253719b Jun 12 21:44:41.003182 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:41.003139 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5n2vz" event={"ID":"3e0ffb25-9794-4397-9dee-7b6f4cd32e3b","Type":"ContainerStarted","Data":"5389a889f6fca75cf15693a3fd6fc277b5a7dd26627c604be1def1aef253719b"} Jun 12 21:44:41.049496 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:41.049468 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:44:41.049631 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:41.049516 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:44:41.049631 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:41.049613 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 21:44:41.049761 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:41.049635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-dsh99\" (UID: \"7e6c3e41-23ae-4616-a236-48770e4b5462\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:44:41.049761 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:41.049616 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 21:44:41.049761 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:41.049712 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 21:44:41.049761 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:41.049713 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67655dfb86-drdz2: secret "image-registry-tls" not found Jun 12 21:44:41.049954 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:41.049688 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls podName:6fd56879-c834-4b56-be2d-b20295f24c56 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:13.049652121 +0000 UTC m=+99.773935362 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls") pod "dns-default-vgf7j" (UID: "6fd56879-c834-4b56-be2d-b20295f24c56") : secret "dns-default-metrics-tls" not found Jun 12 21:44:41.049954 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:41.049797 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert podName:7e6c3e41-23ae-4616-a236-48770e4b5462 nodeName:}" failed. No retries permitted until 2026-06-12 21:45:13.049784005 +0000 UTC m=+99.774067248 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-dsh99" (UID: "7e6c3e41-23ae-4616-a236-48770e4b5462") : secret "networking-console-plugin-cert" not found Jun 12 21:44:41.049954 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:44:41.049822 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls podName:d98d8dfe-ae15-4606-acf8-2b1d55d48b9e nodeName:}" failed. No retries permitted until 2026-06-12 21:45:13.049811659 +0000 UTC m=+99.774094897 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls") pod "image-registry-67655dfb86-drdz2" (UID: "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e") : secret "image-registry-tls" not found Jun 12 21:44:45.014546 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:45.014502 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pn5xz" event={"ID":"54b820c6-53e5-455b-8211-32e44f9a925c","Type":"ContainerStarted","Data":"084cd1e3e36780a23577a2e4d4bfa59625d08065713dca73c882d80b8748d517"} Jun 12 21:44:45.015944 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:45.015922 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5n2vz" event={"ID":"3e0ffb25-9794-4397-9dee-7b6f4cd32e3b","Type":"ContainerStarted","Data":"b651e7cd65bd007855933a58614131f512d393978b268d07077042394ae82d30"} Jun 12 21:44:45.016066 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:45.015967 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:44:45.029756 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:44:45.029713 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pn5xz" podStartSLOduration=66.497854245 podStartE2EDuration="1m11.029699645s" totalImagesPullingTime="4.5318454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:44:45.028760321 +0000 UTC m=+71.753043599" watchObservedRunningTime="2026-06-12 21:44:45.029699645 +0000 UTC m=+71.753982894" Jun 12 21:45:13.075825 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:45:13.075787 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-dsh99\" (UID: \"7e6c3e41-23ae-4616-a236-48770e4b5462\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:45:13.076279 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:45:13.075855 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:45:13.076279 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:45:13.075897 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:45:13.076279 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:45:13.075931 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 21:45:13.076279 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:45:13.076009 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert podName:7e6c3e41-23ae-4616-a236-48770e4b5462 nodeName:}" failed. No retries permitted until 2026-06-12 21:46:17.075988833 +0000 UTC m=+163.800272076 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-dsh99" (UID: "7e6c3e41-23ae-4616-a236-48770e4b5462") : secret "networking-console-plugin-cert" not found Jun 12 21:45:13.076279 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:45:13.076006 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 21:45:13.076279 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:45:13.076030 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67655dfb86-drdz2: secret "image-registry-tls" not found Jun 12 21:45:13.076279 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:45:13.076048 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 21:45:13.076279 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:45:13.076097 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls podName:d98d8dfe-ae15-4606-acf8-2b1d55d48b9e nodeName:}" failed. No retries permitted until 2026-06-12 21:46:17.076078446 +0000 UTC m=+163.800361686 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls") pod "image-registry-67655dfb86-drdz2" (UID: "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e") : secret "image-registry-tls" not found Jun 12 21:45:13.076279 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:45:13.076115 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls podName:6fd56879-c834-4b56-be2d-b20295f24c56 nodeName:}" failed. No retries permitted until 2026-06-12 21:46:17.076106348 +0000 UTC m=+163.800389576 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls") pod "dns-default-vgf7j" (UID: "6fd56879-c834-4b56-be2d-b20295f24c56") : secret "dns-default-metrics-tls" not found Jun 12 21:45:16.020759 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:45:16.020730 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5n2vz" Jun 12 21:45:16.036269 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:45:16.036195 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5n2vz" podStartSLOduration=98.548143363 podStartE2EDuration="1m43.036183121s" totalImagesPullingTime="4.488039758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:43:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:44:45.046320887 +0000 UTC m=+71.770604138" watchObservedRunningTime="2026-06-12 21:45:16.036183121 +0000 UTC m=+102.760466371" Jun 12 21:45:43.577714 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:45:43.577681 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs\") pod \"network-metrics-daemon-kcq4r\" (UID: \"a8029f62-78fe-46b2-8587-0c150c839d9c\") " pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:45:43.578165 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:45:43.577812 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 21:45:43.578165 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:45:43.577875 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs podName:a8029f62-78fe-46b2-8587-0c150c839d9c nodeName:}" failed. No retries permitted until 2026-06-12 21:47:45.5778607 +0000 UTC m=+252.302143931 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs") pod "network-metrics-daemon-kcq4r" (UID: "a8029f62-78fe-46b2-8587-0c150c839d9c") : secret "metrics-daemon-secret" not found Jun 12 21:46:12.173540 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:46:12.173500 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" podUID="7e6c3e41-23ae-4616-a236-48770e4b5462" Jun 12 21:46:12.179639 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:46:12.179615 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67655dfb86-drdz2" podUID="d98d8dfe-ae15-4606-acf8-2b1d55d48b9e" Jun 12 21:46:12.185785 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:46:12.185757 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vgf7j" podUID="6fd56879-c834-4b56-be2d-b20295f24c56" Jun 12 21:46:12.206503 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:46:12.206481 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vgf7j" Jun 12 21:46:12.206609 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:46:12.206481 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:46:12.206647 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:46:12.206487 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:46:12.699566 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:46:12.699534 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:46:17.107594 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:46:17.107549 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-dsh99\" (UID: \"7e6c3e41-23ae-4616-a236-48770e4b5462\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:46:17.108011 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:46:17.107643 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:46:17.108011 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:46:17.107706 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:46:17.108011 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:46:17.107724 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 21:46:17.108011 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:46:17.107784 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 21:46:17.108011 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:46:17.107803 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert podName:7e6c3e41-23ae-4616-a236-48770e4b5462 nodeName:}" failed. No retries permitted until 2026-06-12 21:48:19.107786898 +0000 UTC m=+285.832070141 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-dsh99" (UID: "7e6c3e41-23ae-4616-a236-48770e4b5462") : secret "networking-console-plugin-cert" not found Jun 12 21:46:17.108011 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:46:17.107847 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls podName:6fd56879-c834-4b56-be2d-b20295f24c56 nodeName:}" failed. No retries permitted until 2026-06-12 21:48:19.107834303 +0000 UTC m=+285.832117530 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls") pod "dns-default-vgf7j" (UID: "6fd56879-c834-4b56-be2d-b20295f24c56") : secret "dns-default-metrics-tls" not found Jun 12 21:46:17.108011 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:46:17.107786 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 21:46:17.108011 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:46:17.107868 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67655dfb86-drdz2: secret "image-registry-tls" not found Jun 12 21:46:17.108011 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:46:17.107911 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls podName:d98d8dfe-ae15-4606-acf8-2b1d55d48b9e nodeName:}" failed. No retries permitted until 2026-06-12 21:48:19.107898503 +0000 UTC m=+285.832181730 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls") pod "image-registry-67655dfb86-drdz2" (UID: "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e") : secret "image-registry-tls" not found Jun 12 21:46:23.691275 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:46:23.691203 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:47:32.128485 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.128453 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-p2ssr"] Jun 12 21:47:32.130539 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.130523 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-p2ssr" Jun 12 21:47:32.132365 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.132342 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qbx6s\"" Jun 12 21:47:32.132697 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.132678 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fll8d"] Jun 12 21:47:32.134678 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.134651 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fll8d" Jun 12 21:47:32.136355 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.136335 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 12 21:47:32.136506 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.136484 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gpn5h\"" Jun 12 21:47:32.136619 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.136601 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 12 21:47:32.141209 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.141189 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-vtz7b"] Jun 12 21:47:32.142791 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.142769 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk"] Jun 12 21:47:32.142900 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.142882 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:32.144543 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.144524 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 12 21:47:32.144684 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.144636 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-p2ssr"] Jun 12 21:47:32.144825 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.144747 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk" Jun 12 21:47:32.147015 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.146995 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 12 21:47:32.147297 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.147279 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 12 21:47:32.147520 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.147503 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-k8jcs\"" Jun 12 21:47:32.147621 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.147524 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 12 21:47:32.147942 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.147922 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mqz22\"" Jun 12 21:47:32.148161 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.148143 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 12 21:47:32.148274 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.148197 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 12 21:47:32.148337 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.148329 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 12 21:47:32.148557 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.148541 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fll8d"] Jun 12 21:47:32.155051 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.155032 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 12 21:47:32.158489 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.158470 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-vtz7b"] Jun 12 21:47:32.164658 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.164637 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk"] Jun 12 21:47:32.199903 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.199878 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/15c9555f-ff57-4466-8a1d-afe9996ba621-trusted-ca\") pod \"console-operator-5dbbb5d744-vtz7b\" (UID: \"15c9555f-ff57-4466-8a1d-afe9996ba621\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:32.200001 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.199907 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8dz9\" (UniqueName: \"kubernetes.io/projected/15c9555f-ff57-4466-8a1d-afe9996ba621-kube-api-access-s8dz9\") pod \"console-operator-5dbbb5d744-vtz7b\" (UID: \"15c9555f-ff57-4466-8a1d-afe9996ba621\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:32.200001 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.199940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdkpt\" (UniqueName: \"kubernetes.io/projected/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-kube-api-access-tdkpt\") pod \"cluster-samples-operator-9547488fd-7jjnk\" (UID: \"3b372dbe-3ecb-47cd-94ed-51c298ebbdd4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk" Jun 12 21:47:32.200078 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.200018 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-7jjnk\" (UID: \"3b372dbe-3ecb-47cd-94ed-51c298ebbdd4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk" Jun 12 21:47:32.200078 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.200044 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq26w\" (UniqueName: \"kubernetes.io/projected/d1f254fe-4106-41d6-8295-5711c5e1dd6c-kube-api-access-gq26w\") pod \"volume-data-source-validator-bd4ccd799-fll8d\" (UID: \"d1f254fe-4106-41d6-8295-5711c5e1dd6c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fll8d" Jun 12 21:47:32.200078 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.200069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15c9555f-ff57-4466-8a1d-afe9996ba621-config\") pod \"console-operator-5dbbb5d744-vtz7b\" (UID: \"15c9555f-ff57-4466-8a1d-afe9996ba621\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:32.200193 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.200089 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15c9555f-ff57-4466-8a1d-afe9996ba621-serving-cert\") pod \"console-operator-5dbbb5d744-vtz7b\" (UID: \"15c9555f-ff57-4466-8a1d-afe9996ba621\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:32.200193 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.200115 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flp7m\" (UniqueName: \"kubernetes.io/projected/02a87d0a-9f00-48bf-89d0-6bf4ac06acc7-kube-api-access-flp7m\") pod \"network-check-source-6947749cfc-p2ssr\" (UID: \"02a87d0a-9f00-48bf-89d0-6bf4ac06acc7\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-p2ssr" Jun 12 21:47:32.300367 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.300343 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/15c9555f-ff57-4466-8a1d-afe9996ba621-trusted-ca\") pod \"console-operator-5dbbb5d744-vtz7b\" (UID: \"15c9555f-ff57-4466-8a1d-afe9996ba621\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:32.300466 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.300369 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8dz9\" (UniqueName: \"kubernetes.io/projected/15c9555f-ff57-4466-8a1d-afe9996ba621-kube-api-access-s8dz9\") pod \"console-operator-5dbbb5d744-vtz7b\" (UID: \"15c9555f-ff57-4466-8a1d-afe9996ba621\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:32.300466 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.300397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdkpt\" (UniqueName: \"kubernetes.io/projected/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-kube-api-access-tdkpt\") pod \"cluster-samples-operator-9547488fd-7jjnk\" (UID: \"3b372dbe-3ecb-47cd-94ed-51c298ebbdd4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk" Jun 12 21:47:32.300577 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.300536 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-7jjnk\" (UID: \"3b372dbe-3ecb-47cd-94ed-51c298ebbdd4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk" Jun 12 21:47:32.300577 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.300571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq26w\" (UniqueName: \"kubernetes.io/projected/d1f254fe-4106-41d6-8295-5711c5e1dd6c-kube-api-access-gq26w\") pod \"volume-data-source-validator-bd4ccd799-fll8d\" (UID: \"d1f254fe-4106-41d6-8295-5711c5e1dd6c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fll8d" Jun 12 21:47:32.300649 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.300610 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15c9555f-ff57-4466-8a1d-afe9996ba621-config\") pod \"console-operator-5dbbb5d744-vtz7b\" (UID: \"15c9555f-ff57-4466-8a1d-afe9996ba621\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:32.300709 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.300644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15c9555f-ff57-4466-8a1d-afe9996ba621-serving-cert\") pod \"console-operator-5dbbb5d744-vtz7b\" (UID: \"15c9555f-ff57-4466-8a1d-afe9996ba621\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:32.300709 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:32.300687 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 21:47:32.300780 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.300707 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flp7m\" (UniqueName: \"kubernetes.io/projected/02a87d0a-9f00-48bf-89d0-6bf4ac06acc7-kube-api-access-flp7m\") pod \"network-check-source-6947749cfc-p2ssr\" (UID: \"02a87d0a-9f00-48bf-89d0-6bf4ac06acc7\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-p2ssr" Jun 12 21:47:32.300780 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:32.300760 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls podName:3b372dbe-3ecb-47cd-94ed-51c298ebbdd4 nodeName:}" failed. No retries permitted until 2026-06-12 21:47:32.800740057 +0000 UTC m=+239.525023290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls") pod "cluster-samples-operator-9547488fd-7jjnk" (UID: "3b372dbe-3ecb-47cd-94ed-51c298ebbdd4") : secret "samples-operator-tls" not found Jun 12 21:47:32.301235 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.301217 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/15c9555f-ff57-4466-8a1d-afe9996ba621-trusted-ca\") pod \"console-operator-5dbbb5d744-vtz7b\" (UID: \"15c9555f-ff57-4466-8a1d-afe9996ba621\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:32.301294 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.301244 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15c9555f-ff57-4466-8a1d-afe9996ba621-config\") pod \"console-operator-5dbbb5d744-vtz7b\" (UID: \"15c9555f-ff57-4466-8a1d-afe9996ba621\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:32.302952 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.302933 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15c9555f-ff57-4466-8a1d-afe9996ba621-serving-cert\") pod \"console-operator-5dbbb5d744-vtz7b\" (UID: \"15c9555f-ff57-4466-8a1d-afe9996ba621\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:32.308741 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.308712 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8dz9\" (UniqueName: \"kubernetes.io/projected/15c9555f-ff57-4466-8a1d-afe9996ba621-kube-api-access-s8dz9\") pod \"console-operator-5dbbb5d744-vtz7b\" (UID: \"15c9555f-ff57-4466-8a1d-afe9996ba621\") " pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:32.308939 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.308920 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdkpt\" (UniqueName: \"kubernetes.io/projected/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-kube-api-access-tdkpt\") pod \"cluster-samples-operator-9547488fd-7jjnk\" (UID: \"3b372dbe-3ecb-47cd-94ed-51c298ebbdd4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk" Jun 12 21:47:32.309238 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.309222 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flp7m\" (UniqueName: \"kubernetes.io/projected/02a87d0a-9f00-48bf-89d0-6bf4ac06acc7-kube-api-access-flp7m\") pod \"network-check-source-6947749cfc-p2ssr\" (UID: \"02a87d0a-9f00-48bf-89d0-6bf4ac06acc7\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-p2ssr" Jun 12 21:47:32.309276 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.309225 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq26w\" (UniqueName: \"kubernetes.io/projected/d1f254fe-4106-41d6-8295-5711c5e1dd6c-kube-api-access-gq26w\") pod \"volume-data-source-validator-bd4ccd799-fll8d\" (UID: \"d1f254fe-4106-41d6-8295-5711c5e1dd6c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fll8d" Jun 12 21:47:32.440198 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.440146 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-p2ssr" Jun 12 21:47:32.446376 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.446359 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fll8d" Jun 12 21:47:32.455241 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.455222 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:32.577290 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.577266 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-p2ssr"] Jun 12 21:47:32.580293 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:47:32.580267 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a87d0a_9f00_48bf_89d0_6bf4ac06acc7.slice/crio-bfcc6c2ae0ae490b9d184562d194eb17e28dfd653b91bfdae5aaab38179e7782 WatchSource:0}: Error finding container bfcc6c2ae0ae490b9d184562d194eb17e28dfd653b91bfdae5aaab38179e7782: Status 404 returned error can't find the container with id bfcc6c2ae0ae490b9d184562d194eb17e28dfd653b91bfdae5aaab38179e7782 Jun 12 21:47:32.795540 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.795476 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-vtz7b"] Jun 12 21:47:32.798799 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.798774 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fll8d"] Jun 12 21:47:32.799035 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:47:32.799012 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c9555f_ff57_4466_8a1d_afe9996ba621.slice/crio-656e0a8e5c4a570dd1c3ef52bae3effe86ad3d13080eff480332a2e02409f4dd WatchSource:0}: Error finding container 656e0a8e5c4a570dd1c3ef52bae3effe86ad3d13080eff480332a2e02409f4dd: Status 404 returned error can't find the container with id 656e0a8e5c4a570dd1c3ef52bae3effe86ad3d13080eff480332a2e02409f4dd Jun 12 21:47:32.802060 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:47:32.802040 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f254fe_4106_41d6_8295_5711c5e1dd6c.slice/crio-50f78965d70e4569ee8b709f7bf93d91c4b9062c4cea1ec81c98311afb734bc8 WatchSource:0}: Error finding container 50f78965d70e4569ee8b709f7bf93d91c4b9062c4cea1ec81c98311afb734bc8: Status 404 returned error can't find the container with id 50f78965d70e4569ee8b709f7bf93d91c4b9062c4cea1ec81c98311afb734bc8 Jun 12 21:47:32.805314 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:32.805284 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-7jjnk\" (UID: \"3b372dbe-3ecb-47cd-94ed-51c298ebbdd4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk" Jun 12 21:47:32.805458 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:32.805437 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 21:47:32.805547 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:32.805518 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls podName:3b372dbe-3ecb-47cd-94ed-51c298ebbdd4 nodeName:}" failed. No retries permitted until 2026-06-12 21:47:33.805480874 +0000 UTC m=+240.529764106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls") pod "cluster-samples-operator-9547488fd-7jjnk" (UID: "3b372dbe-3ecb-47cd-94ed-51c298ebbdd4") : secret "samples-operator-tls" not found Jun 12 21:47:33.387127 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:33.387094 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fll8d" event={"ID":"d1f254fe-4106-41d6-8295-5711c5e1dd6c","Type":"ContainerStarted","Data":"50f78965d70e4569ee8b709f7bf93d91c4b9062c4cea1ec81c98311afb734bc8"} Jun 12 21:47:33.388772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:33.388697 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-p2ssr" event={"ID":"02a87d0a-9f00-48bf-89d0-6bf4ac06acc7","Type":"ContainerStarted","Data":"03343a5bb193f339a20fc9addd69ac5ab76902e9d52bd09288ba9431496fcdcb"} Jun 12 21:47:33.388772 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:33.388741 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-p2ssr" event={"ID":"02a87d0a-9f00-48bf-89d0-6bf4ac06acc7","Type":"ContainerStarted","Data":"bfcc6c2ae0ae490b9d184562d194eb17e28dfd653b91bfdae5aaab38179e7782"} Jun 12 21:47:33.390918 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:33.390888 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" event={"ID":"15c9555f-ff57-4466-8a1d-afe9996ba621","Type":"ContainerStarted","Data":"656e0a8e5c4a570dd1c3ef52bae3effe86ad3d13080eff480332a2e02409f4dd"} Jun 12 21:47:33.404806 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:33.404764 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-p2ssr" podStartSLOduration=1.404749134 podStartE2EDuration="1.404749134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:47:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:47:33.403488965 +0000 UTC m=+240.127772217" watchObservedRunningTime="2026-06-12 21:47:33.404749134 +0000 UTC m=+240.129032385" Jun 12 21:47:33.811981 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:33.811894 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-7jjnk\" (UID: \"3b372dbe-3ecb-47cd-94ed-51c298ebbdd4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk" Jun 12 21:47:33.812119 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:33.812069 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 21:47:33.812174 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:33.812125 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls podName:3b372dbe-3ecb-47cd-94ed-51c298ebbdd4 nodeName:}" failed. No retries permitted until 2026-06-12 21:47:35.812108159 +0000 UTC m=+242.536391389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls") pod "cluster-samples-operator-9547488fd-7jjnk" (UID: "3b372dbe-3ecb-47cd-94ed-51c298ebbdd4") : secret "samples-operator-tls" not found Jun 12 21:47:34.399386 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:34.399351 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fll8d" event={"ID":"d1f254fe-4106-41d6-8295-5711c5e1dd6c","Type":"ContainerStarted","Data":"b7f972e73f533a11318d5a3a505eb735df73f89ff74ef98314223d037b3ca68c"} Jun 12 21:47:34.413993 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:34.413952 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-fll8d" podStartSLOduration=1.2831301960000001 podStartE2EDuration="2.413915168s" totalImagesPullingTime="1.130784972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:47:34.412419254 +0000 UTC m=+241.136702518" watchObservedRunningTime="2026-06-12 21:47:34.413915168 +0000 UTC m=+241.138198418" Jun 12 21:47:35.405944 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:35.405915 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vtz7b_15c9555f-ff57-4466-8a1d-afe9996ba621/console-operator/0.log" Jun 12 21:47:35.406273 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:35.405951 2563 generic.go:356] "Generic (PLEG): container finished" podID="15c9555f-ff57-4466-8a1d-afe9996ba621" containerID="6f1c56088134370b6a1c004ddc33161770e8dfa7b96b119780a26733dff9f545" exitCode=255 Jun 12 21:47:35.406273 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:35.405982 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" event={"ID":"15c9555f-ff57-4466-8a1d-afe9996ba621","Type":"ContainerDied","Data":"6f1c56088134370b6a1c004ddc33161770e8dfa7b96b119780a26733dff9f545"} Jun 12 21:47:35.406341 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:35.406288 2563 scope.go:117] "RemoveContainer" containerID="6f1c56088134370b6a1c004ddc33161770e8dfa7b96b119780a26733dff9f545" Jun 12 21:47:35.826827 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:35.826800 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-7jjnk\" (UID: \"3b372dbe-3ecb-47cd-94ed-51c298ebbdd4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk" Jun 12 21:47:35.826948 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:35.826936 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 21:47:35.827003 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:35.826993 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls podName:3b372dbe-3ecb-47cd-94ed-51c298ebbdd4 nodeName:}" failed. No retries permitted until 2026-06-12 21:47:39.826979077 +0000 UTC m=+246.551262305 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls") pod "cluster-samples-operator-9547488fd-7jjnk" (UID: "3b372dbe-3ecb-47cd-94ed-51c298ebbdd4") : secret "samples-operator-tls" not found Jun 12 21:47:36.410156 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.410130 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vtz7b_15c9555f-ff57-4466-8a1d-afe9996ba621/console-operator/1.log" Jun 12 21:47:36.410554 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.410514 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vtz7b_15c9555f-ff57-4466-8a1d-afe9996ba621/console-operator/0.log" Jun 12 21:47:36.410554 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.410543 2563 generic.go:356] "Generic (PLEG): container finished" podID="15c9555f-ff57-4466-8a1d-afe9996ba621" containerID="8c5220c41c6ba10997568651641c22466c6e63f65f3342ef0f62bd99f9f4ef50" exitCode=255 Jun 12 21:47:36.410628 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.410571 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" event={"ID":"15c9555f-ff57-4466-8a1d-afe9996ba621","Type":"ContainerDied","Data":"8c5220c41c6ba10997568651641c22466c6e63f65f3342ef0f62bd99f9f4ef50"} Jun 12 21:47:36.410680 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.410633 2563 scope.go:117] "RemoveContainer" containerID="6f1c56088134370b6a1c004ddc33161770e8dfa7b96b119780a26733dff9f545" Jun 12 21:47:36.410854 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.410838 2563 scope.go:117] "RemoveContainer" containerID="8c5220c41c6ba10997568651641c22466c6e63f65f3342ef0f62bd99f9f4ef50" Jun 12 21:47:36.411005 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:36.410981 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-vtz7b_openshift-console-operator(15c9555f-ff57-4466-8a1d-afe9996ba621)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" podUID="15c9555f-ff57-4466-8a1d-afe9996ba621" Jun 12 21:47:36.856275 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.856244 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rxh2m"] Jun 12 21:47:36.860372 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.860345 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:36.862235 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.862214 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 21:47:36.862360 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.862218 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7px2z\"" Jun 12 21:47:36.862360 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.862314 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 21:47:36.862794 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.862779 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 21:47:36.863087 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.863074 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 21:47:36.871530 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.871508 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rxh2m"] Jun 12 21:47:36.934608 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.934586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebdeff48-8dd7-4b34-89f0-a87effa678e5-crio-socket\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:36.934725 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.934624 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:36.934725 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.934655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebdeff48-8dd7-4b34-89f0-a87effa678e5-data-volume\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:36.934815 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.934726 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:36.934815 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:36.934743 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shq48\" (UniqueName: \"kubernetes.io/projected/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-api-access-shq48\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:37.035539 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.035518 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebdeff48-8dd7-4b34-89f0-a87effa678e5-crio-socket\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:37.035612 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.035553 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:37.035612 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.035584 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebdeff48-8dd7-4b34-89f0-a87effa678e5-data-volume\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:37.035711 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.035630 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebdeff48-8dd7-4b34-89f0-a87effa678e5-crio-socket\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:37.035711 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:37.035637 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 21:47:37.035711 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.035654 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:37.035711 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.035696 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shq48\" (UniqueName: \"kubernetes.io/projected/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-api-access-shq48\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:37.035886 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:37.035714 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm podName:ebdeff48-8dd7-4b34-89f0-a87effa678e5 nodeName:}" failed. No retries permitted until 2026-06-12 21:47:37.535701307 +0000 UTC m=+244.259984539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rxh2m" (UID: "ebdeff48-8dd7-4b34-89f0-a87effa678e5") : configmap "kube-rbac-proxy" not found Jun 12 21:47:37.035886 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:37.035767 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 21:47:37.035886 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:37.035833 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls podName:ebdeff48-8dd7-4b34-89f0-a87effa678e5 nodeName:}" failed. No retries permitted until 2026-06-12 21:47:37.535815553 +0000 UTC m=+244.260098785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rxh2m" (UID: "ebdeff48-8dd7-4b34-89f0-a87effa678e5") : secret "insights-runtime-extractor-tls" not found Jun 12 21:47:37.035886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.035849 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebdeff48-8dd7-4b34-89f0-a87effa678e5-data-volume\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:37.043102 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.043086 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shq48\" (UniqueName: \"kubernetes.io/projected/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-api-access-shq48\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:37.414567 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.414549 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vtz7b_15c9555f-ff57-4466-8a1d-afe9996ba621/console-operator/1.log" Jun 12 21:47:37.414994 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.414823 2563 scope.go:117] "RemoveContainer" containerID="8c5220c41c6ba10997568651641c22466c6e63f65f3342ef0f62bd99f9f4ef50" Jun 12 21:47:37.414994 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:37.414944 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-vtz7b_openshift-console-operator(15c9555f-ff57-4466-8a1d-afe9996ba621)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" podUID="15c9555f-ff57-4466-8a1d-afe9996ba621" Jun 12 21:47:37.495581 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.495557 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-d9v9b"] Jun 12 21:47:37.498479 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.498464 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-d9v9b" Jun 12 21:47:37.500409 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.500391 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 12 21:47:37.500485 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.500409 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 12 21:47:37.500485 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.500441 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jq7nb\"" Jun 12 21:47:37.505453 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.505435 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-d9v9b"] Jun 12 21:47:37.538729 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.538712 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:37.538823 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.538750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4wjj\" (UniqueName: \"kubernetes.io/projected/5b7f3281-1bb5-41b2-b316-c4a482a4d175-kube-api-access-f4wjj\") pod \"migrator-d4bcd4867-d9v9b\" (UID: \"5b7f3281-1bb5-41b2-b316-c4a482a4d175\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-d9v9b" Jun 12 21:47:37.538823 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.538790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:37.538898 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:37.538842 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 21:47:37.538898 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:37.538886 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls podName:ebdeff48-8dd7-4b34-89f0-a87effa678e5 nodeName:}" failed. No retries permitted until 2026-06-12 21:47:38.538873332 +0000 UTC m=+245.263156564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rxh2m" (UID: "ebdeff48-8dd7-4b34-89f0-a87effa678e5") : secret "insights-runtime-extractor-tls" not found Jun 12 21:47:37.538898 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:37.538886 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 21:47:37.538999 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:37.538924 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm podName:ebdeff48-8dd7-4b34-89f0-a87effa678e5 nodeName:}" failed. No retries permitted until 2026-06-12 21:47:38.538913009 +0000 UTC m=+245.263196238 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rxh2m" (UID: "ebdeff48-8dd7-4b34-89f0-a87effa678e5") : configmap "kube-rbac-proxy" not found Jun 12 21:47:37.639101 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.639079 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4wjj\" (UniqueName: \"kubernetes.io/projected/5b7f3281-1bb5-41b2-b316-c4a482a4d175-kube-api-access-f4wjj\") pod \"migrator-d4bcd4867-d9v9b\" (UID: \"5b7f3281-1bb5-41b2-b316-c4a482a4d175\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-d9v9b" Jun 12 21:47:37.646839 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.646813 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4wjj\" (UniqueName: \"kubernetes.io/projected/5b7f3281-1bb5-41b2-b316-c4a482a4d175-kube-api-access-f4wjj\") pod \"migrator-d4bcd4867-d9v9b\" (UID: \"5b7f3281-1bb5-41b2-b316-c4a482a4d175\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-d9v9b" Jun 12 21:47:37.808039 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.807993 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-d9v9b" Jun 12 21:47:37.924870 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:37.924844 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-d9v9b"] Jun 12 21:47:37.928762 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:47:37.928735 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7f3281_1bb5_41b2_b316_c4a482a4d175.slice/crio-d1ea8bad4dc8e397b8e80317dad2ab2c1866af9cb52a65c5bfd337873340dd6f WatchSource:0}: Error finding container d1ea8bad4dc8e397b8e80317dad2ab2c1866af9cb52a65c5bfd337873340dd6f: Status 404 returned error can't find the container with id d1ea8bad4dc8e397b8e80317dad2ab2c1866af9cb52a65c5bfd337873340dd6f Jun 12 21:47:38.417833 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:38.417810 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-d9v9b" event={"ID":"5b7f3281-1bb5-41b2-b316-c4a482a4d175","Type":"ContainerStarted","Data":"d1ea8bad4dc8e397b8e80317dad2ab2c1866af9cb52a65c5bfd337873340dd6f"} Jun 12 21:47:38.544546 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:38.544510 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:38.544721 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:38.544637 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:38.544721 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:38.544648 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 21:47:38.544853 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:38.544726 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm podName:ebdeff48-8dd7-4b34-89f0-a87effa678e5 nodeName:}" failed. No retries permitted until 2026-06-12 21:47:40.544708569 +0000 UTC m=+247.268991811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rxh2m" (UID: "ebdeff48-8dd7-4b34-89f0-a87effa678e5") : configmap "kube-rbac-proxy" not found Jun 12 21:47:38.544853 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:38.544778 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 21:47:38.544853 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:38.544834 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls podName:ebdeff48-8dd7-4b34-89f0-a87effa678e5 nodeName:}" failed. No retries permitted until 2026-06-12 21:47:40.544818175 +0000 UTC m=+247.269101406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rxh2m" (UID: "ebdeff48-8dd7-4b34-89f0-a87effa678e5") : secret "insights-runtime-extractor-tls" not found Jun 12 21:47:38.858280 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:38.858252 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n2rwp_3cd3425f-322c-481d-bcdc-cbc7a9676764/dns-node-resolver/0.log" Jun 12 21:47:38.868546 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:38.868521 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-6mfkq"] Jun 12 21:47:38.871839 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:38.871817 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-6mfkq" Jun 12 21:47:38.874194 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:38.874138 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-c8twn\"" Jun 12 21:47:38.874194 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:38.874149 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 12 21:47:38.874582 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:38.874562 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 12 21:47:38.874703 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:38.874634 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 12 21:47:38.874703 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:38.874648 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 12 21:47:38.881810 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:38.881790 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-6mfkq"] Jun 12 21:47:38.948191 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:38.948157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0b094c0b-b129-46dd-9952-99a170087493-signing-key\") pod \"service-ca-7b994bc59-6mfkq\" (UID: \"0b094c0b-b129-46dd-9952-99a170087493\") " pod="openshift-service-ca/service-ca-7b994bc59-6mfkq" Jun 12 21:47:38.948324 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:38.948283 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0b094c0b-b129-46dd-9952-99a170087493-signing-cabundle\") pod \"service-ca-7b994bc59-6mfkq\" (UID: \"0b094c0b-b129-46dd-9952-99a170087493\") " pod="openshift-service-ca/service-ca-7b994bc59-6mfkq" Jun 12 21:47:38.948389 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:38.948338 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfkmx\" (UniqueName: \"kubernetes.io/projected/0b094c0b-b129-46dd-9952-99a170087493-kube-api-access-hfkmx\") pod \"service-ca-7b994bc59-6mfkq\" (UID: \"0b094c0b-b129-46dd-9952-99a170087493\") " pod="openshift-service-ca/service-ca-7b994bc59-6mfkq" Jun 12 21:47:39.048877 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:39.048859 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0b094c0b-b129-46dd-9952-99a170087493-signing-cabundle\") pod \"service-ca-7b994bc59-6mfkq\" (UID: \"0b094c0b-b129-46dd-9952-99a170087493\") " pod="openshift-service-ca/service-ca-7b994bc59-6mfkq" Jun 12 21:47:39.048980 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:39.048899 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfkmx\" (UniqueName: \"kubernetes.io/projected/0b094c0b-b129-46dd-9952-99a170087493-kube-api-access-hfkmx\") pod \"service-ca-7b994bc59-6mfkq\" (UID: \"0b094c0b-b129-46dd-9952-99a170087493\") " pod="openshift-service-ca/service-ca-7b994bc59-6mfkq" Jun 12 21:47:39.048980 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:39.048969 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0b094c0b-b129-46dd-9952-99a170087493-signing-key\") pod \"service-ca-7b994bc59-6mfkq\" (UID: \"0b094c0b-b129-46dd-9952-99a170087493\") " pod="openshift-service-ca/service-ca-7b994bc59-6mfkq" Jun 12 21:47:39.049437 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:39.049417 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0b094c0b-b129-46dd-9952-99a170087493-signing-cabundle\") pod \"service-ca-7b994bc59-6mfkq\" (UID: \"0b094c0b-b129-46dd-9952-99a170087493\") " pod="openshift-service-ca/service-ca-7b994bc59-6mfkq" Jun 12 21:47:39.051102 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:39.051028 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0b094c0b-b129-46dd-9952-99a170087493-signing-key\") pod \"service-ca-7b994bc59-6mfkq\" (UID: \"0b094c0b-b129-46dd-9952-99a170087493\") " pod="openshift-service-ca/service-ca-7b994bc59-6mfkq" Jun 12 21:47:39.056787 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:39.056768 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfkmx\" (UniqueName: \"kubernetes.io/projected/0b094c0b-b129-46dd-9952-99a170087493-kube-api-access-hfkmx\") pod \"service-ca-7b994bc59-6mfkq\" (UID: \"0b094c0b-b129-46dd-9952-99a170087493\") " pod="openshift-service-ca/service-ca-7b994bc59-6mfkq" Jun 12 21:47:39.183254 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:39.183232 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-6mfkq" Jun 12 21:47:39.298596 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:39.298570 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-6mfkq"] Jun 12 21:47:39.301943 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:47:39.301917 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b094c0b_b129_46dd_9952_99a170087493.slice/crio-c65d46b57e8b0e3d2215b22a24bc5aab7b445886b6dbe7b455a1a5f6436f4b42 WatchSource:0}: Error finding container c65d46b57e8b0e3d2215b22a24bc5aab7b445886b6dbe7b455a1a5f6436f4b42: Status 404 returned error can't find the container with id c65d46b57e8b0e3d2215b22a24bc5aab7b445886b6dbe7b455a1a5f6436f4b42 Jun 12 21:47:39.422830 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:39.422771 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-d9v9b" event={"ID":"5b7f3281-1bb5-41b2-b316-c4a482a4d175","Type":"ContainerStarted","Data":"b8e07a46ec1888230881c1e8d7f2146a8bbea1b87a36d20ac2b67b8c649e4bd1"} Jun 12 21:47:39.422830 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:39.422819 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-d9v9b" event={"ID":"5b7f3281-1bb5-41b2-b316-c4a482a4d175","Type":"ContainerStarted","Data":"fcad725ff562ba82a08d3b04e74847c9beba00ae8ab461e442172516f8ecf089"} Jun 12 21:47:39.423825 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:39.423807 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-6mfkq" event={"ID":"0b094c0b-b129-46dd-9952-99a170087493","Type":"ContainerStarted","Data":"c65d46b57e8b0e3d2215b22a24bc5aab7b445886b6dbe7b455a1a5f6436f4b42"} Jun 12 21:47:39.439323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:39.439285 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-d9v9b" podStartSLOduration=1.365426883 podStartE2EDuration="2.439273383s" totalImagesPullingTime="1.0738465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:47:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:47:39.438541596 +0000 UTC m=+246.162824842" watchObservedRunningTime="2026-06-12 21:47:39.439273383 +0000 UTC m=+246.163556632" Jun 12 21:47:39.653034 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:39.653013 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jjhkm_9a539c62-3abf-4aa8-af59-c5193cd47800/node-ca/0.log" Jun 12 21:47:39.855863 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:39.855831 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-7jjnk\" (UID: \"3b372dbe-3ecb-47cd-94ed-51c298ebbdd4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk" Jun 12 21:47:39.856044 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:39.856004 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 12 21:47:39.856099 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:39.856072 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls podName:3b372dbe-3ecb-47cd-94ed-51c298ebbdd4 nodeName:}" failed. No retries permitted until 2026-06-12 21:47:47.856052668 +0000 UTC m=+254.580335902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls") pod "cluster-samples-operator-9547488fd-7jjnk" (UID: "3b372dbe-3ecb-47cd-94ed-51c298ebbdd4") : secret "samples-operator-tls" not found Jun 12 21:47:40.452600 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:40.452568 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b2hff_91a20919-5d74-44b4-b238-7238a4e5f890/serve-healthcheck-canary/0.log" Jun 12 21:47:40.561283 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:40.561248 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:40.561453 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:40.561360 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:40.561453 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:40.561369 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 21:47:40.561453 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:40.561440 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm podName:ebdeff48-8dd7-4b34-89f0-a87effa678e5 nodeName:}" failed. No retries permitted until 2026-06-12 21:47:44.561420846 +0000 UTC m=+251.285704086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rxh2m" (UID: "ebdeff48-8dd7-4b34-89f0-a87effa678e5") : configmap "kube-rbac-proxy" not found Jun 12 21:47:40.561585 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:40.561482 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 21:47:40.561585 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:40.561545 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls podName:ebdeff48-8dd7-4b34-89f0-a87effa678e5 nodeName:}" failed. No retries permitted until 2026-06-12 21:47:44.561528426 +0000 UTC m=+251.285811656 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rxh2m" (UID: "ebdeff48-8dd7-4b34-89f0-a87effa678e5") : secret "insights-runtime-extractor-tls" not found Jun 12 21:47:41.431536 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:41.431504 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-6mfkq" event={"ID":"0b094c0b-b129-46dd-9952-99a170087493","Type":"ContainerStarted","Data":"08ff428541ee2b32183f933b5d9d1216e4032ec355c6bc5b1ff35c185508a7c8"} Jun 12 21:47:41.445487 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:41.445435 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-6mfkq" podStartSLOduration=1.82887959 podStartE2EDuration="3.445415614s" totalImagesPullingTime="1.616536024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:47:41.444036487 +0000 UTC m=+248.168319736" watchObservedRunningTime="2026-06-12 21:47:41.445415614 +0000 UTC m=+248.169698868" Jun 12 21:47:42.455488 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:42.455401 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:42.455488 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:42.455487 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:42.456011 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:42.455844 2563 scope.go:117] "RemoveContainer" containerID="8c5220c41c6ba10997568651641c22466c6e63f65f3342ef0f62bd99f9f4ef50" Jun 12 21:47:42.456068 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:42.456003 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-vtz7b_openshift-console-operator(15c9555f-ff57-4466-8a1d-afe9996ba621)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" podUID="15c9555f-ff57-4466-8a1d-afe9996ba621" Jun 12 21:47:44.592312 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:44.592278 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:44.592794 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:44.592388 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 21:47:44.592794 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:44.592449 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm podName:ebdeff48-8dd7-4b34-89f0-a87effa678e5 nodeName:}" failed. No retries permitted until 2026-06-12 21:47:52.592434508 +0000 UTC m=+259.316717735 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rxh2m" (UID: "ebdeff48-8dd7-4b34-89f0-a87effa678e5") : configmap "kube-rbac-proxy" not found Jun 12 21:47:44.592794 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:44.592390 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:44.592794 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:44.592486 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 21:47:44.592794 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:44.592541 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls podName:ebdeff48-8dd7-4b34-89f0-a87effa678e5 nodeName:}" failed. No retries permitted until 2026-06-12 21:47:52.592524506 +0000 UTC m=+259.316807735 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rxh2m" (UID: "ebdeff48-8dd7-4b34-89f0-a87effa678e5") : secret "insights-runtime-extractor-tls" not found Jun 12 21:47:45.599945 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:45.599913 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs\") pod \"network-metrics-daemon-kcq4r\" (UID: \"a8029f62-78fe-46b2-8587-0c150c839d9c\") " pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:47:45.600377 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:45.600070 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 21:47:45.600377 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:45.600138 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs podName:a8029f62-78fe-46b2-8587-0c150c839d9c nodeName:}" failed. No retries permitted until 2026-06-12 21:49:47.600119027 +0000 UTC m=+374.324402261 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs") pod "network-metrics-daemon-kcq4r" (UID: "a8029f62-78fe-46b2-8587-0c150c839d9c") : secret "metrics-daemon-secret" not found Jun 12 21:47:47.918347 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:47.918312 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-7jjnk\" (UID: \"3b372dbe-3ecb-47cd-94ed-51c298ebbdd4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk" Jun 12 21:47:47.920758 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:47.920729 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b372dbe-3ecb-47cd-94ed-51c298ebbdd4-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-7jjnk\" (UID: \"3b372dbe-3ecb-47cd-94ed-51c298ebbdd4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk" Jun 12 21:47:48.062262 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:48.062238 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mqz22\"" Jun 12 21:47:48.070711 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:48.070693 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk" Jun 12 21:47:48.192120 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:48.192047 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk"] Jun 12 21:47:48.454126 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:48.454057 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk" event={"ID":"3b372dbe-3ecb-47cd-94ed-51c298ebbdd4","Type":"ContainerStarted","Data":"af807c358612ee4fb249df57190383fe3e09c323ea2fbb96ea468db73bfb4f7b"} Jun 12 21:47:50.461628 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:50.461548 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk" event={"ID":"3b372dbe-3ecb-47cd-94ed-51c298ebbdd4","Type":"ContainerStarted","Data":"978746813aafc3c14c7bf7350ade7284f6906fee15cb0b9bb1937560a825d14d"} Jun 12 21:47:50.461628 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:50.461608 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk" event={"ID":"3b372dbe-3ecb-47cd-94ed-51c298ebbdd4","Type":"ContainerStarted","Data":"d8da1e54a8d4ad69fc57406fff1b969275c88d2474f0ea7ac75aaf89b137bb9e"} Jun 12 21:47:50.476973 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:50.476929 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-7jjnk" podStartSLOduration=16.890100156 podStartE2EDuration="18.476916036s" totalImagesPullingTime="1.58681588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:47:50.475441012 +0000 UTC m=+257.199724264" watchObservedRunningTime="2026-06-12 21:47:50.476916036 +0000 UTC m=+257.201199286" Jun 12 21:47:52.654817 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:52.654787 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:52.655155 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:52.654883 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:52.655155 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:52.654988 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 21:47:52.655155 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:47:52.655051 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls podName:ebdeff48-8dd7-4b34-89f0-a87effa678e5 nodeName:}" failed. No retries permitted until 2026-06-12 21:48:08.655032392 +0000 UTC m=+275.379315643 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rxh2m" (UID: "ebdeff48-8dd7-4b34-89f0-a87effa678e5") : secret "insights-runtime-extractor-tls" not found Jun 12 21:47:52.655369 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:52.655348 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebdeff48-8dd7-4b34-89f0-a87effa678e5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:47:53.691125 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:53.691098 2563 scope.go:117] "RemoveContainer" containerID="8c5220c41c6ba10997568651641c22466c6e63f65f3342ef0f62bd99f9f4ef50" Jun 12 21:47:54.479195 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:54.479170 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vtz7b_15c9555f-ff57-4466-8a1d-afe9996ba621/console-operator/1.log" Jun 12 21:47:54.479350 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:54.479244 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" event={"ID":"15c9555f-ff57-4466-8a1d-afe9996ba621","Type":"ContainerStarted","Data":"a1511287408a811ebbe519cfe24d3f50f0268dc1bdcf4fc35e8a65906354e56f"} Jun 12 21:47:54.479533 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:54.479515 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:54.483872 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:54.483848 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" Jun 12 21:47:54.494838 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:47:54.494799 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-vtz7b" podStartSLOduration=20.330326642 podStartE2EDuration="22.494787972s" totalImagesPullingTime="2.16446133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:47:54.49337107 +0000 UTC m=+261.217654322" watchObservedRunningTime="2026-06-12 21:47:54.494787972 +0000 UTC m=+261.219071281" Jun 12 21:48:02.402389 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:02.400742 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-h8b6l"] Jun 12 21:48:02.406052 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:02.406029 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-h8b6l" Jun 12 21:48:02.407905 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:02.407884 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 12 21:48:02.407989 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:02.407884 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 12 21:48:02.407989 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:02.407937 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hs5c4\"" Jun 12 21:48:02.413081 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:02.413057 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-h8b6l"] Jun 12 21:48:02.527139 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:02.527114 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fb64\" (UniqueName: \"kubernetes.io/projected/c72f6610-122b-4b79-b186-fd68ea6d475c-kube-api-access-5fb64\") pod \"downloads-694c955b9-h8b6l\" (UID: \"c72f6610-122b-4b79-b186-fd68ea6d475c\") " pod="openshift-console/downloads-694c955b9-h8b6l" Jun 12 21:48:02.627484 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:02.627457 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fb64\" (UniqueName: \"kubernetes.io/projected/c72f6610-122b-4b79-b186-fd68ea6d475c-kube-api-access-5fb64\") pod \"downloads-694c955b9-h8b6l\" (UID: \"c72f6610-122b-4b79-b186-fd68ea6d475c\") " pod="openshift-console/downloads-694c955b9-h8b6l" Jun 12 21:48:02.636342 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:02.636312 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fb64\" (UniqueName: \"kubernetes.io/projected/c72f6610-122b-4b79-b186-fd68ea6d475c-kube-api-access-5fb64\") pod \"downloads-694c955b9-h8b6l\" (UID: \"c72f6610-122b-4b79-b186-fd68ea6d475c\") " pod="openshift-console/downloads-694c955b9-h8b6l" Jun 12 21:48:02.714622 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:02.714572 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-h8b6l" Jun 12 21:48:02.837084 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:02.837057 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-h8b6l"] Jun 12 21:48:02.839610 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:48:02.839586 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72f6610_122b_4b79_b186_fd68ea6d475c.slice/crio-25fc102241a4af339bd1c04526c053c42b38f883bef8fe640b63d5bd8c0e79ac WatchSource:0}: Error finding container 25fc102241a4af339bd1c04526c053c42b38f883bef8fe640b63d5bd8c0e79ac: Status 404 returned error can't find the container with id 25fc102241a4af339bd1c04526c053c42b38f883bef8fe640b63d5bd8c0e79ac Jun 12 21:48:03.507010 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:03.506970 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-h8b6l" event={"ID":"c72f6610-122b-4b79-b186-fd68ea6d475c","Type":"ContainerStarted","Data":"25fc102241a4af339bd1c04526c053c42b38f883bef8fe640b63d5bd8c0e79ac"} Jun 12 21:48:07.403449 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:07.403415 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-nw7p6"] Jun 12 21:48:07.412314 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:07.412286 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-nw7p6" Jun 12 21:48:07.412781 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:07.412294 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-nw7p6"] Jun 12 21:48:07.414189 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:07.414126 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 12 21:48:07.414523 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:07.414503 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kr785\"" Jun 12 21:48:07.563124 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:07.563096 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cf9fb8bb-8e87-4e6f-b373-41cedc968a4d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-nw7p6\" (UID: \"cf9fb8bb-8e87-4e6f-b373-41cedc968a4d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-nw7p6" Jun 12 21:48:07.663982 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:07.663912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cf9fb8bb-8e87-4e6f-b373-41cedc968a4d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-nw7p6\" (UID: \"cf9fb8bb-8e87-4e6f-b373-41cedc968a4d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-nw7p6" Jun 12 21:48:07.666623 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:07.666597 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cf9fb8bb-8e87-4e6f-b373-41cedc968a4d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-nw7p6\" (UID: \"cf9fb8bb-8e87-4e6f-b373-41cedc968a4d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-nw7p6" Jun 12 21:48:07.723944 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:07.723905 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-nw7p6" Jun 12 21:48:07.855631 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:07.855599 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-nw7p6"] Jun 12 21:48:07.858392 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:48:07.858367 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf9fb8bb_8e87_4e6f_b373_41cedc968a4d.slice/crio-2ae58a9a25167d3b41f16d0e6ee45c4888f320466567de102f897ded50acd575 WatchSource:0}: Error finding container 2ae58a9a25167d3b41f16d0e6ee45c4888f320466567de102f897ded50acd575: Status 404 returned error can't find the container with id 2ae58a9a25167d3b41f16d0e6ee45c4888f320466567de102f897ded50acd575 Jun 12 21:48:08.524193 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:08.524154 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-nw7p6" event={"ID":"cf9fb8bb-8e87-4e6f-b373-41cedc968a4d","Type":"ContainerStarted","Data":"2ae58a9a25167d3b41f16d0e6ee45c4888f320466567de102f897ded50acd575"} Jun 12 21:48:08.672643 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:08.672599 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:48:08.675542 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:08.675484 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebdeff48-8dd7-4b34-89f0-a87effa678e5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxh2m\" (UID: \"ebdeff48-8dd7-4b34-89f0-a87effa678e5\") " pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:48:08.969711 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:08.969682 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rxh2m" Jun 12 21:48:09.113649 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:09.113616 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rxh2m"] Jun 12 21:48:09.118416 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:48:09.118386 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebdeff48_8dd7_4b34_89f0_a87effa678e5.slice/crio-cf255cb4be507b840e4abd1aa072b4f14c9662072586cdba3e01057deee8663f WatchSource:0}: Error finding container cf255cb4be507b840e4abd1aa072b4f14c9662072586cdba3e01057deee8663f: Status 404 returned error can't find the container with id cf255cb4be507b840e4abd1aa072b4f14c9662072586cdba3e01057deee8663f Jun 12 21:48:09.531633 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:09.531592 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rxh2m" event={"ID":"ebdeff48-8dd7-4b34-89f0-a87effa678e5","Type":"ContainerStarted","Data":"cf255cb4be507b840e4abd1aa072b4f14c9662072586cdba3e01057deee8663f"} Jun 12 21:48:09.536301 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:09.535462 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-nw7p6" event={"ID":"cf9fb8bb-8e87-4e6f-b373-41cedc968a4d","Type":"ContainerStarted","Data":"72ed381a70a3728eb1fdc08e264cd0fcdd96cb67f9fd23e34a19b8a543b2451e"} Jun 12 21:48:09.536301 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:09.536197 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-nw7p6" Jun 12 21:48:09.543851 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:09.543829 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-nw7p6" Jun 12 21:48:09.554374 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:09.554319 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-nw7p6" podStartSLOduration=1.396565003 podStartE2EDuration="2.554301968s" totalImagesPullingTime="1.157736965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:48:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:48:09.553573388 +0000 UTC m=+276.277856631" watchObservedRunningTime="2026-06-12 21:48:09.554301968 +0000 UTC m=+276.278585220" Jun 12 21:48:10.462976 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.462944 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7"] Jun 12 21:48:10.465484 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.465456 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" Jun 12 21:48:10.468433 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.468409 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 21:48:10.468561 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.468465 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 21:48:10.469142 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.468631 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mkpml\"" Jun 12 21:48:10.469142 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.468410 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 21:48:10.469142 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.468861 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 12 21:48:10.469142 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.469011 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 12 21:48:10.474493 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.474469 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7"] Jun 12 21:48:10.589154 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.589120 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44g8n\" (UniqueName: \"kubernetes.io/projected/8b9d16a6-cb75-44c8-9dbc-cf9a82683fac-kube-api-access-44g8n\") pod \"prometheus-operator-864fcfc6f9-c8gl7\" (UID: \"8b9d16a6-cb75-44c8-9dbc-cf9a82683fac\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" Jun 12 21:48:10.589560 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.589177 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b9d16a6-cb75-44c8-9dbc-cf9a82683fac-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-c8gl7\" (UID: \"8b9d16a6-cb75-44c8-9dbc-cf9a82683fac\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" Jun 12 21:48:10.589560 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.589253 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b9d16a6-cb75-44c8-9dbc-cf9a82683fac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-c8gl7\" (UID: \"8b9d16a6-cb75-44c8-9dbc-cf9a82683fac\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" Jun 12 21:48:10.589560 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.589311 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b9d16a6-cb75-44c8-9dbc-cf9a82683fac-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-c8gl7\" (UID: \"8b9d16a6-cb75-44c8-9dbc-cf9a82683fac\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" Jun 12 21:48:10.690341 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.690297 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b9d16a6-cb75-44c8-9dbc-cf9a82683fac-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-c8gl7\" (UID: \"8b9d16a6-cb75-44c8-9dbc-cf9a82683fac\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" Jun 12 21:48:10.690517 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.690382 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44g8n\" (UniqueName: \"kubernetes.io/projected/8b9d16a6-cb75-44c8-9dbc-cf9a82683fac-kube-api-access-44g8n\") pod \"prometheus-operator-864fcfc6f9-c8gl7\" (UID: \"8b9d16a6-cb75-44c8-9dbc-cf9a82683fac\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" Jun 12 21:48:10.690517 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.690419 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b9d16a6-cb75-44c8-9dbc-cf9a82683fac-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-c8gl7\" (UID: \"8b9d16a6-cb75-44c8-9dbc-cf9a82683fac\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" Jun 12 21:48:10.690517 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.690465 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b9d16a6-cb75-44c8-9dbc-cf9a82683fac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-c8gl7\" (UID: \"8b9d16a6-cb75-44c8-9dbc-cf9a82683fac\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" Jun 12 21:48:10.691153 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.691129 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b9d16a6-cb75-44c8-9dbc-cf9a82683fac-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-c8gl7\" (UID: \"8b9d16a6-cb75-44c8-9dbc-cf9a82683fac\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" Jun 12 21:48:10.693719 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.693650 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b9d16a6-cb75-44c8-9dbc-cf9a82683fac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-c8gl7\" (UID: \"8b9d16a6-cb75-44c8-9dbc-cf9a82683fac\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" Jun 12 21:48:10.694423 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.694398 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b9d16a6-cb75-44c8-9dbc-cf9a82683fac-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-c8gl7\" (UID: \"8b9d16a6-cb75-44c8-9dbc-cf9a82683fac\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" Jun 12 21:48:10.697994 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.697969 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44g8n\" (UniqueName: \"kubernetes.io/projected/8b9d16a6-cb75-44c8-9dbc-cf9a82683fac-kube-api-access-44g8n\") pod \"prometheus-operator-864fcfc6f9-c8gl7\" (UID: \"8b9d16a6-cb75-44c8-9dbc-cf9a82683fac\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" Jun 12 21:48:10.779131 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:10.779063 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" Jun 12 21:48:12.976939 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:12.976915 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7"] Jun 12 21:48:12.980493 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:48:12.980462 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b9d16a6_cb75_44c8_9dbc_cf9a82683fac.slice/crio-9ebb6df2580c7ead320a040d8df8ec91a17185b8624cdff2b433431c3f7a8130 WatchSource:0}: Error finding container 9ebb6df2580c7ead320a040d8df8ec91a17185b8624cdff2b433431c3f7a8130: Status 404 returned error can't find the container with id 9ebb6df2580c7ead320a040d8df8ec91a17185b8624cdff2b433431c3f7a8130 Jun 12 21:48:13.558964 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:13.558928 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rxh2m" event={"ID":"ebdeff48-8dd7-4b34-89f0-a87effa678e5","Type":"ContainerStarted","Data":"9e44901077d8792e7656fadf10c59b3d014ca966101f26f04313d12dc6743166"} Jun 12 21:48:13.560263 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:13.560236 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" event={"ID":"8b9d16a6-cb75-44c8-9dbc-cf9a82683fac","Type":"ContainerStarted","Data":"9ebb6df2580c7ead320a040d8df8ec91a17185b8624cdff2b433431c3f7a8130"} Jun 12 21:48:15.207940 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:48:15.207894 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vgf7j" podUID="6fd56879-c834-4b56-be2d-b20295f24c56" Jun 12 21:48:15.207940 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:48:15.207913 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" podUID="7e6c3e41-23ae-4616-a236-48770e4b5462" Jun 12 21:48:15.207940 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:48:15.207918 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67655dfb86-drdz2" podUID="d98d8dfe-ae15-4606-acf8-2b1d55d48b9e" Jun 12 21:48:15.566868 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:15.566787 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:48:15.567031 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:15.566788 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vgf7j" Jun 12 21:48:15.567031 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:15.566788 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:48:19.164745 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:19.164709 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:48:19.165219 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:19.164766 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:48:19.165219 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:19.164970 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-dsh99\" (UID: \"7e6c3e41-23ae-4616-a236-48770e4b5462\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:48:19.167499 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:19.167470 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls\") pod \"image-registry-67655dfb86-drdz2\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:48:19.167596 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:19.167542 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fd56879-c834-4b56-be2d-b20295f24c56-metrics-tls\") pod \"dns-default-vgf7j\" (UID: \"6fd56879-c834-4b56-be2d-b20295f24c56\") " pod="openshift-dns/dns-default-vgf7j" Jun 12 21:48:19.167637 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:19.167608 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e6c3e41-23ae-4616-a236-48770e4b5462-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-dsh99\" (UID: \"7e6c3e41-23ae-4616-a236-48770e4b5462\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:48:19.469607 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:19.469521 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b2mnf\"" Jun 12 21:48:19.469607 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:19.469528 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fhwss\"" Jun 12 21:48:19.469607 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:19.469587 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hxwcc\"" Jun 12 21:48:19.478208 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:19.478181 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" Jun 12 21:48:19.478330 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:19.478218 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vgf7j" Jun 12 21:48:19.478330 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:19.478238 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:48:21.054857 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:21.054830 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67655dfb86-drdz2"] Jun 12 21:48:21.057701 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:48:21.057644 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd98d8dfe_ae15_4606_acf8_2b1d55d48b9e.slice/crio-695f576aba44947f5a1075e7b6cae53a5c848cd43c781e97659ddb6ccb76fa0d WatchSource:0}: Error finding container 695f576aba44947f5a1075e7b6cae53a5c848cd43c781e97659ddb6ccb76fa0d: Status 404 returned error can't find the container with id 695f576aba44947f5a1075e7b6cae53a5c848cd43c781e97659ddb6ccb76fa0d Jun 12 21:48:21.276364 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:21.276263 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-dsh99"] Jun 12 21:48:21.279035 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:21.278982 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vgf7j"] Jun 12 21:48:21.280048 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:48:21.280017 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e6c3e41_23ae_4616_a236_48770e4b5462.slice/crio-4553a11bb435e3354c28cdb0cfaca69643e211761dd6b156a4bab3d22759c552 WatchSource:0}: Error finding container 4553a11bb435e3354c28cdb0cfaca69643e211761dd6b156a4bab3d22759c552: Status 404 returned error can't find the container with id 4553a11bb435e3354c28cdb0cfaca69643e211761dd6b156a4bab3d22759c552 Jun 12 21:48:21.282874 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:48:21.282832 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd56879_c834_4b56_be2d_b20295f24c56.slice/crio-3f4b592af128b77e6a2e64f83fe47359ffcf418204594c0e5aae4e4cebff7ddd WatchSource:0}: Error finding container 3f4b592af128b77e6a2e64f83fe47359ffcf418204594c0e5aae4e4cebff7ddd: Status 404 returned error can't find the container with id 3f4b592af128b77e6a2e64f83fe47359ffcf418204594c0e5aae4e4cebff7ddd Jun 12 21:48:21.592184 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:21.591803 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" event={"ID":"8b9d16a6-cb75-44c8-9dbc-cf9a82683fac","Type":"ContainerStarted","Data":"44df41256992a173149c514930b90c2ac7c9bb72792a7e2aa664167700486c85"} Jun 12 21:48:21.592184 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:21.591866 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" event={"ID":"8b9d16a6-cb75-44c8-9dbc-cf9a82683fac","Type":"ContainerStarted","Data":"181111673e00df5a347472a230b3d9603520548017c0253547912420dd061994"} Jun 12 21:48:21.594629 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:21.594541 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67655dfb86-drdz2" event={"ID":"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e","Type":"ContainerStarted","Data":"b719208a54479192798d8cc8ee95b63613b7ec150ff909dad6a728747eed6c14"} Jun 12 21:48:21.594629 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:21.594588 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67655dfb86-drdz2" event={"ID":"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e","Type":"ContainerStarted","Data":"695f576aba44947f5a1075e7b6cae53a5c848cd43c781e97659ddb6ccb76fa0d"} Jun 12 21:48:21.594846 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:21.594808 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:48:21.597265 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:21.597235 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rxh2m" event={"ID":"ebdeff48-8dd7-4b34-89f0-a87effa678e5","Type":"ContainerStarted","Data":"eba11155ff19f301ca013c44dafe49500ff5338f1bfa0293c4f723f18f10eb1d"} Jun 12 21:48:21.601390 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:21.599346 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-h8b6l" event={"ID":"c72f6610-122b-4b79-b186-fd68ea6d475c","Type":"ContainerStarted","Data":"a6fe7339c3b9809cc940d0dbf4f5976b595a63edf506923aab02d4718391f994"} Jun 12 21:48:21.601596 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:21.601545 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-h8b6l" Jun 12 21:48:21.602916 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:21.602887 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vgf7j" event={"ID":"6fd56879-c834-4b56-be2d-b20295f24c56","Type":"ContainerStarted","Data":"3f4b592af128b77e6a2e64f83fe47359ffcf418204594c0e5aae4e4cebff7ddd"} Jun 12 21:48:21.604305 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:21.604283 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" event={"ID":"7e6c3e41-23ae-4616-a236-48770e4b5462","Type":"ContainerStarted","Data":"4553a11bb435e3354c28cdb0cfaca69643e211761dd6b156a4bab3d22759c552"} Jun 12 21:48:21.608450 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:21.608285 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-c8gl7" podStartSLOduration=3.7052300430000003 podStartE2EDuration="11.608269014s" totalImagesPullingTime="7.903038971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:48:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:48:21.608084101 +0000 UTC m=+288.332367351" watchObservedRunningTime="2026-06-12 21:48:21.608269014 +0000 UTC m=+288.332552267" Jun 12 21:48:21.612998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:21.612940 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-h8b6l" Jun 12 21:48:21.626752 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:21.626696 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67655dfb86-drdz2" podStartSLOduration=287.626678164 podStartE2EDuration="4m47.626678164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:43:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:48:21.625283805 +0000 UTC m=+288.349567056" watchObservedRunningTime="2026-06-12 21:48:21.626678164 +0000 UTC m=+288.350961407" Jun 12 21:48:21.642326 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:21.642085 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-h8b6l" podStartSLOduration=1.591763088 podStartE2EDuration="19.6420727s" totalImagesPullingTime="18.050309612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:48:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:48:21.641339434 +0000 UTC m=+288.365622684" watchObservedRunningTime="2026-06-12 21:48:21.6420727 +0000 UTC m=+288.366355950" Jun 12 21:48:23.798851 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.798816 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn"] Jun 12 21:48:23.812117 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.812091 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn"] Jun 12 21:48:23.812240 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.812216 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" Jun 12 21:48:23.814183 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.814160 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 12 21:48:23.814299 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.814236 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lxbsb\"" Jun 12 21:48:23.814507 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.814489 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 12 21:48:23.824578 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.824548 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z"] Jun 12 21:48:23.837205 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.837165 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gmmvl"] Jun 12 21:48:23.838447 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.838211 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:23.843632 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.841935 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 12 21:48:23.843632 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.842092 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 12 21:48:23.843632 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.842258 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 12 21:48:23.843632 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.842523 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7fvhr\"" Jun 12 21:48:23.854892 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.854517 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z"] Jun 12 21:48:23.854892 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.854646 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:23.857022 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.857003 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f5hq6\"" Jun 12 21:48:23.857357 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.857328 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 21:48:23.857711 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.857695 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 21:48:23.858052 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.858037 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 21:48:23.911257 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.910905 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9990ef7-4c89-4ff9-80a7-12a40414352a-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-v5mmn\" (UID: \"f9990ef7-4c89-4ff9-80a7-12a40414352a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" Jun 12 21:48:23.911257 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.910987 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m58f\" (UniqueName: \"kubernetes.io/projected/f9990ef7-4c89-4ff9-80a7-12a40414352a-kube-api-access-5m58f\") pod \"openshift-state-metrics-6b8d965dd5-v5mmn\" (UID: \"f9990ef7-4c89-4ff9-80a7-12a40414352a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" Jun 12 21:48:23.911257 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.911076 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9990ef7-4c89-4ff9-80a7-12a40414352a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-v5mmn\" (UID: \"f9990ef7-4c89-4ff9-80a7-12a40414352a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" Jun 12 21:48:23.911257 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:23.911147 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9990ef7-4c89-4ff9-80a7-12a40414352a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-v5mmn\" (UID: \"f9990ef7-4c89-4ff9-80a7-12a40414352a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" Jun 12 21:48:24.014488 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.011965 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.014488 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d5fd836-f36e-444c-92f1-1617e0be15c0-metrics-client-ca\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.014488 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012043 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fef94b62-8120-4bfd-8d2f-894dc07892f0-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.014488 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.014488 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012118 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m58f\" (UniqueName: \"kubernetes.io/projected/f9990ef7-4c89-4ff9-80a7-12a40414352a-kube-api-access-5m58f\") pod \"openshift-state-metrics-6b8d965dd5-v5mmn\" (UID: \"f9990ef7-4c89-4ff9-80a7-12a40414352a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" Jun 12 21:48:24.014488 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012177 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8d5fd836-f36e-444c-92f1-1617e0be15c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.014488 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txwg2\" (UniqueName: \"kubernetes.io/projected/8d5fd836-f36e-444c-92f1-1617e0be15c0-kube-api-access-txwg2\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.014488 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012262 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8d5fd836-f36e-444c-92f1-1617e0be15c0-node-exporter-tls\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.014488 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012291 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8d5fd836-f36e-444c-92f1-1617e0be15c0-root\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.014488 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012334 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9990ef7-4c89-4ff9-80a7-12a40414352a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-v5mmn\" (UID: \"f9990ef7-4c89-4ff9-80a7-12a40414352a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" Jun 12 21:48:24.014488 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012358 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grtzf\" (UniqueName: \"kubernetes.io/projected/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-api-access-grtzf\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.014488 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012382 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8d5fd836-f36e-444c-92f1-1617e0be15c0-node-exporter-textfile\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.014488 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012427 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8d5fd836-f36e-444c-92f1-1617e0be15c0-node-exporter-wtmp\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.014488 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012454 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fef94b62-8120-4bfd-8d2f-894dc07892f0-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.014488 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012481 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.015353 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012514 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d5fd836-f36e-444c-92f1-1617e0be15c0-sys\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.015353 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012557 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9990ef7-4c89-4ff9-80a7-12a40414352a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-v5mmn\" (UID: \"f9990ef7-4c89-4ff9-80a7-12a40414352a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" Jun 12 21:48:24.015353 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012589 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9990ef7-4c89-4ff9-80a7-12a40414352a-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-v5mmn\" (UID: \"f9990ef7-4c89-4ff9-80a7-12a40414352a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" Jun 12 21:48:24.015353 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.012613 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d5fd836-f36e-444c-92f1-1617e0be15c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.015353 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:48:24.013104 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 12 21:48:24.015353 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:48:24.013195 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9990ef7-4c89-4ff9-80a7-12a40414352a-openshift-state-metrics-tls podName:f9990ef7-4c89-4ff9-80a7-12a40414352a nodeName:}" failed. No retries permitted until 2026-06-12 21:48:24.513174101 +0000 UTC m=+291.237457332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f9990ef7-4c89-4ff9-80a7-12a40414352a-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-v5mmn" (UID: "f9990ef7-4c89-4ff9-80a7-12a40414352a") : secret "openshift-state-metrics-tls" not found Jun 12 21:48:24.015353 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.014412 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9990ef7-4c89-4ff9-80a7-12a40414352a-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-v5mmn\" (UID: \"f9990ef7-4c89-4ff9-80a7-12a40414352a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" Jun 12 21:48:24.018310 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.018283 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f9990ef7-4c89-4ff9-80a7-12a40414352a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-v5mmn\" (UID: \"f9990ef7-4c89-4ff9-80a7-12a40414352a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" Jun 12 21:48:24.029243 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.029219 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m58f\" (UniqueName: \"kubernetes.io/projected/f9990ef7-4c89-4ff9-80a7-12a40414352a-kube-api-access-5m58f\") pod \"openshift-state-metrics-6b8d965dd5-v5mmn\" (UID: \"f9990ef7-4c89-4ff9-80a7-12a40414352a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" Jun 12 21:48:24.113698 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.113299 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8d5fd836-f36e-444c-92f1-1617e0be15c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.113698 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.113345 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txwg2\" (UniqueName: \"kubernetes.io/projected/8d5fd836-f36e-444c-92f1-1617e0be15c0-kube-api-access-txwg2\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.113698 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.113377 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8d5fd836-f36e-444c-92f1-1617e0be15c0-node-exporter-tls\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.113698 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.113406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8d5fd836-f36e-444c-92f1-1617e0be15c0-root\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.113698 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.113464 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grtzf\" (UniqueName: \"kubernetes.io/projected/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-api-access-grtzf\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.113698 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.113487 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8d5fd836-f36e-444c-92f1-1617e0be15c0-node-exporter-textfile\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.113698 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.113517 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8d5fd836-f36e-444c-92f1-1617e0be15c0-node-exporter-wtmp\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.113698 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.113545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fef94b62-8120-4bfd-8d2f-894dc07892f0-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.113698 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.113604 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.113698 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.113634 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d5fd836-f36e-444c-92f1-1617e0be15c0-sys\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.114293 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.113719 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d5fd836-f36e-444c-92f1-1617e0be15c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.114293 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.113751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.114293 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.113798 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d5fd836-f36e-444c-92f1-1617e0be15c0-metrics-client-ca\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.114293 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.113825 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fef94b62-8120-4bfd-8d2f-894dc07892f0-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.114293 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.113852 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.114293 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:48:24.114014 2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 12 21:48:24.114293 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:48:24.114077 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-tls podName:fef94b62-8120-4bfd-8d2f-894dc07892f0 nodeName:}" failed. No retries permitted until 2026-06-12 21:48:24.614059671 +0000 UTC m=+291.338342902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-fbc9z" (UID: "fef94b62-8120-4bfd-8d2f-894dc07892f0") : secret "kube-state-metrics-tls" not found Jun 12 21:48:24.114293 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.114292 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8d5fd836-f36e-444c-92f1-1617e0be15c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.114730 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.114306 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8d5fd836-f36e-444c-92f1-1617e0be15c0-root\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.114730 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.114505 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d5fd836-f36e-444c-92f1-1617e0be15c0-sys\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.114836 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.114783 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8d5fd836-f36e-444c-92f1-1617e0be15c0-node-exporter-textfile\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.115830 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.114907 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8d5fd836-f36e-444c-92f1-1617e0be15c0-node-exporter-wtmp\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.115830 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.115553 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d5fd836-f36e-444c-92f1-1617e0be15c0-metrics-client-ca\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.115830 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.115576 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fef94b62-8120-4bfd-8d2f-894dc07892f0-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.116239 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.116212 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.116563 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.116478 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fef94b62-8120-4bfd-8d2f-894dc07892f0-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.120248 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.120217 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.120517 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.120498 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8d5fd836-f36e-444c-92f1-1617e0be15c0-node-exporter-tls\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.122316 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.121852 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d5fd836-f36e-444c-92f1-1617e0be15c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.126183 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.126136 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txwg2\" (UniqueName: \"kubernetes.io/projected/8d5fd836-f36e-444c-92f1-1617e0be15c0-kube-api-access-txwg2\") pod \"node-exporter-gmmvl\" (UID: \"8d5fd836-f36e-444c-92f1-1617e0be15c0\") " pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.129463 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.129417 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grtzf\" (UniqueName: \"kubernetes.io/projected/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-api-access-grtzf\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.168308 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.168122 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gmmvl" Jun 12 21:48:24.517646 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.517567 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9990ef7-4c89-4ff9-80a7-12a40414352a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-v5mmn\" (UID: \"f9990ef7-4c89-4ff9-80a7-12a40414352a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" Jun 12 21:48:24.520518 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.520485 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9990ef7-4c89-4ff9-80a7-12a40414352a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-v5mmn\" (UID: \"f9990ef7-4c89-4ff9-80a7-12a40414352a\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" Jun 12 21:48:24.618194 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.618143 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:24.618366 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:48:24.618321 2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 12 21:48:24.618441 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:48:24.618383 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-tls podName:fef94b62-8120-4bfd-8d2f-894dc07892f0 nodeName:}" failed. No retries permitted until 2026-06-12 21:48:25.618366103 +0000 UTC m=+292.342649334 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-fbc9z" (UID: "fef94b62-8120-4bfd-8d2f-894dc07892f0") : secret "kube-state-metrics-tls" not found Jun 12 21:48:24.725194 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.725160 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" Jun 12 21:48:24.875442 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.875416 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:48:24.888088 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.888066 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:24.891935 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.890172 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 21:48:24.891935 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.890286 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 21:48:24.891935 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.890291 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 21:48:24.891935 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.890376 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kbw8r\"" Jun 12 21:48:24.891935 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.890578 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 21:48:24.891935 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.890784 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 21:48:24.891935 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.890954 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 21:48:24.891935 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.891135 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 21:48:24.891935 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.891306 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 21:48:24.891935 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.891472 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 21:48:24.895985 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:24.895959 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:48:25.022057 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.022024 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-config-volume\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.022279 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.022253 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82898b91-be30-4076-a460-6e7288217c76-config-out\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.022353 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.022300 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82898b91-be30-4076-a460-6e7288217c76-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.022411 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.022373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.022475 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.022449 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/82898b91-be30-4076-a460-6e7288217c76-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.022539 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.022523 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.022595 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.022553 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-web-config\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.022650 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.022599 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.022650 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.022629 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz4mb\" (UniqueName: \"kubernetes.io/projected/82898b91-be30-4076-a460-6e7288217c76-kube-api-access-lz4mb\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.022770 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.022680 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.022770 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.022717 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82898b91-be30-4076-a460-6e7288217c76-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.022770 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.022754 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82898b91-be30-4076-a460-6e7288217c76-tls-assets\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.022914 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.022776 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.068817 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:48:25.068788 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5fd836_f36e_444c_92f1_1617e0be15c0.slice/crio-1993e64b35adff2c510e79c9886ceb4d7f001e8b786983740818bcfb649db7ce WatchSource:0}: Error finding container 1993e64b35adff2c510e79c9886ceb4d7f001e8b786983740818bcfb649db7ce: Status 404 returned error can't find the container with id 1993e64b35adff2c510e79c9886ceb4d7f001e8b786983740818bcfb649db7ce Jun 12 21:48:25.123789 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.123713 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/82898b91-be30-4076-a460-6e7288217c76-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.123789 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.123784 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.123966 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.123812 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-web-config\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.123966 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.123858 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.123966 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.123889 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz4mb\" (UniqueName: \"kubernetes.io/projected/82898b91-be30-4076-a460-6e7288217c76-kube-api-access-lz4mb\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.123966 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.123919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.123966 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.123949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82898b91-be30-4076-a460-6e7288217c76-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.124212 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.123994 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82898b91-be30-4076-a460-6e7288217c76-tls-assets\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.124212 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.124017 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.124212 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.124061 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-config-volume\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.124212 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.124089 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82898b91-be30-4076-a460-6e7288217c76-config-out\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.124212 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.124115 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82898b91-be30-4076-a460-6e7288217c76-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.124212 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.124157 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.127481 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:48:25.125556 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82898b91-be30-4076-a460-6e7288217c76-alertmanager-trusted-ca-bundle podName:82898b91-be30-4076-a460-6e7288217c76 nodeName:}" failed. No retries permitted until 2026-06-12 21:48:25.625533382 +0000 UTC m=+292.349816624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/82898b91-be30-4076-a460-6e7288217c76-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "82898b91-be30-4076-a460-6e7288217c76") : configmap references non-existent config key: ca-bundle.crt Jun 12 21:48:25.127481 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.126813 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82898b91-be30-4076-a460-6e7288217c76-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.129693 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.129516 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/82898b91-be30-4076-a460-6e7288217c76-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.129693 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.129633 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82898b91-be30-4076-a460-6e7288217c76-tls-assets\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.131238 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.131191 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.140250 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.139227 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.150825 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.147293 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz4mb\" (UniqueName: \"kubernetes.io/projected/82898b91-be30-4076-a460-6e7288217c76-kube-api-access-lz4mb\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.150825 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.147873 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82898b91-be30-4076-a460-6e7288217c76-config-out\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.150825 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.148318 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.150825 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.148756 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-web-config\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.150825 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.149216 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.150825 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.150526 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-config-volume\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.153051 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.152630 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.250004 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.249822 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn"] Jun 12 21:48:25.259275 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:48:25.258936 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9990ef7_4c89_4ff9_80a7_12a40414352a.slice/crio-2dbd6f415cf39551f39b5b592cea1404e2fa6d87e8e696f9ad34da897b2d07ee WatchSource:0}: Error finding container 2dbd6f415cf39551f39b5b592cea1404e2fa6d87e8e696f9ad34da897b2d07ee: Status 404 returned error can't find the container with id 2dbd6f415cf39551f39b5b592cea1404e2fa6d87e8e696f9ad34da897b2d07ee Jun 12 21:48:25.628922 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.628729 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vgf7j" event={"ID":"6fd56879-c834-4b56-be2d-b20295f24c56","Type":"ContainerStarted","Data":"222ef84b7cd7e19e725bf9d8098c4e00707b4fdb5d1f210bd23349780e70f1e4"} Jun 12 21:48:25.628922 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.628791 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vgf7j" event={"ID":"6fd56879-c834-4b56-be2d-b20295f24c56","Type":"ContainerStarted","Data":"0c54bd483bcb342afb6ccb14f01d1eed6cf34bbdea54bff5e7042fabb8afd267"} Jun 12 21:48:25.628922 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.628835 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vgf7j" Jun 12 21:48:25.631901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.631116 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:25.631901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.631196 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82898b91-be30-4076-a460-6e7288217c76-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.631901 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:48:25.631592 2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 12 21:48:25.631901 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:48:25.631653 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-tls podName:fef94b62-8120-4bfd-8d2f-894dc07892f0 nodeName:}" failed. No retries permitted until 2026-06-12 21:48:27.631635507 +0000 UTC m=+294.355918745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-fbc9z" (UID: "fef94b62-8120-4bfd-8d2f-894dc07892f0") : secret "kube-state-metrics-tls" not found Jun 12 21:48:25.632231 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.632148 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82898b91-be30-4076-a460-6e7288217c76-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.632590 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.632555 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" event={"ID":"7e6c3e41-23ae-4616-a236-48770e4b5462","Type":"ContainerStarted","Data":"7d2ad1cfefcd9135de207ceef28b1bec99ae2091f0936b987c5b114673adfa83"} Jun 12 21:48:25.637049 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.636961 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gmmvl" event={"ID":"8d5fd836-f36e-444c-92f1-1617e0be15c0","Type":"ContainerStarted","Data":"1993e64b35adff2c510e79c9886ceb4d7f001e8b786983740818bcfb649db7ce"} Jun 12 21:48:25.640234 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.640097 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" event={"ID":"f9990ef7-4c89-4ff9-80a7-12a40414352a","Type":"ContainerStarted","Data":"5702fe7d947cd206de9842c37187175faa2aacbdb6d97303de606a13b3fb8f73"} Jun 12 21:48:25.640234 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.640165 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" event={"ID":"f9990ef7-4c89-4ff9-80a7-12a40414352a","Type":"ContainerStarted","Data":"3d702104e25ad50cc54db628193f454b2df5f3ae818675905bc61211e6b3f842"} Jun 12 21:48:25.640234 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.640199 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" event={"ID":"f9990ef7-4c89-4ff9-80a7-12a40414352a","Type":"ContainerStarted","Data":"2dbd6f415cf39551f39b5b592cea1404e2fa6d87e8e696f9ad34da897b2d07ee"} Jun 12 21:48:25.642524 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.642442 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rxh2m" event={"ID":"ebdeff48-8dd7-4b34-89f0-a87effa678e5","Type":"ContainerStarted","Data":"bd2b8899ce5e38932c51b53e1a728832dbeffbd21f52074d076f682a9499c41e"} Jun 12 21:48:25.648500 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.648453 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vgf7j" podStartSLOduration=252.85956457 podStartE2EDuration="4m16.64843543s" totalImagesPullingTime="3.78887086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:48:25.646919178 +0000 UTC m=+292.371202428" watchObservedRunningTime="2026-06-12 21:48:25.64843543 +0000 UTC m=+292.372718680" Jun 12 21:48:25.662491 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.662131 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-dsh99" podStartSLOduration=287.876419211 podStartE2EDuration="4m51.662118899s" totalImagesPullingTime="3.785699688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:48:25.661602925 +0000 UTC m=+292.385886176" watchObservedRunningTime="2026-06-12 21:48:25.662118899 +0000 UTC m=+292.386402151" Jun 12 21:48:25.678940 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.678570 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rxh2m" podStartSLOduration=33.91457212 podStartE2EDuration="49.678552346s" totalImagesPullingTime="15.763980226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:47:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:48:25.676687585 +0000 UTC m=+292.400970828" watchObservedRunningTime="2026-06-12 21:48:25.678552346 +0000 UTC m=+292.402835597" Jun 12 21:48:25.803637 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.803594 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:48:25.804583 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.804558 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-d776c6f6-6vhdz"] Jun 12 21:48:25.829276 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.829251 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d776c6f6-6vhdz"] Jun 12 21:48:25.829397 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.829378 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:25.832140 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.831646 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 12 21:48:25.832140 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.831804 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 12 21:48:25.832140 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.831928 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 12 21:48:25.832140 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.831991 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 12 21:48:25.832140 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.832051 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-x7j2z\"" Jun 12 21:48:25.832140 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.832066 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 12 21:48:25.832594 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.832217 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c0vulughol2dh\"" Jun 12 21:48:25.935375 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.935065 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:25.935375 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.935109 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhtb6\" (UniqueName: \"kubernetes.io/projected/4e78eddd-2636-460b-9c15-5de0d00e5abd-kube-api-access-bhtb6\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:25.935375 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.935141 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:25.935375 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.935177 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:25.935375 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.935220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-thanos-querier-tls\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:25.936350 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.935797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-grpc-tls\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:25.936350 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.935841 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e78eddd-2636-460b-9c15-5de0d00e5abd-metrics-client-ca\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:25.936350 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.935890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:25.992121 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:25.992049 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:48:26.037256 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.037005 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:26.037256 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.037081 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:26.037256 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.037120 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhtb6\" (UniqueName: \"kubernetes.io/projected/4e78eddd-2636-460b-9c15-5de0d00e5abd-kube-api-access-bhtb6\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:26.037256 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.037155 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:26.037256 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.037195 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:26.037256 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.037236 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-thanos-querier-tls\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:26.037696 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.037288 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-grpc-tls\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:26.037696 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.037312 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e78eddd-2636-460b-9c15-5de0d00e5abd-metrics-client-ca\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:26.039708 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.038505 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e78eddd-2636-460b-9c15-5de0d00e5abd-metrics-client-ca\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:26.042189 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.042163 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-thanos-querier-tls\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:26.042862 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.042837 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:26.042985 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.042933 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:26.043255 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.043232 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:26.044185 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.044006 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-grpc-tls\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:26.045584 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.045537 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4e78eddd-2636-460b-9c15-5de0d00e5abd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:26.048275 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.048186 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhtb6\" (UniqueName: \"kubernetes.io/projected/4e78eddd-2636-460b-9c15-5de0d00e5abd-kube-api-access-bhtb6\") pod \"thanos-querier-d776c6f6-6vhdz\" (UID: \"4e78eddd-2636-460b-9c15-5de0d00e5abd\") " pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:26.141436 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.141351 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:26.188890 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:48:26.188858 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82898b91_be30_4076_a460_6e7288217c76.slice/crio-ba37041a091284b22b624e331c21313cf3607b14b505f383d045af554c53b294 WatchSource:0}: Error finding container ba37041a091284b22b624e331c21313cf3607b14b505f383d045af554c53b294: Status 404 returned error can't find the container with id ba37041a091284b22b624e331c21313cf3607b14b505f383d045af554c53b294 Jun 12 21:48:26.337151 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.337123 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d776c6f6-6vhdz"] Jun 12 21:48:26.340948 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:48:26.340920 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e78eddd_2636_460b_9c15_5de0d00e5abd.slice/crio-e15a3143cb5dc9b297e7fda298769f1ac6d0605988da5f6f80520069f27c641c WatchSource:0}: Error finding container e15a3143cb5dc9b297e7fda298769f1ac6d0605988da5f6f80520069f27c641c: Status 404 returned error can't find the container with id e15a3143cb5dc9b297e7fda298769f1ac6d0605988da5f6f80520069f27c641c Jun 12 21:48:26.649969 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.649934 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gmmvl" event={"ID":"8d5fd836-f36e-444c-92f1-1617e0be15c0","Type":"ContainerStarted","Data":"7f4e5c8e93469096bdbd16e13639b765d2cab22c72337bbe62fdf64f2774e309"} Jun 12 21:48:26.651718 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.651689 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" event={"ID":"4e78eddd-2636-460b-9c15-5de0d00e5abd","Type":"ContainerStarted","Data":"e15a3143cb5dc9b297e7fda298769f1ac6d0605988da5f6f80520069f27c641c"} Jun 12 21:48:26.653733 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:26.653605 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82898b91-be30-4076-a460-6e7288217c76","Type":"ContainerStarted","Data":"ba37041a091284b22b624e331c21313cf3607b14b505f383d045af554c53b294"} Jun 12 21:48:26.691970 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:48:26.691910 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kcq4r" podUID="a8029f62-78fe-46b2-8587-0c150c839d9c" Jun 12 21:48:27.654857 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:27.654745 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:27.662087 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:27.661776 2563 generic.go:356] "Generic (PLEG): container finished" podID="8d5fd836-f36e-444c-92f1-1617e0be15c0" containerID="7f4e5c8e93469096bdbd16e13639b765d2cab22c72337bbe62fdf64f2774e309" exitCode=0 Jun 12 21:48:27.662087 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:27.661858 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gmmvl" event={"ID":"8d5fd836-f36e-444c-92f1-1617e0be15c0","Type":"ContainerDied","Data":"7f4e5c8e93469096bdbd16e13639b765d2cab22c72337bbe62fdf64f2774e309"} Jun 12 21:48:27.663922 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:27.663863 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fef94b62-8120-4bfd-8d2f-894dc07892f0-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-fbc9z\" (UID: \"fef94b62-8120-4bfd-8d2f-894dc07892f0\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:27.753515 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:27.753485 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" Jun 12 21:48:29.283058 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:29.281044 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z"] Jun 12 21:48:29.287447 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:48:29.287201 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef94b62_8120_4bfd_8d2f_894dc07892f0.slice/crio-54a025d351b4d64def4e7884a261fee23db92537d32e8c2f8c250bd06dcd907d WatchSource:0}: Error finding container 54a025d351b4d64def4e7884a261fee23db92537d32e8c2f8c250bd06dcd907d: Status 404 returned error can't find the container with id 54a025d351b4d64def4e7884a261fee23db92537d32e8c2f8c250bd06dcd907d Jun 12 21:48:29.673206 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:29.673172 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" event={"ID":"fef94b62-8120-4bfd-8d2f-894dc07892f0","Type":"ContainerStarted","Data":"54a025d351b4d64def4e7884a261fee23db92537d32e8c2f8c250bd06dcd907d"} Jun 12 21:48:29.675191 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:29.675166 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gmmvl" event={"ID":"8d5fd836-f36e-444c-92f1-1617e0be15c0","Type":"ContainerStarted","Data":"960ba7f758966b6ab0ad0960f902c959aa8605356071fdcc8ab96b1fec84237b"} Jun 12 21:48:29.675285 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:29.675213 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gmmvl" event={"ID":"8d5fd836-f36e-444c-92f1-1617e0be15c0","Type":"ContainerStarted","Data":"342830cca8386f142851e869a516fd4aa50674aa5028c942c22c60e9aac75404"} Jun 12 21:48:29.677282 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:29.677262 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" event={"ID":"f9990ef7-4c89-4ff9-80a7-12a40414352a","Type":"ContainerStarted","Data":"4056253a674a4107ff96458e2d4fb4b67bbd1c292da011c6c0873078ffc32bef"} Jun 12 21:48:29.678717 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:29.678694 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" event={"ID":"4e78eddd-2636-460b-9c15-5de0d00e5abd","Type":"ContainerStarted","Data":"68d4f9385b2be79551081a57f117ff27b8fa339ce1a6dad4e3a1d035206a94e4"} Jun 12 21:48:29.680076 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:29.680056 2563 generic.go:356] "Generic (PLEG): container finished" podID="82898b91-be30-4076-a460-6e7288217c76" containerID="01aa0b8b8fe48cb3d693585178a2fef60382dc50b91aac8fea3ce4ab4379ae86" exitCode=0 Jun 12 21:48:29.680167 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:29.680097 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82898b91-be30-4076-a460-6e7288217c76","Type":"ContainerDied","Data":"01aa0b8b8fe48cb3d693585178a2fef60382dc50b91aac8fea3ce4ab4379ae86"} Jun 12 21:48:29.707558 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:29.707520 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gmmvl" podStartSLOduration=5.110762018 podStartE2EDuration="6.707508745s" totalImagesPullingTime="1.452742782s" totalInitContainerRuntime="144.003945ms" isStatefulPod=true podCreationTimestamp="2026-06-12 21:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:48:29.706507145 +0000 UTC m=+296.430790399" watchObservedRunningTime="2026-06-12 21:48:29.707508745 +0000 UTC m=+296.431791972" Jun 12 21:48:29.720917 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:29.720879 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-v5mmn" podStartSLOduration=3.107510432 podStartE2EDuration="6.720866708s" totalImagesPullingTime="3.613356276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:48:29.720160553 +0000 UTC m=+296.444443804" watchObservedRunningTime="2026-06-12 21:48:29.720866708 +0000 UTC m=+296.445149959" Jun 12 21:48:30.688740 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:30.688696 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" event={"ID":"4e78eddd-2636-460b-9c15-5de0d00e5abd","Type":"ContainerStarted","Data":"42eb1c574d339753132ef09691a0c90d4b727b3153cbfbe3c591a2c03684a006"} Jun 12 21:48:30.689301 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:30.688826 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" event={"ID":"4e78eddd-2636-460b-9c15-5de0d00e5abd","Type":"ContainerStarted","Data":"c40fa4b795b52018301e27c3c8bdc871e9dbe4d2581084f676f1d092e61e5283"} Jun 12 21:48:32.703013 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:32.702987 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" event={"ID":"fef94b62-8120-4bfd-8d2f-894dc07892f0","Type":"ContainerStarted","Data":"30bbcb242b3c8251e35f7eed666f3c16a40864ee9ead4a4c3b4b7300e0be8c43"} Jun 12 21:48:32.703387 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:32.703038 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" event={"ID":"fef94b62-8120-4bfd-8d2f-894dc07892f0","Type":"ContainerStarted","Data":"210ac808423bb6902d3145110eb920cd185127bad57bd2f656c9e4e34ff4a14a"} Jun 12 21:48:32.703387 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:32.703062 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" event={"ID":"fef94b62-8120-4bfd-8d2f-894dc07892f0","Type":"ContainerStarted","Data":"b572a68d83d955965e91cc83a2634f9ba984752ea76b2e5df1b208b0bd5482aa"} Jun 12 21:48:32.705809 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:32.705781 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" event={"ID":"4e78eddd-2636-460b-9c15-5de0d00e5abd","Type":"ContainerStarted","Data":"522f35da3e6c8d792d6643b9c5ee818b42bedc8c78f2e78510ad791648428f40"} Jun 12 21:48:32.705920 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:32.705845 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:32.705920 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:32.705884 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" event={"ID":"4e78eddd-2636-460b-9c15-5de0d00e5abd","Type":"ContainerStarted","Data":"9cf7132430b537071a89f2c1c9265ee9a8577140656c3ee2db86bdbb098d853c"} Jun 12 21:48:32.705920 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:32.705920 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" event={"ID":"4e78eddd-2636-460b-9c15-5de0d00e5abd","Type":"ContainerStarted","Data":"43c87a0e71f7006b4f58ae9b43f95e00f5656bad8db0b744ac480c7127761c88"} Jun 12 21:48:32.708270 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:32.708252 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82898b91-be30-4076-a460-6e7288217c76","Type":"ContainerStarted","Data":"f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47"} Jun 12 21:48:32.708350 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:32.708303 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82898b91-be30-4076-a460-6e7288217c76","Type":"ContainerStarted","Data":"3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465"} Jun 12 21:48:32.708350 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:32.708329 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82898b91-be30-4076-a460-6e7288217c76","Type":"ContainerStarted","Data":"df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb"} Jun 12 21:48:32.708425 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:32.708352 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82898b91-be30-4076-a460-6e7288217c76","Type":"ContainerStarted","Data":"6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792"} Jun 12 21:48:32.720762 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:32.720724 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-fbc9z" podStartSLOduration=7.06188491 podStartE2EDuration="9.720711905s" totalImagesPullingTime="2.658826995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:48:32.718815179 +0000 UTC m=+299.443098447" watchObservedRunningTime="2026-06-12 21:48:32.720711905 +0000 UTC m=+299.444995155" Jun 12 21:48:32.740990 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:32.740951 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" podStartSLOduration=2.294938686 podStartE2EDuration="7.740938602s" totalImagesPullingTime="5.445999916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:48:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:48:32.740036234 +0000 UTC m=+299.464319484" watchObservedRunningTime="2026-06-12 21:48:32.740938602 +0000 UTC m=+299.465221870" Jun 12 21:48:33.668186 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:33.668159 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vtz7b_15c9555f-ff57-4466-8a1d-afe9996ba621/console-operator/1.log" Jun 12 21:48:33.668922 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:33.668890 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vtz7b_15c9555f-ff57-4466-8a1d-afe9996ba621/console-operator/1.log" Jun 12 21:48:33.674373 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:33.674354 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnlbf_d13fa689-39c1-4a87-8506-5a75fcf8ad40/ovn-acl-logging/0.log" Jun 12 21:48:33.675046 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:33.675027 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnlbf_d13fa689-39c1-4a87-8506-5a75fcf8ad40/ovn-acl-logging/0.log" Jun 12 21:48:33.678622 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:33.678605 2563 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 21:48:33.715420 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:33.715280 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82898b91-be30-4076-a460-6e7288217c76","Type":"ContainerStarted","Data":"09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de"} Jun 12 21:48:33.715420 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:33.715341 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82898b91-be30-4076-a460-6e7288217c76","Type":"ContainerStarted","Data":"a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34"} Jun 12 21:48:33.881072 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:33.741268 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.504062859 podStartE2EDuration="9.741251766s" totalImagesPullingTime="5.208380622s" totalInitContainerRuntime="28.808285ms" isStatefulPod=false podCreationTimestamp="2026-06-12 21:48:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:48:33.739045063 +0000 UTC m=+300.463328329" watchObservedRunningTime="2026-06-12 21:48:33.741251766 +0000 UTC m=+300.465535017" Jun 12 21:48:35.655930 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:35.655905 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vgf7j" Jun 12 21:48:38.721326 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:38.721300 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-d776c6f6-6vhdz" Jun 12 21:48:39.482757 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:39.482724 2563 patch_prober.go:28] interesting pod/image-registry-67655dfb86-drdz2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 21:48:39.483001 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:39.482782 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67655dfb86-drdz2" podUID="d98d8dfe-ae15-4606-acf8-2b1d55d48b9e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 21:48:40.689864 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:40.689835 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:48:42.614360 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:42.614333 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:48:52.766712 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:48:52.766674 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67655dfb86-drdz2"] Jun 12 21:49:12.070531 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:12.070498 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67655dfb86-drdz2_d98d8dfe-ae15-4606-acf8-2b1d55d48b9e/registry/0.log" Jun 12 21:49:12.099445 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:12.099426 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jjhkm_9a539c62-3abf-4aa8-af59-c5193cd47800/node-ca/0.log" Jun 12 21:49:17.786653 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:17.786610 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67655dfb86-drdz2" podUID="d98d8dfe-ae15-4606-acf8-2b1d55d48b9e" containerName="registry" containerID="cri-o://b719208a54479192798d8cc8ee95b63613b7ec150ff909dad6a728747eed6c14" gracePeriod=30 Jun 12 21:49:18.024463 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.024442 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:49:18.127613 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.127585 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-bound-sa-token\") pod \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " Jun 12 21:49:18.127788 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.127641 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-image-registry-private-configuration\") pod \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " Jun 12 21:49:18.127788 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.127688 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-installation-pull-secrets\") pod \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " Jun 12 21:49:18.127788 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.127749 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-certificates\") pod \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " Jun 12 21:49:18.127788 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.127779 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls\") pod \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " Jun 12 21:49:18.128000 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.127804 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5scwj\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-kube-api-access-5scwj\") pod \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " Jun 12 21:49:18.128000 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.127857 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-ca-trust-extracted\") pod \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " Jun 12 21:49:18.128000 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.127886 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-trusted-ca\") pod \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\" (UID: \"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e\") " Jun 12 21:49:18.128500 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.128471 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e" (UID: "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:49:18.129006 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.128978 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e" (UID: "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:49:18.130000 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.129976 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e" (UID: "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:49:18.130158 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.130127 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-kube-api-access-5scwj" (OuterVolumeSpecName: "kube-api-access-5scwj") pod "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e" (UID: "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e"). InnerVolumeSpecName "kube-api-access-5scwj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:49:18.130214 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.130192 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e" (UID: "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:49:18.130252 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.130218 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e" (UID: "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:49:18.130318 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.130300 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e" (UID: "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:49:18.136655 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.136628 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e" (UID: "d98d8dfe-ae15-4606-acf8-2b1d55d48b9e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:49:18.228961 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.228934 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-ca-trust-extracted\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:18.228961 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.228957 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-trusted-ca\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:18.229103 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.228970 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-bound-sa-token\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:18.229103 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.228983 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-image-registry-private-configuration\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:18.229103 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.228996 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-installation-pull-secrets\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:18.229103 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.229009 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-certificates\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:18.229103 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.229020 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-registry-tls\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:18.229103 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.229033 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5scwj\" (UniqueName: \"kubernetes.io/projected/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e-kube-api-access-5scwj\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:18.896962 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.896927 2563 generic.go:356] "Generic (PLEG): container finished" podID="d98d8dfe-ae15-4606-acf8-2b1d55d48b9e" containerID="b719208a54479192798d8cc8ee95b63613b7ec150ff909dad6a728747eed6c14" exitCode=0 Jun 12 21:49:18.897418 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.896971 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67655dfb86-drdz2" Jun 12 21:49:18.897418 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.897022 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67655dfb86-drdz2" event={"ID":"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e","Type":"ContainerDied","Data":"b719208a54479192798d8cc8ee95b63613b7ec150ff909dad6a728747eed6c14"} Jun 12 21:49:18.897418 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.897063 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67655dfb86-drdz2" event={"ID":"d98d8dfe-ae15-4606-acf8-2b1d55d48b9e","Type":"ContainerDied","Data":"695f576aba44947f5a1075e7b6cae53a5c848cd43c781e97659ddb6ccb76fa0d"} Jun 12 21:49:18.897418 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.897082 2563 scope.go:117] "RemoveContainer" containerID="b719208a54479192798d8cc8ee95b63613b7ec150ff909dad6a728747eed6c14" Jun 12 21:49:18.907998 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.907979 2563 scope.go:117] "RemoveContainer" containerID="b719208a54479192798d8cc8ee95b63613b7ec150ff909dad6a728747eed6c14" Jun 12 21:49:18.908263 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:49:18.908243 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b719208a54479192798d8cc8ee95b63613b7ec150ff909dad6a728747eed6c14\": container with ID starting with b719208a54479192798d8cc8ee95b63613b7ec150ff909dad6a728747eed6c14 not found: ID does not exist" containerID="b719208a54479192798d8cc8ee95b63613b7ec150ff909dad6a728747eed6c14" Jun 12 21:49:18.908325 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.908271 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b719208a54479192798d8cc8ee95b63613b7ec150ff909dad6a728747eed6c14"} err="failed to get container status \"b719208a54479192798d8cc8ee95b63613b7ec150ff909dad6a728747eed6c14\": rpc error: code = NotFound desc = could not find container \"b719208a54479192798d8cc8ee95b63613b7ec150ff909dad6a728747eed6c14\": container with ID starting with b719208a54479192798d8cc8ee95b63613b7ec150ff909dad6a728747eed6c14 not found: ID does not exist" Jun 12 21:49:18.919458 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.919435 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67655dfb86-drdz2"] Jun 12 21:49:18.922908 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:18.922881 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67655dfb86-drdz2"] Jun 12 21:49:19.695088 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:19.695061 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d98d8dfe-ae15-4606-acf8-2b1d55d48b9e" path="/var/lib/kubelet/pods/d98d8dfe-ae15-4606-acf8-2b1d55d48b9e/volumes" Jun 12 21:49:44.116619 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:44.116580 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:49:44.117076 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:44.116921 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="alertmanager" containerID="cri-o://6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792" gracePeriod=120 Jun 12 21:49:44.117076 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:44.116992 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="kube-rbac-proxy-metric" containerID="cri-o://a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34" gracePeriod=120 Jun 12 21:49:44.117076 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:44.117049 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="kube-rbac-proxy-web" containerID="cri-o://3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465" gracePeriod=120 Jun 12 21:49:44.117259 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:44.117116 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="kube-rbac-proxy" containerID="cri-o://f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47" gracePeriod=120 Jun 12 21:49:44.117259 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:44.117042 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="prom-label-proxy" containerID="cri-o://09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de" gracePeriod=120 Jun 12 21:49:44.117259 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:44.117068 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="config-reloader" containerID="cri-o://df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb" gracePeriod=120 Jun 12 21:49:45.007730 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.007699 2563 generic.go:356] "Generic (PLEG): container finished" podID="82898b91-be30-4076-a460-6e7288217c76" containerID="09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de" exitCode=0 Jun 12 21:49:45.007730 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.007725 2563 generic.go:356] "Generic (PLEG): container finished" podID="82898b91-be30-4076-a460-6e7288217c76" containerID="f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47" exitCode=0 Jun 12 21:49:45.007730 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.007732 2563 generic.go:356] "Generic (PLEG): container finished" podID="82898b91-be30-4076-a460-6e7288217c76" containerID="df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb" exitCode=0 Jun 12 21:49:45.007730 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.007738 2563 generic.go:356] "Generic (PLEG): container finished" podID="82898b91-be30-4076-a460-6e7288217c76" containerID="6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792" exitCode=0 Jun 12 21:49:45.007987 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.007775 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82898b91-be30-4076-a460-6e7288217c76","Type":"ContainerDied","Data":"09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de"} Jun 12 21:49:45.007987 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.007847 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82898b91-be30-4076-a460-6e7288217c76","Type":"ContainerDied","Data":"f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47"} Jun 12 21:49:45.007987 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.007873 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82898b91-be30-4076-a460-6e7288217c76","Type":"ContainerDied","Data":"df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb"} Jun 12 21:49:45.007987 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.007897 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82898b91-be30-4076-a460-6e7288217c76","Type":"ContainerDied","Data":"6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792"} Jun 12 21:49:45.359276 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.359253 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:45.540629 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.540546 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82898b91-be30-4076-a460-6e7288217c76-config-out\") pod \"82898b91-be30-4076-a460-6e7288217c76\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " Jun 12 21:49:45.540629 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.540589 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-main-tls\") pod \"82898b91-be30-4076-a460-6e7288217c76\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " Jun 12 21:49:45.540629 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.540612 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz4mb\" (UniqueName: \"kubernetes.io/projected/82898b91-be30-4076-a460-6e7288217c76-kube-api-access-lz4mb\") pod \"82898b91-be30-4076-a460-6e7288217c76\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " Jun 12 21:49:45.540629 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.540629 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82898b91-be30-4076-a460-6e7288217c76-alertmanager-trusted-ca-bundle\") pod \"82898b91-be30-4076-a460-6e7288217c76\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " Jun 12 21:49:45.540967 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.540654 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-config-volume\") pod \"82898b91-be30-4076-a460-6e7288217c76\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " Jun 12 21:49:45.540967 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.540693 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82898b91-be30-4076-a460-6e7288217c76-metrics-client-ca\") pod \"82898b91-be30-4076-a460-6e7288217c76\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " Jun 12 21:49:45.540967 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.540711 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy-metric\") pod \"82898b91-be30-4076-a460-6e7288217c76\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " Jun 12 21:49:45.540967 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.540731 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy\") pod \"82898b91-be30-4076-a460-6e7288217c76\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " Jun 12 21:49:45.540967 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.540758 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-cluster-tls-config\") pod \"82898b91-be30-4076-a460-6e7288217c76\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " Jun 12 21:49:45.540967 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.540786 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy-web\") pod \"82898b91-be30-4076-a460-6e7288217c76\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " Jun 12 21:49:45.540967 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.540820 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82898b91-be30-4076-a460-6e7288217c76-tls-assets\") pod \"82898b91-be30-4076-a460-6e7288217c76\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " Jun 12 21:49:45.540967 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.540852 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/82898b91-be30-4076-a460-6e7288217c76-alertmanager-main-db\") pod \"82898b91-be30-4076-a460-6e7288217c76\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " Jun 12 21:49:45.540967 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.540896 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-web-config\") pod \"82898b91-be30-4076-a460-6e7288217c76\" (UID: \"82898b91-be30-4076-a460-6e7288217c76\") " Jun 12 21:49:45.541443 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.541066 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82898b91-be30-4076-a460-6e7288217c76-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "82898b91-be30-4076-a460-6e7288217c76" (UID: "82898b91-be30-4076-a460-6e7288217c76"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:49:45.541443 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.541076 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82898b91-be30-4076-a460-6e7288217c76-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "82898b91-be30-4076-a460-6e7288217c76" (UID: "82898b91-be30-4076-a460-6e7288217c76"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 21:49:45.543583 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.543256 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82898b91-be30-4076-a460-6e7288217c76-kube-api-access-lz4mb" (OuterVolumeSpecName: "kube-api-access-lz4mb") pod "82898b91-be30-4076-a460-6e7288217c76" (UID: "82898b91-be30-4076-a460-6e7288217c76"). InnerVolumeSpecName "kube-api-access-lz4mb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:49:45.543583 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.543293 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-config-volume" (OuterVolumeSpecName: "config-volume") pod "82898b91-be30-4076-a460-6e7288217c76" (UID: "82898b91-be30-4076-a460-6e7288217c76"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:49:45.543583 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.543386 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "82898b91-be30-4076-a460-6e7288217c76" (UID: "82898b91-be30-4076-a460-6e7288217c76"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:49:45.543583 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.543545 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82898b91-be30-4076-a460-6e7288217c76-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "82898b91-be30-4076-a460-6e7288217c76" (UID: "82898b91-be30-4076-a460-6e7288217c76"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:49:45.543878 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.543610 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "82898b91-be30-4076-a460-6e7288217c76" (UID: "82898b91-be30-4076-a460-6e7288217c76"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:49:45.543878 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.543628 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "82898b91-be30-4076-a460-6e7288217c76" (UID: "82898b91-be30-4076-a460-6e7288217c76"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:49:45.543878 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.543850 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82898b91-be30-4076-a460-6e7288217c76-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "82898b91-be30-4076-a460-6e7288217c76" (UID: "82898b91-be30-4076-a460-6e7288217c76"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 21:49:45.544368 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.544345 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82898b91-be30-4076-a460-6e7288217c76-config-out" (OuterVolumeSpecName: "config-out") pod "82898b91-be30-4076-a460-6e7288217c76" (UID: "82898b91-be30-4076-a460-6e7288217c76"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 21:49:45.544492 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.544466 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "82898b91-be30-4076-a460-6e7288217c76" (UID: "82898b91-be30-4076-a460-6e7288217c76"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:49:45.549374 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.549353 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "82898b91-be30-4076-a460-6e7288217c76" (UID: "82898b91-be30-4076-a460-6e7288217c76"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:49:45.555765 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.555740 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-web-config" (OuterVolumeSpecName: "web-config") pod "82898b91-be30-4076-a460-6e7288217c76" (UID: "82898b91-be30-4076-a460-6e7288217c76"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 21:49:45.641901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.641879 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-main-tls\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:45.641901 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.641899 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz4mb\" (UniqueName: \"kubernetes.io/projected/82898b91-be30-4076-a460-6e7288217c76-kube-api-access-lz4mb\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:45.642008 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.641908 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82898b91-be30-4076-a460-6e7288217c76-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:45.642008 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.641917 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-config-volume\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:45.642008 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.641926 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82898b91-be30-4076-a460-6e7288217c76-metrics-client-ca\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:45.642008 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.641934 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:45.642008 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.641943 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:45.642008 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.641953 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-cluster-tls-config\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:45.642008 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.641961 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:45.642008 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.641969 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82898b91-be30-4076-a460-6e7288217c76-tls-assets\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:45.642008 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.641977 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/82898b91-be30-4076-a460-6e7288217c76-alertmanager-main-db\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:45.642008 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.641986 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82898b91-be30-4076-a460-6e7288217c76-web-config\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:45.642008 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:45.641993 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82898b91-be30-4076-a460-6e7288217c76-config-out\") on node \"ip-10-0-128-93.ec2.internal\" DevicePath \"\"" Jun 12 21:49:46.015280 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.015252 2563 generic.go:356] "Generic (PLEG): container finished" podID="82898b91-be30-4076-a460-6e7288217c76" containerID="a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34" exitCode=0 Jun 12 21:49:46.015280 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.015272 2563 generic.go:356] "Generic (PLEG): container finished" podID="82898b91-be30-4076-a460-6e7288217c76" containerID="3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465" exitCode=0 Jun 12 21:49:46.015451 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.015310 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82898b91-be30-4076-a460-6e7288217c76","Type":"ContainerDied","Data":"a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34"} Jun 12 21:49:46.015451 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.015379 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82898b91-be30-4076-a460-6e7288217c76","Type":"ContainerDied","Data":"3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465"} Jun 12 21:49:46.015451 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.015315 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.015451 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.015424 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"82898b91-be30-4076-a460-6e7288217c76","Type":"ContainerDied","Data":"ba37041a091284b22b624e331c21313cf3607b14b505f383d045af554c53b294"} Jun 12 21:49:46.015586 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.015466 2563 scope.go:117] "RemoveContainer" containerID="09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de" Jun 12 21:49:46.023254 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.023238 2563 scope.go:117] "RemoveContainer" containerID="a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34" Jun 12 21:49:46.029937 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.029917 2563 scope.go:117] "RemoveContainer" containerID="f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47" Jun 12 21:49:46.034394 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.034376 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:49:46.037392 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.037374 2563 scope.go:117] "RemoveContainer" containerID="3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465" Jun 12 21:49:46.038086 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.038069 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:49:46.043631 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.043613 2563 scope.go:117] "RemoveContainer" containerID="df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb" Jun 12 21:49:46.049907 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.049888 2563 scope.go:117] "RemoveContainer" containerID="6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792" Jun 12 21:49:46.056298 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.056281 2563 scope.go:117] "RemoveContainer" containerID="01aa0b8b8fe48cb3d693585178a2fef60382dc50b91aac8fea3ce4ab4379ae86" Jun 12 21:49:46.063497 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.063461 2563 scope.go:117] "RemoveContainer" containerID="09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de" Jun 12 21:49:46.063944 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:49:46.063892 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de\": container with ID starting with 09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de not found: ID does not exist" containerID="09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de" Jun 12 21:49:46.063944 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.063927 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de"} err="failed to get container status \"09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de\": rpc error: code = NotFound desc = could not find container \"09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de\": container with ID starting with 09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de not found: ID does not exist" Jun 12 21:49:46.063944 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.063945 2563 scope.go:117] "RemoveContainer" containerID="a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34" Jun 12 21:49:46.064221 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:49:46.064202 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34\": container with ID starting with a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34 not found: ID does not exist" containerID="a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34" Jun 12 21:49:46.064283 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.064225 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34"} err="failed to get container status \"a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34\": rpc error: code = NotFound desc = could not find container \"a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34\": container with ID starting with a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34 not found: ID does not exist" Jun 12 21:49:46.064283 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.064241 2563 scope.go:117] "RemoveContainer" containerID="f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47" Jun 12 21:49:46.064530 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:49:46.064510 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47\": container with ID starting with f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47 not found: ID does not exist" containerID="f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47" Jun 12 21:49:46.064596 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.064538 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47"} err="failed to get container status \"f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47\": rpc error: code = NotFound desc = could not find container \"f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47\": container with ID starting with f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47 not found: ID does not exist" Jun 12 21:49:46.064596 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.064558 2563 scope.go:117] "RemoveContainer" containerID="3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465" Jun 12 21:49:46.064842 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:49:46.064826 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465\": container with ID starting with 3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465 not found: ID does not exist" containerID="3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465" Jun 12 21:49:46.064906 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.064849 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465"} err="failed to get container status \"3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465\": rpc error: code = NotFound desc = could not find container \"3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465\": container with ID starting with 3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465 not found: ID does not exist" Jun 12 21:49:46.064906 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.064869 2563 scope.go:117] "RemoveContainer" containerID="df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb" Jun 12 21:49:46.065081 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:49:46.065066 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb\": container with ID starting with df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb not found: ID does not exist" containerID="df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb" Jun 12 21:49:46.065140 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065087 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb"} err="failed to get container status \"df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb\": rpc error: code = NotFound desc = could not find container \"df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb\": container with ID starting with df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb not found: ID does not exist" Jun 12 21:49:46.065140 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065103 2563 scope.go:117] "RemoveContainer" containerID="6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792" Jun 12 21:49:46.065217 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065137 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:49:46.065296 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:49:46.065268 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792\": container with ID starting with 6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792 not found: ID does not exist" containerID="6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792" Jun 12 21:49:46.065340 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065300 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792"} err="failed to get container status \"6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792\": rpc error: code = NotFound desc = could not find container \"6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792\": container with ID starting with 6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792 not found: ID does not exist" Jun 12 21:49:46.065340 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065314 2563 scope.go:117] "RemoveContainer" containerID="01aa0b8b8fe48cb3d693585178a2fef60382dc50b91aac8fea3ce4ab4379ae86" Jun 12 21:49:46.065476 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065459 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="init-config-reloader" Jun 12 21:49:46.065476 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065475 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="init-config-reloader" Jun 12 21:49:46.065600 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065489 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="config-reloader" Jun 12 21:49:46.065600 ip-10-0-128-93 kubenswrapper[2563]: E0612 21:49:46.065490 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01aa0b8b8fe48cb3d693585178a2fef60382dc50b91aac8fea3ce4ab4379ae86\": container with ID starting with 01aa0b8b8fe48cb3d693585178a2fef60382dc50b91aac8fea3ce4ab4379ae86 not found: ID does not exist" containerID="01aa0b8b8fe48cb3d693585178a2fef60382dc50b91aac8fea3ce4ab4379ae86" Jun 12 21:49:46.065600 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065509 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01aa0b8b8fe48cb3d693585178a2fef60382dc50b91aac8fea3ce4ab4379ae86"} err="failed to get container status \"01aa0b8b8fe48cb3d693585178a2fef60382dc50b91aac8fea3ce4ab4379ae86\": rpc error: code = NotFound desc = could not find container \"01aa0b8b8fe48cb3d693585178a2fef60382dc50b91aac8fea3ce4ab4379ae86\": container with ID starting with 01aa0b8b8fe48cb3d693585178a2fef60382dc50b91aac8fea3ce4ab4379ae86 not found: ID does not exist" Jun 12 21:49:46.065600 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065521 2563 scope.go:117] "RemoveContainer" containerID="09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de" Jun 12 21:49:46.065600 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065495 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="config-reloader" Jun 12 21:49:46.065600 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065564 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="prom-label-proxy" Jun 12 21:49:46.065600 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065571 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="prom-label-proxy" Jun 12 21:49:46.065600 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065586 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d98d8dfe-ae15-4606-acf8-2b1d55d48b9e" containerName="registry" Jun 12 21:49:46.065600 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065595 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d98d8dfe-ae15-4606-acf8-2b1d55d48b9e" containerName="registry" Jun 12 21:49:46.065600 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065602 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="kube-rbac-proxy-metric" Jun 12 21:49:46.065958 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065608 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="kube-rbac-proxy-metric" Jun 12 21:49:46.065958 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065619 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="alertmanager" Jun 12 21:49:46.065958 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065624 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="alertmanager" Jun 12 21:49:46.065958 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065635 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="kube-rbac-proxy-web" Jun 12 21:49:46.065958 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065640 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="kube-rbac-proxy-web" Jun 12 21:49:46.065958 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065649 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="kube-rbac-proxy" Jun 12 21:49:46.065958 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065655 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="kube-rbac-proxy" Jun 12 21:49:46.065958 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065743 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d98d8dfe-ae15-4606-acf8-2b1d55d48b9e" containerName="registry" Jun 12 21:49:46.065958 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065753 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="kube-rbac-proxy-metric" Jun 12 21:49:46.065958 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065762 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="config-reloader" Jun 12 21:49:46.065958 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065767 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="kube-rbac-proxy-web" Jun 12 21:49:46.065958 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065774 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="prom-label-proxy" Jun 12 21:49:46.065958 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065779 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="kube-rbac-proxy" Jun 12 21:49:46.065958 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065772 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de"} err="failed to get container status \"09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de\": rpc error: code = NotFound desc = could not find container \"09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de\": container with ID starting with 09c73348f3ca8509b6e45b162459198b7f602d4f4f5cef8e747966f81f2555de not found: ID does not exist" Jun 12 21:49:46.065958 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065794 2563 scope.go:117] "RemoveContainer" containerID="a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34" Jun 12 21:49:46.065958 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.065786 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="82898b91-be30-4076-a460-6e7288217c76" containerName="alertmanager" Jun 12 21:49:46.066496 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.066032 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34"} err="failed to get container status \"a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34\": rpc error: code = NotFound desc = could not find container \"a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34\": container with ID starting with a93a12ed0d803b4158a8a341f6b842e52f57bc075f461eb1bc97d8ed7a3a9f34 not found: ID does not exist" Jun 12 21:49:46.066496 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.066045 2563 scope.go:117] "RemoveContainer" containerID="f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47" Jun 12 21:49:46.066496 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.066246 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47"} err="failed to get container status \"f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47\": rpc error: code = NotFound desc = could not find container \"f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47\": container with ID starting with f3e22c5712bc6e2e1c066bba247c3f517f7dbefc309554c18ec09388c5ee8d47 not found: ID does not exist" Jun 12 21:49:46.066496 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.066262 2563 scope.go:117] "RemoveContainer" containerID="3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465" Jun 12 21:49:46.066496 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.066481 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465"} err="failed to get container status \"3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465\": rpc error: code = NotFound desc = could not find container \"3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465\": container with ID starting with 3e7cb7899e6f8bf953de413e238ad29d021db617610e3ed61f3da0bb23f38465 not found: ID does not exist" Jun 12 21:49:46.066496 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.066496 2563 scope.go:117] "RemoveContainer" containerID="df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb" Jun 12 21:49:46.066758 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.066735 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb"} err="failed to get container status \"df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb\": rpc error: code = NotFound desc = could not find container \"df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb\": container with ID starting with df0c968dd699b44bdba27410995443aba9e17492641a98dcebad30ba4fa590cb not found: ID does not exist" Jun 12 21:49:46.066758 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.066750 2563 scope.go:117] "RemoveContainer" containerID="6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792" Jun 12 21:49:46.066976 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.066954 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792"} err="failed to get container status \"6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792\": rpc error: code = NotFound desc = could not find container \"6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792\": container with ID starting with 6e299c9099e2a998832518b483443d399da58035a4c7ead3a437bf6677a25792 not found: ID does not exist" Jun 12 21:49:46.066976 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.066976 2563 scope.go:117] "RemoveContainer" containerID="01aa0b8b8fe48cb3d693585178a2fef60382dc50b91aac8fea3ce4ab4379ae86" Jun 12 21:49:46.067178 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.067164 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01aa0b8b8fe48cb3d693585178a2fef60382dc50b91aac8fea3ce4ab4379ae86"} err="failed to get container status \"01aa0b8b8fe48cb3d693585178a2fef60382dc50b91aac8fea3ce4ab4379ae86\": rpc error: code = NotFound desc = could not find container \"01aa0b8b8fe48cb3d693585178a2fef60382dc50b91aac8fea3ce4ab4379ae86\": container with ID starting with 01aa0b8b8fe48cb3d693585178a2fef60382dc50b91aac8fea3ce4ab4379ae86 not found: ID does not exist" Jun 12 21:49:46.069735 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.069716 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.071516 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.071496 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 21:49:46.071598 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.071520 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 21:49:46.071765 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.071749 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 21:49:46.071827 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.071782 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 21:49:46.071895 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.071878 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 21:49:46.071942 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.071891 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 21:49:46.071942 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.071920 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 21:49:46.072016 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.072006 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 21:49:46.072165 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.072150 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kbw8r\"" Jun 12 21:49:46.077165 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.077126 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 21:49:46.080724 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.080705 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:49:46.248203 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.248167 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.248301 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.248215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8a296a6-d482-4739-8672-42a3261b760f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.248301 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.248237 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.248301 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.248260 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.248301 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.248282 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.248430 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.248310 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.248430 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.248340 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8a296a6-d482-4739-8672-42a3261b760f-config-out\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.248430 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.248370 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.248430 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.248415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8a296a6-d482-4739-8672-42a3261b760f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.248544 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.248439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-web-config\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.248544 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.248461 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhj48\" (UniqueName: \"kubernetes.io/projected/c8a296a6-d482-4739-8672-42a3261b760f-kube-api-access-lhj48\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.248544 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.248527 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8a296a6-d482-4739-8672-42a3261b760f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.248628 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.248551 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8a296a6-d482-4739-8672-42a3261b760f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.349059 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.349031 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.349159 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.349074 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8a296a6-d482-4739-8672-42a3261b760f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.349159 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.349093 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.349159 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.349115 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.349159 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.349138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.349391 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.349185 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.349391 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.349205 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8a296a6-d482-4739-8672-42a3261b760f-config-out\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.349391 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.349226 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.349391 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.349251 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8a296a6-d482-4739-8672-42a3261b760f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.349391 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.349285 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-web-config\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.349391 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.349313 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhj48\" (UniqueName: \"kubernetes.io/projected/c8a296a6-d482-4739-8672-42a3261b760f-kube-api-access-lhj48\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.349391 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.349365 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8a296a6-d482-4739-8672-42a3261b760f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.349776 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.349394 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8a296a6-d482-4739-8672-42a3261b760f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.349776 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.349458 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8a296a6-d482-4739-8672-42a3261b760f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.350403 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.350374 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8a296a6-d482-4739-8672-42a3261b760f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.352103 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.352073 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.352209 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.352108 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.352209 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.352132 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8a296a6-d482-4739-8672-42a3261b760f-config-out\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.352209 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.352182 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.352372 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.352261 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.352786 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.352759 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.352857 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.352791 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8a296a6-d482-4739-8672-42a3261b760f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.352857 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.352815 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.352970 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.352935 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8a296a6-d482-4739-8672-42a3261b760f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.353978 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.353961 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8a296a6-d482-4739-8672-42a3261b760f-web-config\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.360149 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.360129 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhj48\" (UniqueName: \"kubernetes.io/projected/c8a296a6-d482-4739-8672-42a3261b760f-kube-api-access-lhj48\") pod \"alertmanager-main-0\" (UID: \"c8a296a6-d482-4739-8672-42a3261b760f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.378993 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.378972 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 21:49:46.505250 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:46.505216 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 21:49:46.507978 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:49:46.507945 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a296a6_d482_4739_8672_42a3261b760f.slice/crio-1a9be07af04e462ddbf35630e529ef25ef1fd89463a022ac2730ded8d5f58c32 WatchSource:0}: Error finding container 1a9be07af04e462ddbf35630e529ef25ef1fd89463a022ac2730ded8d5f58c32: Status 404 returned error can't find the container with id 1a9be07af04e462ddbf35630e529ef25ef1fd89463a022ac2730ded8d5f58c32 Jun 12 21:49:47.022650 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:47.022622 2563 generic.go:356] "Generic (PLEG): container finished" podID="c8a296a6-d482-4739-8672-42a3261b760f" containerID="04a227a1166d416879cfac984d2d9a6336d37bc4f7eab974e0d7f540ce5e2103" exitCode=0 Jun 12 21:49:47.022794 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:47.022703 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8a296a6-d482-4739-8672-42a3261b760f","Type":"ContainerDied","Data":"04a227a1166d416879cfac984d2d9a6336d37bc4f7eab974e0d7f540ce5e2103"} Jun 12 21:49:47.022794 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:47.022782 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8a296a6-d482-4739-8672-42a3261b760f","Type":"ContainerStarted","Data":"1a9be07af04e462ddbf35630e529ef25ef1fd89463a022ac2730ded8d5f58c32"} Jun 12 21:49:47.662062 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:47.662025 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs\") pod \"network-metrics-daemon-kcq4r\" (UID: \"a8029f62-78fe-46b2-8587-0c150c839d9c\") " pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:49:47.664238 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:47.664214 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8029f62-78fe-46b2-8587-0c150c839d9c-metrics-certs\") pod \"network-metrics-daemon-kcq4r\" (UID: \"a8029f62-78fe-46b2-8587-0c150c839d9c\") " pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:49:47.694785 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:47.694760 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82898b91-be30-4076-a460-6e7288217c76" path="/var/lib/kubelet/pods/82898b91-be30-4076-a460-6e7288217c76/volumes" Jun 12 21:49:47.892181 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:47.892149 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zhmdq\"" Jun 12 21:49:47.900520 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:47.900490 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcq4r" Jun 12 21:49:48.026453 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.026419 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kcq4r"] Jun 12 21:49:48.030316 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:49:48.030294 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8029f62_78fe_46b2_8587_0c150c839d9c.slice/crio-9f41d2fde4c2ed39e75aa90e61a8497fa5cf6e6ca66a56578bc2b2092ee82b3a WatchSource:0}: Error finding container 9f41d2fde4c2ed39e75aa90e61a8497fa5cf6e6ca66a56578bc2b2092ee82b3a: Status 404 returned error can't find the container with id 9f41d2fde4c2ed39e75aa90e61a8497fa5cf6e6ca66a56578bc2b2092ee82b3a Jun 12 21:49:48.031343 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.031307 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8a296a6-d482-4739-8672-42a3261b760f","Type":"ContainerStarted","Data":"1ca185f00cad1251007ffd2e6a75b2197a61c43b53622453ae4fee14071aa171"} Jun 12 21:49:48.031438 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.031367 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8a296a6-d482-4739-8672-42a3261b760f","Type":"ContainerStarted","Data":"80b9b3d83f7a05a09ed30070a3bf8296a48e22f426b88b94f35bfb9ee09bc778"} Jun 12 21:49:48.031438 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.031393 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8a296a6-d482-4739-8672-42a3261b760f","Type":"ContainerStarted","Data":"123048db70843736f997bd1b56917138624aef500830fd788ee091e4d4ccde98"} Jun 12 21:49:48.031438 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.031419 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8a296a6-d482-4739-8672-42a3261b760f","Type":"ContainerStarted","Data":"1170f7c8472f8c053db08d120ecc171e616813473b7cf88f3bf4d407a0333ad8"} Jun 12 21:49:48.031552 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.031446 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8a296a6-d482-4739-8672-42a3261b760f","Type":"ContainerStarted","Data":"fd733efc48b8bffc90ca39777334bb36a3bb205cdb1a259d3e887db860500651"} Jun 12 21:49:48.031552 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.031471 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8a296a6-d482-4739-8672-42a3261b760f","Type":"ContainerStarted","Data":"f2d229523e0f4859b9deff401d3273fc6391ece794977d6a43a9549a2bc9d408"} Jun 12 21:49:48.032224 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.032210 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 21:49:48.062023 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.061981 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.048404038 podStartE2EDuration="2.061963071s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.559033ms" isStatefulPod=false podCreationTimestamp="2026-06-12 21:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:49:48.060339332 +0000 UTC m=+374.784622581" watchObservedRunningTime="2026-06-12 21:49:48.061963071 +0000 UTC m=+374.786246321" Jun 12 21:49:48.188629 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.188554 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd"] Jun 12 21:49:48.192163 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.192143 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.196215 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.195815 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 12 21:49:48.196215 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.196077 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 12 21:49:48.196457 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.196321 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 12 21:49:48.196612 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.196589 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 12 21:49:48.196718 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.196633 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 12 21:49:48.196845 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.196830 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-58nlc\"" Jun 12 21:49:48.200287 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.200265 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 12 21:49:48.206504 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.206484 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd"] Jun 12 21:49:48.268345 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.268309 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzzd9\" (UniqueName: \"kubernetes.io/projected/2228cd12-aea5-49c2-a665-9237e0f45e0c-kube-api-access-kzzd9\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.268494 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.268351 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2228cd12-aea5-49c2-a665-9237e0f45e0c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.268494 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.268436 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2228cd12-aea5-49c2-a665-9237e0f45e0c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.268608 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.268505 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2228cd12-aea5-49c2-a665-9237e0f45e0c-serving-certs-ca-bundle\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.268608 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.268545 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2228cd12-aea5-49c2-a665-9237e0f45e0c-telemeter-client-tls\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.268608 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.268564 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2228cd12-aea5-49c2-a665-9237e0f45e0c-metrics-client-ca\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.268608 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.268581 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2228cd12-aea5-49c2-a665-9237e0f45e0c-federate-client-tls\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.268758 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.268614 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2228cd12-aea5-49c2-a665-9237e0f45e0c-secret-telemeter-client\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.369445 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.369406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2228cd12-aea5-49c2-a665-9237e0f45e0c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.369632 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.369464 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2228cd12-aea5-49c2-a665-9237e0f45e0c-serving-certs-ca-bundle\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.369632 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.369509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2228cd12-aea5-49c2-a665-9237e0f45e0c-telemeter-client-tls\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.369632 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.369541 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2228cd12-aea5-49c2-a665-9237e0f45e0c-metrics-client-ca\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.369632 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.369567 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2228cd12-aea5-49c2-a665-9237e0f45e0c-federate-client-tls\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.370409 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.369919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2228cd12-aea5-49c2-a665-9237e0f45e0c-secret-telemeter-client\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.370409 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.369983 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzzd9\" (UniqueName: \"kubernetes.io/projected/2228cd12-aea5-49c2-a665-9237e0f45e0c-kube-api-access-kzzd9\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.370409 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.370016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2228cd12-aea5-49c2-a665-9237e0f45e0c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.370409 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.370315 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2228cd12-aea5-49c2-a665-9237e0f45e0c-metrics-client-ca\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.370713 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.370422 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2228cd12-aea5-49c2-a665-9237e0f45e0c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.370713 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.370697 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2228cd12-aea5-49c2-a665-9237e0f45e0c-serving-certs-ca-bundle\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.372761 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.372728 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2228cd12-aea5-49c2-a665-9237e0f45e0c-telemeter-client-tls\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.372859 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.372807 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2228cd12-aea5-49c2-a665-9237e0f45e0c-federate-client-tls\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.373227 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.373202 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2228cd12-aea5-49c2-a665-9237e0f45e0c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.373536 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.373513 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2228cd12-aea5-49c2-a665-9237e0f45e0c-secret-telemeter-client\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.377871 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.377847 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzzd9\" (UniqueName: \"kubernetes.io/projected/2228cd12-aea5-49c2-a665-9237e0f45e0c-kube-api-access-kzzd9\") pod \"telemeter-client-69f4c7b9d-gjfjd\" (UID: \"2228cd12-aea5-49c2-a665-9237e0f45e0c\") " pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.505594 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.505509 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" Jun 12 21:49:48.669044 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:48.669010 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd"] Jun 12 21:49:48.674008 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:49:48.673980 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2228cd12_aea5_49c2_a665_9237e0f45e0c.slice/crio-8a85590ac0eb3af7572607b1b7f8b711a457002be9276c4136a87d85252f2234 WatchSource:0}: Error finding container 8a85590ac0eb3af7572607b1b7f8b711a457002be9276c4136a87d85252f2234: Status 404 returned error can't find the container with id 8a85590ac0eb3af7572607b1b7f8b711a457002be9276c4136a87d85252f2234 Jun 12 21:49:49.037033 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:49.037005 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kcq4r" event={"ID":"a8029f62-78fe-46b2-8587-0c150c839d9c","Type":"ContainerStarted","Data":"7acdefc603c4e1e129bb505eb89d63c29dcc02c34672785301091323dba0465a"} Jun 12 21:49:49.037137 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:49.037071 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kcq4r" event={"ID":"a8029f62-78fe-46b2-8587-0c150c839d9c","Type":"ContainerStarted","Data":"9f41d2fde4c2ed39e75aa90e61a8497fa5cf6e6ca66a56578bc2b2092ee82b3a"} Jun 12 21:49:49.038315 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:49.038288 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" event={"ID":"2228cd12-aea5-49c2-a665-9237e0f45e0c","Type":"ContainerStarted","Data":"8a85590ac0eb3af7572607b1b7f8b711a457002be9276c4136a87d85252f2234"} Jun 12 21:49:50.045007 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:50.044967 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kcq4r" event={"ID":"a8029f62-78fe-46b2-8587-0c150c839d9c","Type":"ContainerStarted","Data":"4df118c68e7555684e49ef4a709cc824e70e592bd1470fecfa488a1dea3e1465"} Jun 12 21:49:50.059074 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:50.058992 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kcq4r" podStartSLOduration=375.153303146 podStartE2EDuration="6m16.058972889s" totalImagesPullingTime="905.669743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:49:50.058156323 +0000 UTC m=+376.782439585" watchObservedRunningTime="2026-06-12 21:49:50.058972889 +0000 UTC m=+376.783256140" Jun 12 21:49:51.051200 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:51.051169 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" event={"ID":"2228cd12-aea5-49c2-a665-9237e0f45e0c","Type":"ContainerStarted","Data":"6b44bbfb179ec9901ddfa16f130e23b63eb19e0dba09b13b403c835a808c03e2"} Jun 12 21:49:51.051486 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:51.051234 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" event={"ID":"2228cd12-aea5-49c2-a665-9237e0f45e0c","Type":"ContainerStarted","Data":"e1e3910604d2945bf4df1aca3d0392cef36570e5079a3c39942adfe6c95a9c3c"} Jun 12 21:49:52.057452 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:52.057418 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" event={"ID":"2228cd12-aea5-49c2-a665-9237e0f45e0c","Type":"ContainerStarted","Data":"daca77d748bd25be6c1168e7a42d823aa06b712182e285c785b600646e4abf45"} Jun 12 21:49:52.076628 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:49:52.076583 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-69f4c7b9d-gjfjd" podStartSLOduration=1.88454867 podStartE2EDuration="4.076568266s" totalImagesPullingTime="2.192019596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:49:52.075577346 +0000 UTC m=+378.799860649" watchObservedRunningTime="2026-06-12 21:49:52.076568266 +0000 UTC m=+378.800851515" Jun 12 21:52:06.100066 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:06.100031 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jtn4b/must-gather-xtw77"] Jun 12 21:52:06.103316 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:06.103300 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jtn4b/must-gather-xtw77" Jun 12 21:52:06.105090 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:06.105072 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jtn4b\"/\"kube-root-ca.crt\"" Jun 12 21:52:06.105169 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:06.105072 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jtn4b\"/\"openshift-service-ca.crt\"" Jun 12 21:52:06.110223 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:06.109974 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jtn4b/must-gather-xtw77"] Jun 12 21:52:06.209727 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:06.209702 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4cba4283-4075-4ab2-9676-973532d33e27-must-gather-output\") pod \"must-gather-xtw77\" (UID: \"4cba4283-4075-4ab2-9676-973532d33e27\") " pod="openshift-must-gather-jtn4b/must-gather-xtw77" Jun 12 21:52:06.209841 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:06.209752 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjw7n\" (UniqueName: \"kubernetes.io/projected/4cba4283-4075-4ab2-9676-973532d33e27-kube-api-access-hjw7n\") pod \"must-gather-xtw77\" (UID: \"4cba4283-4075-4ab2-9676-973532d33e27\") " pod="openshift-must-gather-jtn4b/must-gather-xtw77" Jun 12 21:52:06.310980 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:06.310956 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4cba4283-4075-4ab2-9676-973532d33e27-must-gather-output\") pod \"must-gather-xtw77\" (UID: \"4cba4283-4075-4ab2-9676-973532d33e27\") " pod="openshift-must-gather-jtn4b/must-gather-xtw77" Jun 12 21:52:06.311083 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:06.311001 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjw7n\" (UniqueName: \"kubernetes.io/projected/4cba4283-4075-4ab2-9676-973532d33e27-kube-api-access-hjw7n\") pod \"must-gather-xtw77\" (UID: \"4cba4283-4075-4ab2-9676-973532d33e27\") " pod="openshift-must-gather-jtn4b/must-gather-xtw77" Jun 12 21:52:06.311282 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:06.311264 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4cba4283-4075-4ab2-9676-973532d33e27-must-gather-output\") pod \"must-gather-xtw77\" (UID: \"4cba4283-4075-4ab2-9676-973532d33e27\") " pod="openshift-must-gather-jtn4b/must-gather-xtw77" Jun 12 21:52:06.318209 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:06.318185 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjw7n\" (UniqueName: \"kubernetes.io/projected/4cba4283-4075-4ab2-9676-973532d33e27-kube-api-access-hjw7n\") pod \"must-gather-xtw77\" (UID: \"4cba4283-4075-4ab2-9676-973532d33e27\") " pod="openshift-must-gather-jtn4b/must-gather-xtw77" Jun 12 21:52:06.424786 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:06.424724 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jtn4b/must-gather-xtw77" Jun 12 21:52:06.546106 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:06.546082 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jtn4b/must-gather-xtw77"] Jun 12 21:52:06.548647 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:52:06.548624 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4cba4283_4075_4ab2_9676_973532d33e27.slice/crio-4268a162e1386d738968e29b0aef3e9461e40828262b0d92c7ad7996ca3aa837 WatchSource:0}: Error finding container 4268a162e1386d738968e29b0aef3e9461e40828262b0d92c7ad7996ca3aa837: Status 404 returned error can't find the container with id 4268a162e1386d738968e29b0aef3e9461e40828262b0d92c7ad7996ca3aa837 Jun 12 21:52:06.609104 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:06.609077 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jtn4b/must-gather-xtw77" event={"ID":"4cba4283-4075-4ab2-9676-973532d33e27","Type":"ContainerStarted","Data":"4268a162e1386d738968e29b0aef3e9461e40828262b0d92c7ad7996ca3aa837"} Jun 12 21:52:07.616451 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:07.616362 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jtn4b/must-gather-xtw77" event={"ID":"4cba4283-4075-4ab2-9676-973532d33e27","Type":"ContainerStarted","Data":"80b6414c969052841bc9baba35397ca854f2cdba5a7c9f0dbea3b1c5575ac928"} Jun 12 21:52:07.616451 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:07.616411 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jtn4b/must-gather-xtw77" event={"ID":"4cba4283-4075-4ab2-9676-973532d33e27","Type":"ContainerStarted","Data":"eb64e2df71e636f79630475b5f70a0a28668d966530356c4f7fa8a9cbfb855c2"} Jun 12 21:52:07.631021 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:07.630972 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jtn4b/must-gather-xtw77" podStartSLOduration=0.846876402 podStartE2EDuration="1.630951617s" totalImagesPullingTime="784.075215ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 21:52:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:52:07.629221501 +0000 UTC m=+514.353504753" watchObservedRunningTime="2026-06-12 21:52:07.630951617 +0000 UTC m=+514.355234867" Jun 12 21:52:08.699775 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:08.699744 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pn5xz_54b820c6-53e5-455b-8211-32e44f9a925c/global-pull-secret-syncer/0.log" Jun 12 21:52:08.787889 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:08.787853 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t5rg9_8a74036c-9a66-4f91-95a1-0ea1881ad2e2/konnectivity-agent/0.log" Jun 12 21:52:08.803729 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:08.803702 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-93.ec2.internal_66a2fc8e948c8d5135e0ca9ee3460e65/haproxy/0.log" Jun 12 21:52:12.638362 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:12.638323 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8a296a6-d482-4739-8672-42a3261b760f/alertmanager/0.log" Jun 12 21:52:12.660057 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:12.660026 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8a296a6-d482-4739-8672-42a3261b760f/config-reloader/0.log" Jun 12 21:52:12.680004 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:12.679970 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8a296a6-d482-4739-8672-42a3261b760f/kube-rbac-proxy-web/0.log" Jun 12 21:52:12.700634 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:12.700610 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8a296a6-d482-4739-8672-42a3261b760f/kube-rbac-proxy/0.log" Jun 12 21:52:12.723898 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:12.723872 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8a296a6-d482-4739-8672-42a3261b760f/kube-rbac-proxy-metric/0.log" Jun 12 21:52:12.744287 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:12.744261 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8a296a6-d482-4739-8672-42a3261b760f/prom-label-proxy/0.log" Jun 12 21:52:12.765797 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:12.765771 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c8a296a6-d482-4739-8672-42a3261b760f/init-config-reloader/0.log" Jun 12 21:52:12.827337 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:12.827308 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-fbc9z_fef94b62-8120-4bfd-8d2f-894dc07892f0/kube-state-metrics/0.log" Jun 12 21:52:12.852294 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:12.852258 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-fbc9z_fef94b62-8120-4bfd-8d2f-894dc07892f0/kube-rbac-proxy-main/0.log" Jun 12 21:52:12.873862 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:12.873825 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-fbc9z_fef94b62-8120-4bfd-8d2f-894dc07892f0/kube-rbac-proxy-self/0.log" Jun 12 21:52:12.966414 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:12.966326 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gmmvl_8d5fd836-f36e-444c-92f1-1617e0be15c0/node-exporter/0.log" Jun 12 21:52:12.990321 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:12.990282 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gmmvl_8d5fd836-f36e-444c-92f1-1617e0be15c0/kube-rbac-proxy/0.log" Jun 12 21:52:13.011650 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:13.011623 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gmmvl_8d5fd836-f36e-444c-92f1-1617e0be15c0/init-textfile/0.log" Jun 12 21:52:13.182297 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:13.182254 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-v5mmn_f9990ef7-4c89-4ff9-80a7-12a40414352a/kube-rbac-proxy-main/0.log" Jun 12 21:52:13.204252 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:13.204133 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-v5mmn_f9990ef7-4c89-4ff9-80a7-12a40414352a/kube-rbac-proxy-self/0.log" Jun 12 21:52:13.231142 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:13.231070 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-v5mmn_f9990ef7-4c89-4ff9-80a7-12a40414352a/openshift-state-metrics/0.log" Jun 12 21:52:13.458858 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:13.458825 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-c8gl7_8b9d16a6-cb75-44c8-9dbc-cf9a82683fac/prometheus-operator/0.log" Jun 12 21:52:13.473619 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:13.473589 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-c8gl7_8b9d16a6-cb75-44c8-9dbc-cf9a82683fac/kube-rbac-proxy/0.log" Jun 12 21:52:13.499031 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:13.498950 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-nw7p6_cf9fb8bb-8e87-4e6f-b373-41cedc968a4d/prometheus-operator-admission-webhook/0.log" Jun 12 21:52:13.530323 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:13.530285 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69f4c7b9d-gjfjd_2228cd12-aea5-49c2-a665-9237e0f45e0c/telemeter-client/0.log" Jun 12 21:52:13.552308 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:13.552274 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69f4c7b9d-gjfjd_2228cd12-aea5-49c2-a665-9237e0f45e0c/reload/0.log" Jun 12 21:52:13.588788 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:13.588765 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69f4c7b9d-gjfjd_2228cd12-aea5-49c2-a665-9237e0f45e0c/kube-rbac-proxy/0.log" Jun 12 21:52:13.642469 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:13.642440 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d776c6f6-6vhdz_4e78eddd-2636-460b-9c15-5de0d00e5abd/thanos-query/0.log" Jun 12 21:52:13.677468 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:13.677441 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d776c6f6-6vhdz_4e78eddd-2636-460b-9c15-5de0d00e5abd/kube-rbac-proxy-web/0.log" Jun 12 21:52:13.717475 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:13.717444 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d776c6f6-6vhdz_4e78eddd-2636-460b-9c15-5de0d00e5abd/kube-rbac-proxy/0.log" Jun 12 21:52:13.748137 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:13.748060 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d776c6f6-6vhdz_4e78eddd-2636-460b-9c15-5de0d00e5abd/prom-label-proxy/0.log" Jun 12 21:52:13.793295 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:13.793219 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d776c6f6-6vhdz_4e78eddd-2636-460b-9c15-5de0d00e5abd/kube-rbac-proxy-rules/0.log" Jun 12 21:52:13.819695 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:13.819640 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d776c6f6-6vhdz_4e78eddd-2636-460b-9c15-5de0d00e5abd/kube-rbac-proxy-metrics/0.log" Jun 12 21:52:14.904473 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:14.904434 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-dsh99_7e6c3e41-23ae-4616-a236-48770e4b5462/networking-console-plugin/0.log" Jun 12 21:52:15.312406 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:15.312325 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vtz7b_15c9555f-ff57-4466-8a1d-afe9996ba621/console-operator/1.log" Jun 12 21:52:15.323118 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:15.323073 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-vtz7b_15c9555f-ff57-4466-8a1d-afe9996ba621/console-operator/2.log" Jun 12 21:52:15.734062 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:15.734021 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-h8b6l_c72f6610-122b-4b79-b186-fd68ea6d475c/download-server/0.log" Jun 12 21:52:16.017688 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.017602 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc"] Jun 12 21:52:16.023521 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.023497 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.025283 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.025266 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jtn4b\"/\"default-dockercfg-pvvdk\"" Jun 12 21:52:16.031792 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.031766 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc"] Jun 12 21:52:16.096776 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.096730 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ffcd0f1-feac-4262-83cb-6d3168c749c3-sys\") pod \"perf-node-gather-daemonset-l29lc\" (UID: \"1ffcd0f1-feac-4262-83cb-6d3168c749c3\") " pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.097084 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.097069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ffcd0f1-feac-4262-83cb-6d3168c749c3-proc\") pod \"perf-node-gather-daemonset-l29lc\" (UID: \"1ffcd0f1-feac-4262-83cb-6d3168c749c3\") " pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.097243 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.097226 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ffcd0f1-feac-4262-83cb-6d3168c749c3-podres\") pod \"perf-node-gather-daemonset-l29lc\" (UID: \"1ffcd0f1-feac-4262-83cb-6d3168c749c3\") " pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.097403 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.097389 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ffcd0f1-feac-4262-83cb-6d3168c749c3-lib-modules\") pod \"perf-node-gather-daemonset-l29lc\" (UID: \"1ffcd0f1-feac-4262-83cb-6d3168c749c3\") " pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.097537 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.097522 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64dxd\" (UniqueName: \"kubernetes.io/projected/1ffcd0f1-feac-4262-83cb-6d3168c749c3-kube-api-access-64dxd\") pod \"perf-node-gather-daemonset-l29lc\" (UID: \"1ffcd0f1-feac-4262-83cb-6d3168c749c3\") " pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.198293 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.198252 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64dxd\" (UniqueName: \"kubernetes.io/projected/1ffcd0f1-feac-4262-83cb-6d3168c749c3-kube-api-access-64dxd\") pod \"perf-node-gather-daemonset-l29lc\" (UID: \"1ffcd0f1-feac-4262-83cb-6d3168c749c3\") " pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.198474 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.198450 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ffcd0f1-feac-4262-83cb-6d3168c749c3-sys\") pod \"perf-node-gather-daemonset-l29lc\" (UID: \"1ffcd0f1-feac-4262-83cb-6d3168c749c3\") " pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.198559 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.198540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ffcd0f1-feac-4262-83cb-6d3168c749c3-proc\") pod \"perf-node-gather-daemonset-l29lc\" (UID: \"1ffcd0f1-feac-4262-83cb-6d3168c749c3\") " pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.198606 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.198577 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ffcd0f1-feac-4262-83cb-6d3168c749c3-podres\") pod \"perf-node-gather-daemonset-l29lc\" (UID: \"1ffcd0f1-feac-4262-83cb-6d3168c749c3\") " pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.198606 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.198581 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ffcd0f1-feac-4262-83cb-6d3168c749c3-sys\") pod \"perf-node-gather-daemonset-l29lc\" (UID: \"1ffcd0f1-feac-4262-83cb-6d3168c749c3\") " pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.198734 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.198650 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ffcd0f1-feac-4262-83cb-6d3168c749c3-lib-modules\") pod \"perf-node-gather-daemonset-l29lc\" (UID: \"1ffcd0f1-feac-4262-83cb-6d3168c749c3\") " pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.198734 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.198687 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ffcd0f1-feac-4262-83cb-6d3168c749c3-proc\") pod \"perf-node-gather-daemonset-l29lc\" (UID: \"1ffcd0f1-feac-4262-83cb-6d3168c749c3\") " pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.198734 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.198718 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ffcd0f1-feac-4262-83cb-6d3168c749c3-podres\") pod \"perf-node-gather-daemonset-l29lc\" (UID: \"1ffcd0f1-feac-4262-83cb-6d3168c749c3\") " pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.198834 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.198786 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ffcd0f1-feac-4262-83cb-6d3168c749c3-lib-modules\") pod \"perf-node-gather-daemonset-l29lc\" (UID: \"1ffcd0f1-feac-4262-83cb-6d3168c749c3\") " pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.207049 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.207024 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64dxd\" (UniqueName: \"kubernetes.io/projected/1ffcd0f1-feac-4262-83cb-6d3168c749c3-kube-api-access-64dxd\") pod \"perf-node-gather-daemonset-l29lc\" (UID: \"1ffcd0f1-feac-4262-83cb-6d3168c749c3\") " pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.225604 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.225582 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-fll8d_d1f254fe-4106-41d6-8295-5711c5e1dd6c/volume-data-source-validator/0.log" Jun 12 21:52:16.336178 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.336155 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.481550 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.481451 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc"] Jun 12 21:52:16.486289 ip-10-0-128-93 kubenswrapper[2563]: W0612 21:52:16.486258 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1ffcd0f1_feac_4262_83cb_6d3168c749c3.slice/crio-0f53eefe10fb778b9c146f4e0d3f63fdb2b36e7485fc3b06db182f7ddb435ece WatchSource:0}: Error finding container 0f53eefe10fb778b9c146f4e0d3f63fdb2b36e7485fc3b06db182f7ddb435ece: Status 404 returned error can't find the container with id 0f53eefe10fb778b9c146f4e0d3f63fdb2b36e7485fc3b06db182f7ddb435ece Jun 12 21:52:16.666204 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.666159 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" event={"ID":"1ffcd0f1-feac-4262-83cb-6d3168c749c3","Type":"ContainerStarted","Data":"a8524df502725c722c1e14acbaed1792439446cadc262c788204eb2ec8be856f"} Jun 12 21:52:16.666333 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.666224 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" event={"ID":"1ffcd0f1-feac-4262-83cb-6d3168c749c3","Type":"ContainerStarted","Data":"0f53eefe10fb778b9c146f4e0d3f63fdb2b36e7485fc3b06db182f7ddb435ece"} Jun 12 21:52:16.666738 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.666720 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:16.681122 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:16.681085 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" podStartSLOduration=0.68107258 podStartE2EDuration="681.07258ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 21:52:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 21:52:16.680821655 +0000 UTC m=+523.405104917" watchObservedRunningTime="2026-06-12 21:52:16.68107258 +0000 UTC m=+523.405355831" Jun 12 21:52:17.050833 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:17.050749 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vgf7j_6fd56879-c834-4b56-be2d-b20295f24c56/dns/0.log" Jun 12 21:52:17.118334 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:17.118307 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vgf7j_6fd56879-c834-4b56-be2d-b20295f24c56/kube-rbac-proxy/0.log" Jun 12 21:52:17.164228 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:17.164203 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n2rwp_3cd3425f-322c-481d-bcdc-cbc7a9676764/dns-node-resolver/0.log" Jun 12 21:52:17.571621 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:17.571597 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jjhkm_9a539c62-3abf-4aa8-af59-c5193cd47800/node-ca/0.log" Jun 12 21:52:18.554118 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:18.554093 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b2hff_91a20919-5d74-44b4-b238-7238a4e5f890/serve-healthcheck-canary/0.log" Jun 12 21:52:19.072659 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:19.072633 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rxh2m_ebdeff48-8dd7-4b34-89f0-a87effa678e5/kube-rbac-proxy/0.log" Jun 12 21:52:19.091619 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:19.091578 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rxh2m_ebdeff48-8dd7-4b34-89f0-a87effa678e5/exporter/0.log" Jun 12 21:52:19.111459 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:19.111439 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rxh2m_ebdeff48-8dd7-4b34-89f0-a87effa678e5/extractor/0.log" Jun 12 21:52:22.683700 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:22.683619 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jtn4b/perf-node-gather-daemonset-l29lc" Jun 12 21:52:22.814140 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:22.814108 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-d9v9b_5b7f3281-1bb5-41b2-b316-c4a482a4d175/migrator/0.log" Jun 12 21:52:22.831882 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:22.831858 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-d9v9b_5b7f3281-1bb5-41b2-b316-c4a482a4d175/graceful-termination/0.log" Jun 12 21:52:23.850145 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:23.850118 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4b7w6_0cb4ffdb-cf64-454c-af86-776a73f8d4c5/kube-multus/0.log" Jun 12 21:52:24.228759 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:24.228658 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qd7gq_7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d/kube-multus-additional-cni-plugins/0.log" Jun 12 21:52:24.251777 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:24.251719 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qd7gq_7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d/egress-router-binary-copy/0.log" Jun 12 21:52:24.272094 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:24.272030 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qd7gq_7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d/cni-plugins/0.log" Jun 12 21:52:24.297171 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:24.297151 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qd7gq_7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d/bond-cni-plugin/0.log" Jun 12 21:52:24.318210 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:24.318187 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qd7gq_7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d/routeoverride-cni/0.log" Jun 12 21:52:24.336945 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:24.336925 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qd7gq_7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d/whereabouts-cni-bincopy/0.log" Jun 12 21:52:24.355373 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:24.355351 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qd7gq_7bd3ee46-fbcf-48c9-9159-4ee1fe57a78d/whereabouts-cni/0.log" Jun 12 21:52:24.465109 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:24.465065 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kcq4r_a8029f62-78fe-46b2-8587-0c150c839d9c/network-metrics-daemon/0.log" Jun 12 21:52:24.484846 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:24.484788 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kcq4r_a8029f62-78fe-46b2-8587-0c150c839d9c/kube-rbac-proxy/0.log" Jun 12 21:52:25.311230 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:25.311152 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnlbf_d13fa689-39c1-4a87-8506-5a75fcf8ad40/ovn-controller/0.log" Jun 12 21:52:25.326931 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:25.326868 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnlbf_d13fa689-39c1-4a87-8506-5a75fcf8ad40/ovn-acl-logging/1.log" Jun 12 21:52:25.327086 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:25.326945 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnlbf_d13fa689-39c1-4a87-8506-5a75fcf8ad40/ovn-acl-logging/0.log" Jun 12 21:52:25.354403 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:25.354381 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnlbf_d13fa689-39c1-4a87-8506-5a75fcf8ad40/kube-rbac-proxy-node/0.log" Jun 12 21:52:25.379428 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:25.379384 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnlbf_d13fa689-39c1-4a87-8506-5a75fcf8ad40/kube-rbac-proxy-ovn-metrics/0.log" Jun 12 21:52:25.397128 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:25.397101 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnlbf_d13fa689-39c1-4a87-8506-5a75fcf8ad40/northd/0.log" Jun 12 21:52:25.415481 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:25.415456 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnlbf_d13fa689-39c1-4a87-8506-5a75fcf8ad40/nbdb/0.log" Jun 12 21:52:25.435489 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:25.435452 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnlbf_d13fa689-39c1-4a87-8506-5a75fcf8ad40/sbdb/0.log" Jun 12 21:52:25.489886 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:25.489855 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnlbf_d13fa689-39c1-4a87-8506-5a75fcf8ad40/ovnkube-controller/0.log" Jun 12 21:52:26.896172 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:26.896117 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-6947749cfc-p2ssr_02a87d0a-9f00-48bf-89d0-6bf4ac06acc7/check-endpoints/0.log" Jun 12 21:52:26.918290 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:26.918215 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-5n2vz_3e0ffb25-9794-4397-9dee-7b6f4cd32e3b/network-check-target-container/0.log" Jun 12 21:52:27.847249 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:27.847215 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-jwz9l_d8f7ac87-c842-4d2f-9307-1d3b28983356/iptables-alerter/0.log" Jun 12 21:52:28.452511 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:28.452489 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-jk7bg_5d4a7f67-5716-491d-a76a-e2f8ec4c5dd1/tuned/0.log" Jun 12 21:52:30.131616 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:30.131589 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-9547488fd-7jjnk_3b372dbe-3ecb-47cd-94ed-51c298ebbdd4/cluster-samples-operator/0.log" Jun 12 21:52:30.145332 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:30.145312 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-9547488fd-7jjnk_3b372dbe-3ecb-47cd-94ed-51c298ebbdd4/cluster-samples-operator-watch/0.log" Jun 12 21:52:31.283538 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:31.283512 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-7b994bc59-6mfkq_0b094c0b-b129-46dd-9952-99a170087493/service-ca-controller/0.log" Jun 12 21:52:31.774583 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:31.774559 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-tn6kc_2f45d449-7cd4-4b25-8972-69758824c534/csi-driver/0.log" Jun 12 21:52:31.797686 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:31.797646 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-tn6kc_2f45d449-7cd4-4b25-8972-69758824c534/csi-node-driver-registrar/0.log" Jun 12 21:52:31.819249 ip-10-0-128-93 kubenswrapper[2563]: I0612 21:52:31.819226 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-tn6kc_2f45d449-7cd4-4b25-8972-69758824c534/csi-liveness-probe/0.log"