Jun 10 20:39:09.566353 ip-10-0-140-84 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 20:39:09.566367 ip-10-0-140-84 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 20:39:09.566377 ip-10-0-140-84 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 20:39:09.566597 ip-10-0-140-84 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 20:39:19.753522 ip-10-0-140-84 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 20:39:19.753544 ip-10-0-140-84 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c1a6d4ebcd964a54b1d44f7095d786e7 -- Jun 10 20:41:52.717376 ip-10-0-140-84 systemd[1]: Starting Kubernetes Kubelet... Jun 10 20:41:53.103109 ip-10-0-140-84 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 20:41:53.103109 ip-10-0-140-84 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 20:41:53.103109 ip-10-0-140-84 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 20:41:53.103109 ip-10-0-140-84 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 20:41:53.103109 ip-10-0-140-84 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 20:41:53.104313 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.103121 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 20:41:53.107640 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107619 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:41:53.107640 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107639 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:41:53.107640 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107643 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107647 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107651 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107655 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107658 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107661 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107663 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107666 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107669 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107672 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107675 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107677 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107680 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107682 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107685 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107694 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107697 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107700 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107703 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107705 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:41:53.107737 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107708 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107711 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107713 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107716 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107718 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107721 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107723 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107726 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107730 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107732 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107735 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107738 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107741 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107744 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107748 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107751 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107755 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107757 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107760 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107763 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:41:53.108230 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107765 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107768 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107771 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107773 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107776 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107779 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107782 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107784 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107787 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107790 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107792 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107795 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107799 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107805 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107810 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107813 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107816 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107820 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107822 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107825 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:41:53.108807 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107828 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107831 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107834 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107838 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107841 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107845 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107848 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107851 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107854 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107857 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107859 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107862 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107865 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107867 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107870 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107873 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107875 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107877 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107881 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:41:53.109300 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107884 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107887 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107890 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107892 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107895 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107897 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107899 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107902 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107905 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107907 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107910 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107913 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107916 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107919 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107921 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107924 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107926 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.107929 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108668 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108675 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:41:53.109910 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108679 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108682 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108685 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108689 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108692 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108695 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108697 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108700 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108702 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108705 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108707 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108710 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108713 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108716 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108720 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108723 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108727 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108731 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108734 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:41:53.110585 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108736 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108739 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108742 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108744 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108747 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108750 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108753 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108755 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108758 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108761 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108763 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108766 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108768 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108771 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108774 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108776 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108779 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108782 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108785 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108787 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:41:53.111115 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108789 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108792 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108795 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108797 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108801 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108805 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108808 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108811 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108814 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108817 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108820 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108823 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108825 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108828 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108831 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108833 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108836 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108838 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108841 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108844 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:41:53.111617 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108846 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108849 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108851 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108855 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108857 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108860 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108863 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108866 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108869 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108872 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108876 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108880 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108883 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108886 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108889 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108891 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108894 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108898 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108900 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108903 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:41:53.112131 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108906 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108909 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108912 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108915 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108918 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108920 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108923 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108926 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108929 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108932 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108935 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108938 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108941 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108943 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108945 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108948 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108951 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.108953 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.109523 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.109541 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:41:53.112618 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.109546 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.109551 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.110981 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.110996 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111001 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111033 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111038 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111041 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111151 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111155 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111158 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111161 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111164 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111167 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111169 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111172 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111175 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111178 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111181 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111183 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:41:53.113127 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111186 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111189 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111192 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111195 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111197 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111200 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111203 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111206 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111210 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111214 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111217 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111220 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111223 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111226 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111229 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111232 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111236 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111238 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111241 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:41:53.113607 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111248 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111253 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111256 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111258 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111261 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111263 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111266 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111269 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111272 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111275 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111277 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111280 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111283 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111285 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111288 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111290 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111293 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111295 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111298 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:41:53.114085 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111302 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111306 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111309 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111312 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111315 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111318 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111322 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111325 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111328 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111338 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111342 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111345 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111348 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111350 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111353 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111357 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111360 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111363 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111366 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:41:53.114527 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111368 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111371 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111374 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111376 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111379 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111381 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111384 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111387 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111389 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111392 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111394 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111397 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111399 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111402 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111404 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111407 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111409 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111412 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111414 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.111417 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111495 2554 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 20:41:53.114984 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111503 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111511 2554 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111516 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111520 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111524 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111528 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111532 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111536 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111539 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111542 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111545 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111549 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111551 2554 flags.go:64] FLAG: --cgroup-root="" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111554 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111557 2554 flags.go:64] FLAG: --client-ca-file="" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111560 2554 flags.go:64] FLAG: --cloud-provider="external" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111565 2554 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111569 2554 flags.go:64] FLAG: --cluster-domain="" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111572 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111575 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111579 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111582 2554 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111586 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 20:41:53.115496 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111589 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111592 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111595 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111598 2554 flags.go:64] FLAG: --contention-profiling="false" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111601 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111604 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111608 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111611 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111615 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111618 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111622 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111626 2554 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111629 2554 flags.go:64] FLAG: --enable-server="true" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111632 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111637 2554 flags.go:64] FLAG: --event-burst="100" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111640 2554 flags.go:64] FLAG: --event-qps="50" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111643 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111646 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111648 2554 flags.go:64] FLAG: --eviction-hard="" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111655 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111659 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111661 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111665 2554 flags.go:64] FLAG: --eviction-soft="" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111668 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111670 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 20:41:53.116139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111673 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111676 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111679 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111682 2554 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111685 2554 flags.go:64] FLAG: --feature-gates="" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111696 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111699 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111702 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111706 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111709 2554 flags.go:64] FLAG: --healthz-port="10248" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111712 2554 flags.go:64] FLAG: --help="false" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111715 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111718 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111721 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111724 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111727 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111731 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111734 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111737 2554 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111740 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111742 2554 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111745 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111749 2554 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111751 2554 flags.go:64] FLAG: --kube-reserved="" Jun 10 20:41:53.116752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111754 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111757 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111760 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111763 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111765 2554 flags.go:64] FLAG: --lock-file="" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111768 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111771 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111774 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111780 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111784 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111787 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111790 2554 flags.go:64] FLAG: --logging-format="text" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111793 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111796 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111799 2554 flags.go:64] FLAG: --manifest-url="" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111802 2554 flags.go:64] FLAG: --manifest-url-header="" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111806 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111813 2554 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111817 2554 flags.go:64] FLAG: --max-pods="110" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111820 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111823 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111826 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111829 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111832 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111835 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 20:41:53.117374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111838 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111845 2554 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111848 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111852 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111855 2554 flags.go:64] FLAG: --pod-cidr="" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111858 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111864 2554 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111867 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111870 2554 flags.go:64] FLAG: --pods-per-core="0" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111872 2554 flags.go:64] FLAG: --port="10250" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111875 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111878 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-000e463df36c3ac3b" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111882 2554 flags.go:64] FLAG: --qos-reserved="" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111884 2554 flags.go:64] FLAG: --read-only-port="10255" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111887 2554 flags.go:64] FLAG: --register-node="true" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111891 2554 flags.go:64] FLAG: --register-with-taints="" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111895 2554 flags.go:64] FLAG: --registry-burst="10" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111898 2554 flags.go:64] FLAG: --registry-qps="5" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111902 2554 flags.go:64] FLAG: --reserved-cpus="" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111904 2554 flags.go:64] FLAG: --reserved-memory="" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111908 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111911 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111914 2554 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111917 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111920 2554 flags.go:64] FLAG: --runonce="false" Jun 10 20:41:53.117988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111924 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111927 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111930 2554 flags.go:64] FLAG: --seccomp-default="false" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111933 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111936 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111939 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111942 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111945 2554 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111948 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111951 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111954 2554 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111956 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111959 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111962 2554 flags.go:64] FLAG: --system-cgroups="" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111965 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111971 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111974 2554 flags.go:64] FLAG: --tls-cert-file="" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111977 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111981 2554 flags.go:64] FLAG: --tls-min-version="" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111984 2554 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111986 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111989 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111992 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111995 2554 flags.go:64] FLAG: --v="2" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.111999 2554 flags.go:64] FLAG: --version="false" Jun 10 20:41:53.118606 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.112003 2554 flags.go:64] FLAG: --vmodule="" Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.112024 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.112028 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112143 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112148 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112151 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112153 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112157 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112160 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112163 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112166 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112168 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112171 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112174 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112177 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112180 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112182 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112185 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112187 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112190 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:41:53.119232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112193 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112196 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112198 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112201 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112204 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112206 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112209 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112212 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112214 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112217 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112220 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112222 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112225 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112228 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112232 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112235 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112238 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112240 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112244 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112248 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:41:53.119722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112251 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112253 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112256 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112258 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112261 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112264 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112266 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112269 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112273 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112276 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112279 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112283 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112286 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112289 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112292 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112294 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112298 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112301 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112304 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:41:53.120233 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112307 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112309 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112312 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112315 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112317 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112320 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112322 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112325 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112328 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112331 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112333 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112337 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112342 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112345 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112347 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112350 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112352 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112355 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112357 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112360 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:41:53.120722 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112363 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112365 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112368 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112371 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112374 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112376 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112379 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112381 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112384 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112387 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112389 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112392 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112394 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112397 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112400 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112402 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112405 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112407 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112409 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:41:53.121235 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112412 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:41:53.121703 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112415 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:41:53.121703 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112418 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:41:53.121703 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.112422 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:41:53.121703 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.112432 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 20:41:53.121703 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.119092 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 20:41:53.121703 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.119109 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 20:41:53.121703 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.119130 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 20:41:53.121703 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.119136 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 20:41:53.121703 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119194 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:41:53.121703 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119199 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:41:53.121703 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119202 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:41:53.121703 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119205 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:41:53.121703 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119208 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:41:53.121703 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119212 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119215 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119218 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119221 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119223 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119226 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119229 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119231 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119234 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119237 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119240 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119243 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119245 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119248 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119251 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119253 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119256 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119259 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119261 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119264 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:41:53.122102 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119266 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119269 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119272 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119274 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119282 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119285 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119287 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119290 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119293 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119295 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119298 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119301 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119303 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119306 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119309 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119312 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119316 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119319 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119322 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:41:53.122596 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119325 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119328 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119332 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119336 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119339 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119342 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119345 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119348 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119351 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119353 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119356 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119359 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119362 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119365 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119368 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119371 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119373 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119377 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119380 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:41:53.123108 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119384 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119388 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119391 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119395 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119397 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119400 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119403 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119405 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119408 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119411 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119413 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119416 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119418 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119421 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119424 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119426 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119429 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119432 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119435 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119437 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:41:53.123576 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119440 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:41:53.124075 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119443 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:41:53.124075 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119445 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:41:53.124075 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119448 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:41:53.124075 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119451 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:41:53.124075 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119453 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:41:53.124075 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119456 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:41:53.124075 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119458 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:41:53.124075 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119461 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:41:53.124075 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119464 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:41:53.124075 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119468 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:41:53.124075 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119470 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:41:53.124075 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119474 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:41:53.124075 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119476 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:41:53.124075 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119479 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:41:53.124075 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119482 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:41:53.124460 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.119487 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 20:41:53.124460 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119606 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:41:53.124460 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119611 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:41:53.124460 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119614 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:41:53.124460 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119617 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:41:53.124460 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119621 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:41:53.124460 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119625 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:41:53.124460 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119628 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:41:53.124460 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119631 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:41:53.124460 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119634 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:41:53.124460 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119637 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:41:53.124460 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119639 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:41:53.124460 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119642 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:41:53.124460 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119644 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:41:53.124460 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119647 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119650 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119652 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119655 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119657 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119660 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119662 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119665 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119667 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119669 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119672 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119674 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119677 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119680 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119682 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119686 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119697 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119700 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119703 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119706 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:41:53.124843 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119708 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119711 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119713 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119716 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119718 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119722 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119726 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119729 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119732 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119735 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119739 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119741 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119744 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119747 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119750 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119753 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119756 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119758 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119761 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:41:53.125342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119764 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119767 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119770 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119773 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119776 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119779 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119782 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119785 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119788 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119792 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119795 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119797 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119800 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119802 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119805 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119808 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119810 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119813 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119815 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119818 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:41:53.125805 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119821 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119824 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119827 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119831 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119834 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119837 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119839 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119842 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119845 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119847 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119850 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119852 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119855 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119857 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119860 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119863 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119865 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119868 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119870 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:41:53.126305 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119873 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:41:53.126775 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119875 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:41:53.126775 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119878 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:41:53.126775 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119881 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:41:53.126775 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119884 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:41:53.126775 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119887 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:41:53.126775 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119889 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:41:53.126775 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:53.119892 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:41:53.126775 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.119897 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 20:41:53.126775 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.120029 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 20:41:53.126775 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.121976 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 20:41:53.126775 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.123406 2554 server.go:1019] "Starting client certificate rotation" Jun 10 20:41:53.126775 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.123509 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 20:41:53.126775 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.123544 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 20:41:53.127135 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.125827 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 20:41:53.127135 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.126993 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 20:41:53.135982 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.135963 2554 log.go:25] "Validated CRI v1 runtime API" Jun 10 20:41:53.139040 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.138998 2554 log.go:25] "Validated CRI v1 image API" Jun 10 20:41:53.141185 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.141159 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 20:41:53.143765 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.143744 2554 fs.go:135] Filesystem UUIDs: map[654aefdd-b54f-4c13-9031-9f30e124e529:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8a6b33d1-d108-4699-917e-614a35587c52:/dev/nvme0n1p4] Jun 10 20:41:53.143836 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.143763 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 20:41:53.149730 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.149605 2554 manager.go:216] Machine: {Timestamp:2026-06-10 20:41:53.148303101 +0000 UTC m=+0.316341837 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098817 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24e8a8ba5c0ac7adf8872e619abeb4 SystemUUID:ec24e8a8-ba5c-0ac7-adf8-872e619abeb4 BootID:c1a6d4eb-cd96-4a54-b1d4-4f7095d786e7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2a:28:fd:60:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2a:28:fd:60:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:82:0d:c4:31:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 20:41:53.149730 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.149724 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 20:41:53.149867 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.149854 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 20:41:53.152863 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.152832 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 20:41:53.153001 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.152863 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-84.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 20:41:53.153641 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.153629 2554 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 20:41:53.153683 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.153643 2554 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 20:41:53.153683 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.153651 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 20:41:53.154379 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.154368 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 20:41:53.155129 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.155119 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 20:41:53.156142 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.156123 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 20:41:53.158041 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.158026 2554 state_mem.go:36] "Initialized new in-memory state store" Jun 10 20:41:53.158199 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.158187 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 20:41:53.158255 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.158226 2554 kubelet.go:486] "Attempting to sync node with API server" Jun 10 20:41:53.158255 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.158247 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 20:41:53.158345 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.158268 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 20:41:53.158345 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.158284 2554 kubelet.go:398] "Adding apiserver pod source" Jun 10 20:41:53.158345 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.158298 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 20:41:53.158689 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.158675 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 20:41:53.158758 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.158698 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 20:41:53.162276 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.162258 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 20:41:53.163637 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.163594 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 20:41:53.163703 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.163654 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 20:41:53.165352 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.165339 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 20:41:53.165401 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.165359 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 20:41:53.165401 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.165366 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 20:41:53.165401 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.165372 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 20:41:53.165401 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.165381 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 20:41:53.165401 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.165387 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 20:41:53.165401 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.165395 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 20:41:53.165401 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.165402 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 20:41:53.165576 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.165410 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 20:41:53.165576 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.165418 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 20:41:53.165576 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.165433 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 20:41:53.165576 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.165439 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 20:41:53.166054 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.166043 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 20:41:53.166054 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.166055 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 20:41:53.169374 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.169358 2554 server.go:1268] "Started kubelet" Jun 10 20:41:53.169455 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.169430 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 20:41:53.169854 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.169552 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 20:41:53.169854 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.169684 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 20:41:53.170326 ip-10-0-140-84 systemd[1]: Started Kubernetes Kubelet. Jun 10 20:41:53.170895 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.170348 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-84.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 20:41:53.170895 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.170375 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 20:41:53.170895 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.170380 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 20:41:53.171565 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.171545 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 20:41:53.172064 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.172048 2554 server.go:310] "Adding debug handlers to kubelet server" Jun 10 20:41:53.176888 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.176867 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 20:41:53.176888 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.176871 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 20:41:53.177069 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.176973 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-84.ec2.internal\" not found" Jun 10 20:41:53.177426 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.175992 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-84.ec2.internal.18b7d2f1b2571822 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-84.ec2.internal,UID:ip-10-0-140-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-84.ec2.internal,},FirstTimestamp:2026-06-10 20:41:53.169324066 +0000 UTC m=+0.337362785,LastTimestamp:2026-06-10 20:41:53.169324066 +0000 UTC m=+0.337362785,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-84.ec2.internal,}" Jun 10 20:41:53.177586 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.177565 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 20:41:53.177639 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.177566 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 20:41:53.177639 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.177611 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 20:41:53.177737 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.177725 2554 reconstruct.go:97] "Volume reconstruction finished" Jun 10 20:41:53.177737 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.177733 2554 factory.go:55] Registering systemd factory Jun 10 20:41:53.177814 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.177738 2554 reconciler.go:29] "Reconciler: start to sync state" Jun 10 20:41:53.177814 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.177744 2554 factory.go:223] Registration of the systemd container factory successfully Jun 10 20:41:53.177948 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.177935 2554 factory.go:153] Registering CRI-O factory Jun 10 20:41:53.177998 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.177952 2554 factory.go:223] Registration of the crio container factory successfully Jun 10 20:41:53.178090 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.178078 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 20:41:53.178142 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.178107 2554 factory.go:103] Registering Raw factory Jun 10 20:41:53.178142 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.178123 2554 manager.go:1196] Started watching for new ooms in manager Jun 10 20:41:53.178572 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.178557 2554 manager.go:349] Starting recovery of all containers Jun 10 20:41:53.178803 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.178782 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 20:41:53.186174 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.186138 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 20:41:53.186839 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.186819 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 20:41:53.190501 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.190485 2554 manager.go:354] Recovery completed Jun 10 20:41:53.195601 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.195587 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:41:53.197911 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.197894 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:41:53.197976 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.197925 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:41:53.197976 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.197936 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:41:53.198499 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.198481 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 20:41:53.198499 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.198497 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 20:41:53.198597 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.198515 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:41:53.198597 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.198525 2554 state_mem.go:36] "Initialized new in-memory state store" Jun 10 20:41:53.198958 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.198939 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8m5hw" Jun 10 20:41:53.199249 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.199230 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:41:53.199324 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.199266 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:41:53.199324 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.199280 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:41:53.200025 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.199993 2554 policy_none.go:49] "None policy: Start" Jun 10 20:41:53.200111 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.200099 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 20:41:53.200145 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.200121 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 20:41:53.201102 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.201091 2554 policy_none.go:47] "Start" Jun 10 20:41:53.208085 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.207985 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-84.ec2.internal.18b7d2f1b40b4cc6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-84.ec2.internal,UID:ip-10-0-140-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-84.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-84.ec2.internal,},FirstTimestamp:2026-06-10 20:41:53.197911238 +0000 UTC m=+0.365949957,LastTimestamp:2026-06-10 20:41:53.197911238 +0000 UTC m=+0.365949957,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-84.ec2.internal,}" Jun 10 20:41:53.208179 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.208110 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8m5hw" Jun 10 20:41:53.211038 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.210909 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-84.ec2.internal.18b7d2f1b40b987e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-84.ec2.internal,UID:ip-10-0-140-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-84.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-84.ec2.internal,},FirstTimestamp:2026-06-10 20:41:53.197930622 +0000 UTC m=+0.365969341,LastTimestamp:2026-06-10 20:41:53.197930622 +0000 UTC m=+0.365969341,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-84.ec2.internal,}" Jun 10 20:41:53.248687 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.232673 2554 manager.go:337] "Starting Device Plugin manager" Jun 10 20:41:53.248687 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.232708 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 20:41:53.248687 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.232718 2554 server.go:87] "Starting device plugin registration server" Jun 10 20:41:53.248687 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.233020 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 20:41:53.248687 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.233033 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 20:41:53.248687 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.233142 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 20:41:53.248687 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.233231 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 20:41:53.248687 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.233240 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 20:41:53.248687 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.234536 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 20:41:53.248687 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.234589 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-84.ec2.internal\" not found" Jun 10 20:41:53.248687 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.245322 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 20:41:53.248687 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.246608 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 20:41:53.248687 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.246664 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 20:41:53.248687 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.246691 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 20:41:53.248687 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.246735 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 20:41:53.249232 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.249133 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:41:53.333703 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.333683 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:41:53.335962 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.335944 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:41:53.336072 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.335973 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:41:53.336072 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.335984 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:41:53.336072 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.336018 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.347507 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.347463 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-84.ec2.internal"] Jun 10 20:41:53.347592 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.347548 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:41:53.349703 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.349685 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:41:53.349703 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.349700 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.349844 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.349720 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:41:53.349844 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.349720 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-84.ec2.internal\": node \"ip-10-0-140-84.ec2.internal\" not found" Jun 10 20:41:53.349844 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.349735 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:41:53.351042 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.351027 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:41:53.351144 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.351129 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.351189 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.351168 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:41:53.352036 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.352000 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:41:53.352116 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.352046 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:41:53.352116 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.352056 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:41:53.352116 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.352108 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:41:53.352243 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.352135 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:41:53.352243 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.352147 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:41:53.353266 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.353227 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.353266 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.353264 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:41:53.354550 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.354532 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:41:53.354616 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.354568 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:41:53.354616 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.354582 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:41:53.374986 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.374950 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-84.ec2.internal\" not found" node="ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.379449 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.379421 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/681550990802757c8d9284c7e126bbe0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal\" (UID: \"681550990802757c8d9284c7e126bbe0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.379542 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.379462 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/681550990802757c8d9284c7e126bbe0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal\" (UID: \"681550990802757c8d9284c7e126bbe0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.379542 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.379477 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-84.ec2.internal\" not found" node="ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.379542 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.379489 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb606e6e49ab7c92af3bf94d0bc58e30-config\") pod \"kube-apiserver-proxy-ip-10-0-140-84.ec2.internal\" (UID: \"eb606e6e49ab7c92af3bf94d0bc58e30\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.382215 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.382198 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-84.ec2.internal\" not found" Jun 10 20:41:53.480111 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.480067 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb606e6e49ab7c92af3bf94d0bc58e30-config\") pod \"kube-apiserver-proxy-ip-10-0-140-84.ec2.internal\" (UID: \"eb606e6e49ab7c92af3bf94d0bc58e30\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.480111 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.480108 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/681550990802757c8d9284c7e126bbe0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal\" (UID: \"681550990802757c8d9284c7e126bbe0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.480339 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.480165 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/681550990802757c8d9284c7e126bbe0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal\" (UID: \"681550990802757c8d9284c7e126bbe0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.480339 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.480179 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eb606e6e49ab7c92af3bf94d0bc58e30-config\") pod \"kube-apiserver-proxy-ip-10-0-140-84.ec2.internal\" (UID: \"eb606e6e49ab7c92af3bf94d0bc58e30\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.480339 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.480227 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/681550990802757c8d9284c7e126bbe0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal\" (UID: \"681550990802757c8d9284c7e126bbe0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.480339 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.480233 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/681550990802757c8d9284c7e126bbe0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal\" (UID: \"681550990802757c8d9284c7e126bbe0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.483156 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.483141 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-84.ec2.internal\" not found" Jun 10 20:41:53.583781 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.583751 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-84.ec2.internal\" not found" Jun 10 20:41:53.679500 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.679417 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.684077 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.684054 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-84.ec2.internal\" not found" Jun 10 20:41:53.684077 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:53.684057 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-84.ec2.internal" Jun 10 20:41:53.784371 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.784328 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-84.ec2.internal\" not found" Jun 10 20:41:53.885005 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.884961 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-84.ec2.internal\" not found" Jun 10 20:41:53.985514 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:53.985427 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-84.ec2.internal\" not found" Jun 10 20:41:54.086028 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:54.085979 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-84.ec2.internal\" not found" Jun 10 20:41:54.123187 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.123153 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 20:41:54.123849 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.123308 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 20:41:54.155078 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:54.155048 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb606e6e49ab7c92af3bf94d0bc58e30.slice/crio-132019a18fd6b2f98a197da9653083ed19951baf0adfb9bb58e06e04abb11442 WatchSource:0}: Error finding container 132019a18fd6b2f98a197da9653083ed19951baf0adfb9bb58e06e04abb11442: Status 404 returned error can't find the container with id 132019a18fd6b2f98a197da9653083ed19951baf0adfb9bb58e06e04abb11442 Jun 10 20:41:54.155288 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:54.155270 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod681550990802757c8d9284c7e126bbe0.slice/crio-7b3f1ff2e164f0a218735eb92b85519dc66d2b4210f2a41b149f1d2e9547cb3f WatchSource:0}: Error finding container 7b3f1ff2e164f0a218735eb92b85519dc66d2b4210f2a41b149f1d2e9547cb3f: Status 404 returned error can't find the container with id 7b3f1ff2e164f0a218735eb92b85519dc66d2b4210f2a41b149f1d2e9547cb3f Jun 10 20:41:54.159269 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.159252 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 20:41:54.186216 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:54.186181 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-84.ec2.internal\" not found" Jun 10 20:41:54.211415 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.211358 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 20:36:53 +0000 UTC" deadline="2028-03-14 12:36:54.466274422 +0000 UTC" Jun 10 20:41:54.211415 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.211413 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15423h55m0.254865027s" Jun 10 20:41:54.250039 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.249921 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-84.ec2.internal" event={"ID":"eb606e6e49ab7c92af3bf94d0bc58e30","Type":"ContainerStarted","Data":"132019a18fd6b2f98a197da9653083ed19951baf0adfb9bb58e06e04abb11442"} Jun 10 20:41:54.250921 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.250902 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal" event={"ID":"681550990802757c8d9284c7e126bbe0","Type":"ContainerStarted","Data":"7b3f1ff2e164f0a218735eb92b85519dc66d2b4210f2a41b149f1d2e9547cb3f"} Jun 10 20:41:54.278145 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.278113 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:41:54.279091 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.279075 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:41:54.279184 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.279105 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:41:54.279184 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.279117 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:41:54.286278 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:54.286261 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-84.ec2.internal\" not found" Jun 10 20:41:54.295144 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.295126 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:41:54.387291 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:54.387255 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-84.ec2.internal\" not found" Jun 10 20:41:54.487834 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:54.487796 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-84.ec2.internal\" not found" Jun 10 20:41:54.589064 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.587733 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:41:54.589064 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:54.588133 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-84.ec2.internal\" not found" Jun 10 20:41:54.670990 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.670960 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:41:54.677550 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.677515 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal" Jun 10 20:41:54.692509 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.692480 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 20:41:54.693588 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.693570 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-84.ec2.internal" Jun 10 20:41:54.703793 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:54.703775 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 20:41:55.159325 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.159272 2554 apiserver.go:52] "Watching apiserver" Jun 10 20:41:55.171128 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.171098 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 20:41:55.171569 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.171540 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-5wvlk","openshift-network-diagnostics/network-check-target-frh2j","openshift-network-operator/iptables-alerter-qrx7z","openshift-ovn-kubernetes/ovnkube-node-j5dd9","kube-system/global-pull-secret-syncer-888f4","kube-system/konnectivity-agent-mc66f","kube-system/kube-apiserver-proxy-ip-10-0-140-84.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp","openshift-cluster-node-tuning-operator/tuned-bzhjf","openshift-dns/node-resolver-5mnxb","openshift-image-registry/node-ca-zfl89","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal","openshift-multus/multus-additional-cni-plugins-wkzj6","openshift-multus/multus-kgsz7"] Jun 10 20:41:55.173134 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.173097 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5mnxb" Jun 10 20:41:55.174354 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.174332 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.175483 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.175302 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qrx7z" Jun 10 20:41:55.176283 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.176263 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 20:41:55.177315 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.176724 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qcrvt\"" Jun 10 20:41:55.177315 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.176738 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 20:41:55.177315 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.176747 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.180154 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.178300 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 20:41:55.180154 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.178535 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 20:41:55.180154 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.178554 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 20:41:55.180154 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.178536 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 20:41:55.180154 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.178721 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:41:55.180154 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:55.178779 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-888f4" podUID="a48d3544-c7a8-49d0-b6f0-720732a6f056" Jun 10 20:41:55.180154 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.178982 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dvgrh\"" Jun 10 20:41:55.180154 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.179104 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 20:41:55.180154 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.179153 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r52jn\"" Jun 10 20:41:55.180154 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.179282 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:41:55.180154 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.179358 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 20:41:55.180154 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.180162 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mc66f" Jun 10 20:41:55.181460 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.181435 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 20:41:55.181595 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.181579 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 20:41:55.181704 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.181688 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 20:41:55.182033 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.181796 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 20:41:55.182033 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.181913 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 20:41:55.182033 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.181992 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 20:41:55.182431 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.182302 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 20:41:55.183598 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.182548 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.183598 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.182658 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 20:41:55.183598 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.183234 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.186125 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.184998 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:41:55.186125 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.185102 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jvv5n\"" Jun 10 20:41:55.186125 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.185364 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 20:41:55.186125 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:55.185628 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frh2j" podUID="f6f0966a-134e-47fd-b989-63a633ca073e" Jun 10 20:41:55.186375 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.186289 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lxnkx\"" Jun 10 20:41:55.186504 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.186000 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 20:41:55.186801 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.186483 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:41:55.187631 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.187373 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s2mtz\"" Jun 10 20:41:55.187851 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.187828 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:41:55.187940 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:55.187920 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:41:55.188133 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.188109 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 20:41:55.188349 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.188328 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-czb9t\"" Jun 10 20:41:55.188628 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.188609 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 20:41:55.189509 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.189491 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zfl89" Jun 10 20:41:55.190153 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190128 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-run-systemd\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.190253 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190168 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-run-ovn\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.190253 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190192 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-cni-bin\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.190253 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190214 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e775399-2b2b-45c1-823c-dc848145fd90-hosts-file\") pod \"node-resolver-5mnxb\" (UID: \"8e775399-2b2b-45c1-823c-dc848145fd90\") " pod="openshift-dns/node-resolver-5mnxb" Jun 10 20:41:55.190253 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190239 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw77j\" (UniqueName: \"kubernetes.io/projected/be8a6911-3511-4477-8ad3-bede37c12310-kube-api-access-zw77j\") pod \"iptables-alerter-qrx7z\" (UID: \"be8a6911-3511-4477-8ad3-bede37c12310\") " pod="openshift-network-operator/iptables-alerter-qrx7z" Jun 10 20:41:55.190501 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190262 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-log-socket\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.190501 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190286 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.190501 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190311 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e775399-2b2b-45c1-823c-dc848145fd90-tmp-dir\") pod \"node-resolver-5mnxb\" (UID: \"8e775399-2b2b-45c1-823c-dc848145fd90\") " pod="openshift-dns/node-resolver-5mnxb" Jun 10 20:41:55.190501 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190335 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f817cd6-446c-4995-b2d5-ebf8f614d598-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.190501 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190359 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwn2z\" (UniqueName: \"kubernetes.io/projected/2f817cd6-446c-4995-b2d5-ebf8f614d598-kube-api-access-hwn2z\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.190501 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190382 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be8a6911-3511-4477-8ad3-bede37c12310-host-slash\") pod \"iptables-alerter-qrx7z\" (UID: \"be8a6911-3511-4477-8ad3-bede37c12310\") " pod="openshift-network-operator/iptables-alerter-qrx7z" Jun 10 20:41:55.190501 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190403 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-kubelet\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.190501 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190425 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-cni-netd\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.190501 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190447 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d056ae52-f669-4b21-abb9-1223de0b748e-ovnkube-config\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.190501 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190468 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a48d3544-c7a8-49d0-b6f0-720732a6f056-dbus\") pod \"global-pull-secret-syncer-888f4\" (UID: \"a48d3544-c7a8-49d0-b6f0-720732a6f056\") " pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:41:55.190501 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190491 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d056ae52-f669-4b21-abb9-1223de0b748e-env-overrides\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.191106 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190521 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d056ae52-f669-4b21-abb9-1223de0b748e-ovnkube-script-lib\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.191106 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190548 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret\") pod \"global-pull-secret-syncer-888f4\" (UID: \"a48d3544-c7a8-49d0-b6f0-720732a6f056\") " pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:41:55.191106 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190572 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f817cd6-446c-4995-b2d5-ebf8f614d598-os-release\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.191106 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190594 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-run-netns\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.191106 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190616 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a48d3544-c7a8-49d0-b6f0-720732a6f056-kubelet-config\") pod \"global-pull-secret-syncer-888f4\" (UID: \"a48d3544-c7a8-49d0-b6f0-720732a6f056\") " pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:41:55.191106 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190640 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f817cd6-446c-4995-b2d5-ebf8f614d598-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.191106 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190664 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-systemd-units\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.191106 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190687 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-var-lib-openvswitch\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.191106 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190709 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-run-openvswitch\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.191106 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190732 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-run-ovn-kubernetes\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.191106 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190756 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d056ae52-f669-4b21-abb9-1223de0b748e-ovn-node-metrics-cert\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.191106 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190779 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r67q\" (UniqueName: \"kubernetes.io/projected/8e775399-2b2b-45c1-823c-dc848145fd90-kube-api-access-2r67q\") pod \"node-resolver-5mnxb\" (UID: \"8e775399-2b2b-45c1-823c-dc848145fd90\") " pod="openshift-dns/node-resolver-5mnxb" Jun 10 20:41:55.191106 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190800 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f817cd6-446c-4995-b2d5-ebf8f614d598-cnibin\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.191106 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190837 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f817cd6-446c-4995-b2d5-ebf8f614d598-cni-binary-copy\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.191106 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.190869 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-slash\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.191106 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.191092 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vrjv\" (UniqueName: \"kubernetes.io/projected/d056ae52-f669-4b21-abb9-1223de0b748e-kube-api-access-2vrjv\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.191904 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.191130 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f817cd6-446c-4995-b2d5-ebf8f614d598-system-cni-dir\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.191904 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.191164 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be8a6911-3511-4477-8ad3-bede37c12310-iptables-alerter-script\") pod \"iptables-alerter-qrx7z\" (UID: \"be8a6911-3511-4477-8ad3-bede37c12310\") " pod="openshift-network-operator/iptables-alerter-qrx7z" Jun 10 20:41:55.191904 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.191205 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-etc-openvswitch\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.191904 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.191233 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-node-log\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.191904 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.191267 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f817cd6-446c-4995-b2d5-ebf8f614d598-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.191904 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.191324 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 20:41:55.191904 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.191865 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.192585 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.192548 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 20:41:55.192663 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.192607 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 20:41:55.192791 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.192775 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4svjs\"" Jun 10 20:41:55.193100 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.193084 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 20:41:55.195616 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.195599 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 20:41:55.195710 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.195628 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 20:41:55.195777 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.195752 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 20:41:55.195873 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.195856 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t5h7z\"" Jun 10 20:41:55.207316 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.207286 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qrx7l" Jun 10 20:41:55.213121 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.213102 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qrx7l" Jun 10 20:41:55.266685 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.266649 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:41:55.279101 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.279049 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 20:41:55.291900 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.291860 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-run-netns\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.292112 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.291912 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a48d3544-c7a8-49d0-b6f0-720732a6f056-kubelet-config\") pod \"global-pull-secret-syncer-888f4\" (UID: \"a48d3544-c7a8-49d0-b6f0-720732a6f056\") " pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:41:55.292112 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.291937 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f817cd6-446c-4995-b2d5-ebf8f614d598-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.292112 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.291948 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-run-netns\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.292112 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.291966 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce79514f-80c6-42db-b060-1823e18a9bca-agent-certs\") pod \"konnectivity-agent-mc66f\" (UID: \"ce79514f-80c6-42db-b060-1823e18a9bca\") " pod="kube-system/konnectivity-agent-mc66f" Jun 10 20:41:55.292112 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.291989 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-multus-socket-dir-parent\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.292112 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.292027 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-var-lib-cni-bin\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.292112 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.292041 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a48d3544-c7a8-49d0-b6f0-720732a6f056-kubelet-config\") pod \"global-pull-secret-syncer-888f4\" (UID: \"a48d3544-c7a8-49d0-b6f0-720732a6f056\") " pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:41:55.292112 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.292050 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-sysconfig\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.292112 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.292073 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6mmv\" (UniqueName: \"kubernetes.io/projected/dfb762df-1072-4f6d-af60-da1fe0c98b0d-kube-api-access-x6mmv\") pod \"node-ca-zfl89\" (UID: \"dfb762df-1072-4f6d-af60-da1fe0c98b0d\") " pod="openshift-image-registry/node-ca-zfl89" Jun 10 20:41:55.292112 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.292097 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-run-openvswitch\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.292905 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.292881 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-run-openvswitch\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.292985 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.292953 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-cnibin\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.293155 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293031 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-cni-binary-copy\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.293155 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293074 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-sysctl-d\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.293155 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293102 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-registration-dir\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.293155 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293132 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-slash\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.293363 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293156 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vrjv\" (UniqueName: \"kubernetes.io/projected/d056ae52-f669-4b21-abb9-1223de0b748e-kube-api-access-2vrjv\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.293363 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293175 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce79514f-80c6-42db-b060-1823e18a9bca-konnectivity-ca\") pod \"konnectivity-agent-mc66f\" (UID: \"ce79514f-80c6-42db-b060-1823e18a9bca\") " pod="kube-system/konnectivity-agent-mc66f" Jun 10 20:41:55.293363 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293192 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-var-lib-cni-multus\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.293363 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293212 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-slash\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.293363 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293229 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.293363 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293253 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-etc-openvswitch\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.293363 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293275 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-tuned\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.293363 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293291 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-device-dir\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.293363 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293307 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f817cd6-446c-4995-b2d5-ebf8f614d598-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.293363 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293310 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgnsn\" (UniqueName: \"kubernetes.io/projected/0b16548a-48d2-4a83-9bc6-ca8103fb630a-kube-api-access-tgnsn\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.293834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293372 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-etc-openvswitch\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.293834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293387 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-run-ovn\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.293834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293414 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e775399-2b2b-45c1-823c-dc848145fd90-hosts-file\") pod \"node-resolver-5mnxb\" (UID: \"8e775399-2b2b-45c1-823c-dc848145fd90\") " pod="openshift-dns/node-resolver-5mnxb" Jun 10 20:41:55.293834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293444 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-run-ovn\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.293834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293440 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ea4153e-5118-4192-be41-025c35f7c9f2-tmp\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.293834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293482 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-sys-fs\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.293834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293514 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e775399-2b2b-45c1-823c-dc848145fd90-hosts-file\") pod \"node-resolver-5mnxb\" (UID: \"8e775399-2b2b-45c1-823c-dc848145fd90\") " pod="openshift-dns/node-resolver-5mnxb" Jun 10 20:41:55.293834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293530 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw77j\" (UniqueName: \"kubernetes.io/projected/be8a6911-3511-4477-8ad3-bede37c12310-kube-api-access-zw77j\") pod \"iptables-alerter-qrx7z\" (UID: \"be8a6911-3511-4477-8ad3-bede37c12310\") " pod="openshift-network-operator/iptables-alerter-qrx7z" Jun 10 20:41:55.293834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293616 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e775399-2b2b-45c1-823c-dc848145fd90-tmp-dir\") pod \"node-resolver-5mnxb\" (UID: \"8e775399-2b2b-45c1-823c-dc848145fd90\") " pod="openshift-dns/node-resolver-5mnxb" Jun 10 20:41:55.293834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293685 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f817cd6-446c-4995-b2d5-ebf8f614d598-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.293834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293716 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwn2z\" (UniqueName: \"kubernetes.io/projected/2f817cd6-446c-4995-b2d5-ebf8f614d598-kube-api-access-hwn2z\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.293834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293742 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-run-k8s-cni-cncf-io\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.293834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293771 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgjp6\" (UniqueName: \"kubernetes.io/projected/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-kube-api-access-xgjp6\") pod \"network-metrics-daemon-5wvlk\" (UID: \"7e9deb0d-98eb-49cf-8fe2-e863232c7d47\") " pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:41:55.293834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293795 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be8a6911-3511-4477-8ad3-bede37c12310-host-slash\") pod \"iptables-alerter-qrx7z\" (UID: \"be8a6911-3511-4477-8ad3-bede37c12310\") " pod="openshift-network-operator/iptables-alerter-qrx7z" Jun 10 20:41:55.293834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293817 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-cni-netd\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.293834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293842 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d056ae52-f669-4b21-abb9-1223de0b748e-ovnkube-config\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.294439 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293857 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f817cd6-446c-4995-b2d5-ebf8f614d598-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.294439 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293867 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a48d3544-c7a8-49d0-b6f0-720732a6f056-dbus\") pod \"global-pull-secret-syncer-888f4\" (UID: \"a48d3544-c7a8-49d0-b6f0-720732a6f056\") " pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:41:55.294439 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293894 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e775399-2b2b-45c1-823c-dc848145fd90-tmp-dir\") pod \"node-resolver-5mnxb\" (UID: \"8e775399-2b2b-45c1-823c-dc848145fd90\") " pod="openshift-dns/node-resolver-5mnxb" Jun 10 20:41:55.294439 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293893 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-etc-kubernetes\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.294439 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293940 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be8a6911-3511-4477-8ad3-bede37c12310-host-slash\") pod \"iptables-alerter-qrx7z\" (UID: \"be8a6911-3511-4477-8ad3-bede37c12310\") " pod="openshift-network-operator/iptables-alerter-qrx7z" Jun 10 20:41:55.294439 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293953 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jssdj\" (UniqueName: \"kubernetes.io/projected/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-kube-api-access-jssdj\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.294439 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293978 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs\") pod \"network-metrics-daemon-5wvlk\" (UID: \"7e9deb0d-98eb-49cf-8fe2-e863232c7d47\") " pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:41:55.294439 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.293986 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-cni-netd\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.294439 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294030 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dfb762df-1072-4f6d-af60-da1fe0c98b0d-serviceca\") pod \"node-ca-zfl89\" (UID: \"dfb762df-1072-4f6d-af60-da1fe0c98b0d\") " pod="openshift-image-registry/node-ca-zfl89" Jun 10 20:41:55.294439 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294172 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d056ae52-f669-4b21-abb9-1223de0b748e-ovnkube-script-lib\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.294439 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294180 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a48d3544-c7a8-49d0-b6f0-720732a6f056-dbus\") pod \"global-pull-secret-syncer-888f4\" (UID: \"a48d3544-c7a8-49d0-b6f0-720732a6f056\") " pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:41:55.294439 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:55.294400 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:41:55.294996 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:55.294520 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret podName:a48d3544-c7a8-49d0-b6f0-720732a6f056 nodeName:}" failed. No retries permitted until 2026-06-10 20:41:55.794475293 +0000 UTC m=+2.962514005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret") pod "global-pull-secret-syncer-888f4" (UID: "a48d3544-c7a8-49d0-b6f0-720732a6f056") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:41:55.294996 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294532 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d056ae52-f669-4b21-abb9-1223de0b748e-ovnkube-config\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.294996 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294647 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret\") pod \"global-pull-secret-syncer-888f4\" (UID: \"a48d3544-c7a8-49d0-b6f0-720732a6f056\") " pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:41:55.294996 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294682 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f817cd6-446c-4995-b2d5-ebf8f614d598-os-release\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.294996 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294654 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d056ae52-f669-4b21-abb9-1223de0b748e-ovnkube-script-lib\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.294996 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294707 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-multus-cni-dir\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.294996 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294730 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-kubernetes\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.294996 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294753 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-host\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.294996 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294775 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-os-release\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.294996 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294775 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f817cd6-446c-4995-b2d5-ebf8f614d598-os-release\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.294996 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294834 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-lib-modules\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.294996 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294875 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-systemd-units\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.294996 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294910 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-var-lib-openvswitch\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.294996 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294913 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-systemd-units\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.294996 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294943 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-run-ovn-kubernetes\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.294996 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294950 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-var-lib-openvswitch\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.295698 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294959 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d056ae52-f669-4b21-abb9-1223de0b748e-ovn-node-metrics-cert\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.295698 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294974 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r67q\" (UniqueName: \"kubernetes.io/projected/8e775399-2b2b-45c1-823c-dc848145fd90-kube-api-access-2r67q\") pod \"node-resolver-5mnxb\" (UID: \"8e775399-2b2b-45c1-823c-dc848145fd90\") " pod="openshift-dns/node-resolver-5mnxb" Jun 10 20:41:55.295698 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294995 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f817cd6-446c-4995-b2d5-ebf8f614d598-cnibin\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.295698 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.294992 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-run-ovn-kubernetes\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.295698 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295034 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f817cd6-446c-4995-b2d5-ebf8f614d598-cni-binary-copy\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.295698 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295061 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-multus-daemon-config\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.295698 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295086 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f817cd6-446c-4995-b2d5-ebf8f614d598-system-cni-dir\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.295698 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295091 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f817cd6-446c-4995-b2d5-ebf8f614d598-cnibin\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.295698 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295109 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-run-multus-certs\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.295698 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295131 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-sys\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.295698 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295150 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dfb762df-1072-4f6d-af60-da1fe0c98b0d-host\") pod \"node-ca-zfl89\" (UID: \"dfb762df-1072-4f6d-af60-da1fe0c98b0d\") " pod="openshift-image-registry/node-ca-zfl89" Jun 10 20:41:55.295698 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295173 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.295698 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295199 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be8a6911-3511-4477-8ad3-bede37c12310-iptables-alerter-script\") pod \"iptables-alerter-qrx7z\" (UID: \"be8a6911-3511-4477-8ad3-bede37c12310\") " pod="openshift-network-operator/iptables-alerter-qrx7z" Jun 10 20:41:55.295698 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295234 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-node-log\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.295698 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295263 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f817cd6-446c-4995-b2d5-ebf8f614d598-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.295698 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295272 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f817cd6-446c-4995-b2d5-ebf8f614d598-system-cni-dir\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.295698 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295296 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-var-lib-kubelet\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.296481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295324 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 20:41:55.296481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295380 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-node-log\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.296481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295538 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f817cd6-446c-4995-b2d5-ebf8f614d598-cni-binary-copy\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.296481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295598 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-sysctl-conf\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.296481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295634 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-run-systemd\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.296481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295660 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-cni-bin\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.296481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295688 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm8fj\" (UniqueName: \"kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj\") pod \"network-check-target-frh2j\" (UID: \"f6f0966a-134e-47fd-b989-63a633ca073e\") " pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:41:55.296481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295705 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-run-systemd\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.296481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295721 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-socket-dir\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.296481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295747 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-log-socket\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.296481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295779 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.296481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295796 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-log-socket\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.296481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295805 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-kubelet\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.296481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295830 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-run-netns\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.296481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295844 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.296481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295753 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-cni-bin\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.296481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295858 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-hostroot\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.297257 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295865 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be8a6911-3511-4477-8ad3-bede37c12310-iptables-alerter-script\") pod \"iptables-alerter-qrx7z\" (UID: \"be8a6911-3511-4477-8ad3-bede37c12310\") " pod="openshift-network-operator/iptables-alerter-qrx7z" Jun 10 20:41:55.297257 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295872 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f817cd6-446c-4995-b2d5-ebf8f614d598-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.297257 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295895 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d056ae52-f669-4b21-abb9-1223de0b748e-host-kubelet\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.297257 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295923 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-modprobe-d\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.297257 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295947 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-run\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.297257 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295974 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d056ae52-f669-4b21-abb9-1223de0b748e-env-overrides\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.297257 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.295997 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-system-cni-dir\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.297257 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.296109 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-multus-conf-dir\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.297257 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.296141 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-systemd\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.297257 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.296167 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-var-lib-kubelet\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.297257 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.296192 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn8hb\" (UniqueName: \"kubernetes.io/projected/2ea4153e-5118-4192-be41-025c35f7c9f2-kube-api-access-zn8hb\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.297257 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.296388 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d056ae52-f669-4b21-abb9-1223de0b748e-env-overrides\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.298880 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.298856 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d056ae52-f669-4b21-abb9-1223de0b748e-ovn-node-metrics-cert\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.309617 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.309538 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw77j\" (UniqueName: \"kubernetes.io/projected/be8a6911-3511-4477-8ad3-bede37c12310-kube-api-access-zw77j\") pod \"iptables-alerter-qrx7z\" (UID: \"be8a6911-3511-4477-8ad3-bede37c12310\") " pod="openshift-network-operator/iptables-alerter-qrx7z" Jun 10 20:41:55.309768 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.309668 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r67q\" (UniqueName: \"kubernetes.io/projected/8e775399-2b2b-45c1-823c-dc848145fd90-kube-api-access-2r67q\") pod \"node-resolver-5mnxb\" (UID: \"8e775399-2b2b-45c1-823c-dc848145fd90\") " pod="openshift-dns/node-resolver-5mnxb" Jun 10 20:41:55.310408 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.310381 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwn2z\" (UniqueName: \"kubernetes.io/projected/2f817cd6-446c-4995-b2d5-ebf8f614d598-kube-api-access-hwn2z\") pod \"multus-additional-cni-plugins-wkzj6\" (UID: \"2f817cd6-446c-4995-b2d5-ebf8f614d598\") " pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.311252 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.311199 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vrjv\" (UniqueName: \"kubernetes.io/projected/d056ae52-f669-4b21-abb9-1223de0b748e-kube-api-access-2vrjv\") pod \"ovnkube-node-j5dd9\" (UID: \"d056ae52-f669-4b21-abb9-1223de0b748e\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.397248 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.396989 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-os-release\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.397431 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397266 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-lib-modules\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.397431 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397290 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-multus-daemon-config\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.397431 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397100 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-os-release\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.397431 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397315 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-run-multus-certs\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.397431 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397428 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-sys\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.397681 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397448 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dfb762df-1072-4f6d-af60-da1fe0c98b0d-host\") pod \"node-ca-zfl89\" (UID: \"dfb762df-1072-4f6d-af60-da1fe0c98b0d\") " pod="openshift-image-registry/node-ca-zfl89" Jun 10 20:41:55.397681 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397465 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.397681 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397474 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-run-multus-certs\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.397681 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397492 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-var-lib-kubelet\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.397681 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397440 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-lib-modules\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.397681 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397516 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dfb762df-1072-4f6d-af60-da1fe0c98b0d-host\") pod \"node-ca-zfl89\" (UID: \"dfb762df-1072-4f6d-af60-da1fe0c98b0d\") " pod="openshift-image-registry/node-ca-zfl89" Jun 10 20:41:55.397681 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397516 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-sysctl-conf\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.397681 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397532 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-sys\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.397681 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397550 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-var-lib-kubelet\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.397681 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397554 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm8fj\" (UniqueName: \"kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj\") pod \"network-check-target-frh2j\" (UID: \"f6f0966a-134e-47fd-b989-63a633ca073e\") " pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:41:55.397681 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397568 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.397681 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397583 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-socket-dir\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.397681 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397624 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-run-netns\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.397681 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397649 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-hostroot\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.397681 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397654 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-sysctl-conf\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397692 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-hostroot\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397698 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-run-netns\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397719 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-modprobe-d\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397742 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-run\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397764 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-system-cni-dir\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397784 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-multus-conf-dir\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397801 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-socket-dir\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397820 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-modprobe-d\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397805 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-systemd\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397845 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-run\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397852 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-systemd\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397860 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-var-lib-kubelet\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397886 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn8hb\" (UniqueName: \"kubernetes.io/projected/2ea4153e-5118-4192-be41-025c35f7c9f2-kube-api-access-zn8hb\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397894 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-system-cni-dir\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397911 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce79514f-80c6-42db-b060-1823e18a9bca-agent-certs\") pod \"konnectivity-agent-mc66f\" (UID: \"ce79514f-80c6-42db-b060-1823e18a9bca\") " pod="kube-system/konnectivity-agent-mc66f" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397912 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-multus-conf-dir\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397935 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-multus-socket-dir-parent\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.398384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397936 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-var-lib-kubelet\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397910 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-multus-daemon-config\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397974 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-var-lib-cni-bin\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.397977 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-multus-socket-dir-parent\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398049 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-var-lib-cni-bin\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398052 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-sysconfig\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398087 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6mmv\" (UniqueName: \"kubernetes.io/projected/dfb762df-1072-4f6d-af60-da1fe0c98b0d-kube-api-access-x6mmv\") pod \"node-ca-zfl89\" (UID: \"dfb762df-1072-4f6d-af60-da1fe0c98b0d\") " pod="openshift-image-registry/node-ca-zfl89" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398103 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-sysconfig\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398139 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-cnibin\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398206 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-cnibin\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398232 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-cni-binary-copy\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398257 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-sysctl-d\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398282 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-registration-dir\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398322 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce79514f-80c6-42db-b060-1823e18a9bca-konnectivity-ca\") pod \"konnectivity-agent-mc66f\" (UID: \"ce79514f-80c6-42db-b060-1823e18a9bca\") " pod="kube-system/konnectivity-agent-mc66f" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398352 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-var-lib-cni-multus\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398378 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398395 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-registration-dir\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398402 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-tuned\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.399234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398436 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-device-dir\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398462 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgnsn\" (UniqueName: \"kubernetes.io/projected/0b16548a-48d2-4a83-9bc6-ca8103fb630a-kube-api-access-tgnsn\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398471 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-sysctl-d\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398490 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ea4153e-5118-4192-be41-025c35f7c9f2-tmp\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398514 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-sys-fs\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398519 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-var-lib-cni-multus\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398543 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-run-k8s-cni-cncf-io\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgjp6\" (UniqueName: \"kubernetes.io/projected/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-kube-api-access-xgjp6\") pod \"network-metrics-daemon-5wvlk\" (UID: \"7e9deb0d-98eb-49cf-8fe2-e863232c7d47\") " pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398596 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-etc-kubernetes\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398621 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jssdj\" (UniqueName: \"kubernetes.io/projected/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-kube-api-access-jssdj\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398643 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs\") pod \"network-metrics-daemon-5wvlk\" (UID: \"7e9deb0d-98eb-49cf-8fe2-e863232c7d47\") " pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398667 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dfb762df-1072-4f6d-af60-da1fe0c98b0d-serviceca\") pod \"node-ca-zfl89\" (UID: \"dfb762df-1072-4f6d-af60-da1fe0c98b0d\") " pod="openshift-image-registry/node-ca-zfl89" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398705 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-multus-cni-dir\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398724 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-cni-binary-copy\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398777 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-device-dir\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398782 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-kubernetes\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398730 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-kubernetes\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398823 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-host\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.400089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.398895 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ea4153e-5118-4192-be41-025c35f7c9f2-host\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.400919 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.399073 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce79514f-80c6-42db-b060-1823e18a9bca-konnectivity-ca\") pod \"konnectivity-agent-mc66f\" (UID: \"ce79514f-80c6-42db-b060-1823e18a9bca\") " pod="kube-system/konnectivity-agent-mc66f" Jun 10 20:41:55.400919 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.399328 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.400919 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.399374 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-etc-kubernetes\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.400919 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.399420 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b16548a-48d2-4a83-9bc6-ca8103fb630a-sys-fs\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.400919 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.399484 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-host-run-k8s-cni-cncf-io\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.400919 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:55.399504 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:41:55.400919 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:55.399568 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs podName:7e9deb0d-98eb-49cf-8fe2-e863232c7d47 nodeName:}" failed. No retries permitted until 2026-06-10 20:41:55.899548586 +0000 UTC m=+3.067587305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs") pod "network-metrics-daemon-5wvlk" (UID: "7e9deb0d-98eb-49cf-8fe2-e863232c7d47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:41:55.400919 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.399656 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-multus-cni-dir\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.400919 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.399889 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dfb762df-1072-4f6d-af60-da1fe0c98b0d-serviceca\") pod \"node-ca-zfl89\" (UID: \"dfb762df-1072-4f6d-af60-da1fe0c98b0d\") " pod="openshift-image-registry/node-ca-zfl89" Jun 10 20:41:55.401992 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.401970 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ea4153e-5118-4192-be41-025c35f7c9f2-tmp\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.402675 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.402649 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce79514f-80c6-42db-b060-1823e18a9bca-agent-certs\") pod \"konnectivity-agent-mc66f\" (UID: \"ce79514f-80c6-42db-b060-1823e18a9bca\") " pod="kube-system/konnectivity-agent-mc66f" Jun 10 20:41:55.402824 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.402804 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2ea4153e-5118-4192-be41-025c35f7c9f2-etc-tuned\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.404625 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:55.404604 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:41:55.404723 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:55.404633 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:41:55.404723 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:55.404648 2554 projected.go:196] Error preparing data for projected volume kube-api-access-tm8fj for pod openshift-network-diagnostics/network-check-target-frh2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:41:55.404723 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:55.404713 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj podName:f6f0966a-134e-47fd-b989-63a633ca073e nodeName:}" failed. No retries permitted until 2026-06-10 20:41:55.904700834 +0000 UTC m=+3.072739540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tm8fj" (UniqueName: "kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj") pod "network-check-target-frh2j" (UID: "f6f0966a-134e-47fd-b989-63a633ca073e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:41:55.411245 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.411147 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6mmv\" (UniqueName: \"kubernetes.io/projected/dfb762df-1072-4f6d-af60-da1fe0c98b0d-kube-api-access-x6mmv\") pod \"node-ca-zfl89\" (UID: \"dfb762df-1072-4f6d-af60-da1fe0c98b0d\") " pod="openshift-image-registry/node-ca-zfl89" Jun 10 20:41:55.411245 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.411216 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgnsn\" (UniqueName: \"kubernetes.io/projected/0b16548a-48d2-4a83-9bc6-ca8103fb630a-kube-api-access-tgnsn\") pod \"aws-ebs-csi-driver-node-9nslp\" (UID: \"0b16548a-48d2-4a83-9bc6-ca8103fb630a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.411397 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.411325 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn8hb\" (UniqueName: \"kubernetes.io/projected/2ea4153e-5118-4192-be41-025c35f7c9f2-kube-api-access-zn8hb\") pod \"tuned-bzhjf\" (UID: \"2ea4153e-5118-4192-be41-025c35f7c9f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.412829 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.412803 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jssdj\" (UniqueName: \"kubernetes.io/projected/ce4e2367-1145-42ee-be5f-2c17bd0d13ff-kube-api-access-jssdj\") pod \"multus-kgsz7\" (UID: \"ce4e2367-1145-42ee-be5f-2c17bd0d13ff\") " pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.413305 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.413281 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgjp6\" (UniqueName: \"kubernetes.io/projected/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-kube-api-access-xgjp6\") pod \"network-metrics-daemon-5wvlk\" (UID: \"7e9deb0d-98eb-49cf-8fe2-e863232c7d47\") " pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:41:55.489623 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.489589 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5mnxb" Jun 10 20:41:55.498460 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.498432 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wkzj6" Jun 10 20:41:55.508173 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.508140 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qrx7z" Jun 10 20:41:55.515045 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.515004 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:41:55.523920 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.523887 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mc66f" Jun 10 20:41:55.530861 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.530830 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" Jun 10 20:41:55.536848 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.536817 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kgsz7" Jun 10 20:41:55.544715 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.544687 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zfl89" Jun 10 20:41:55.549612 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.549592 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" Jun 10 20:41:55.801320 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.801285 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret\") pod \"global-pull-secret-syncer-888f4\" (UID: \"a48d3544-c7a8-49d0-b6f0-720732a6f056\") " pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:41:55.801526 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:55.801460 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:41:55.801587 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:55.801540 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret podName:a48d3544-c7a8-49d0-b6f0-720732a6f056 nodeName:}" failed. No retries permitted until 2026-06-10 20:41:56.801519408 +0000 UTC m=+3.969558125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret") pod "global-pull-secret-syncer-888f4" (UID: "a48d3544-c7a8-49d0-b6f0-720732a6f056") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:41:55.902704 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:55.902660 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs\") pod \"network-metrics-daemon-5wvlk\" (UID: \"7e9deb0d-98eb-49cf-8fe2-e863232c7d47\") " pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:41:55.902890 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:55.902831 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:41:55.902952 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:55.902908 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs podName:7e9deb0d-98eb-49cf-8fe2-e863232c7d47 nodeName:}" failed. No retries permitted until 2026-06-10 20:41:56.902889242 +0000 UTC m=+4.070927960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs") pod "network-metrics-daemon-5wvlk" (UID: "7e9deb0d-98eb-49cf-8fe2-e863232c7d47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:41:56.004045 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.003945 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm8fj\" (UniqueName: \"kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj\") pod \"network-check-target-frh2j\" (UID: \"f6f0966a-134e-47fd-b989-63a633ca073e\") " pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:41:56.004190 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:56.004103 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:41:56.004190 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:56.004119 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:41:56.004190 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:56.004127 2554 projected.go:196] Error preparing data for projected volume kube-api-access-tm8fj for pod openshift-network-diagnostics/network-check-target-frh2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:41:56.004190 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:56.004189 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj podName:f6f0966a-134e-47fd-b989-63a633ca073e nodeName:}" failed. No retries permitted until 2026-06-10 20:41:57.004176569 +0000 UTC m=+4.172215277 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tm8fj" (UniqueName: "kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj") pod "network-check-target-frh2j" (UID: "f6f0966a-134e-47fd-b989-63a633ca073e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:41:56.157136 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:56.157105 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f817cd6_446c_4995_b2d5_ebf8f614d598.slice/crio-2cee4f855a5b337a24e42ba4982dbab31bf3e6e9611dcf27e04eb6c4dd1ba3e7 WatchSource:0}: Error finding container 2cee4f855a5b337a24e42ba4982dbab31bf3e6e9611dcf27e04eb6c4dd1ba3e7: Status 404 returned error can't find the container with id 2cee4f855a5b337a24e42ba4982dbab31bf3e6e9611dcf27e04eb6c4dd1ba3e7 Jun 10 20:41:56.158453 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:56.158430 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd056ae52_f669_4b21_abb9_1223de0b748e.slice/crio-f4b92aef071dc5b4a021e9882d479deeb1fea86dc30c411147ca943b312da39b WatchSource:0}: Error finding container f4b92aef071dc5b4a021e9882d479deeb1fea86dc30c411147ca943b312da39b: Status 404 returned error can't find the container with id f4b92aef071dc5b4a021e9882d479deeb1fea86dc30c411147ca943b312da39b Jun 10 20:41:56.159295 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:56.159272 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce4e2367_1145_42ee_be5f_2c17bd0d13ff.slice/crio-877474af55bdc4cc72b63ed3ebef361370f9d16ef7eba09aff40d954370ea413 WatchSource:0}: Error finding container 877474af55bdc4cc72b63ed3ebef361370f9d16ef7eba09aff40d954370ea413: Status 404 returned error can't find the container with id 877474af55bdc4cc72b63ed3ebef361370f9d16ef7eba09aff40d954370ea413 Jun 10 20:41:56.161704 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:56.161669 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ea4153e_5118_4192_be41_025c35f7c9f2.slice/crio-77f332f26d1ad7b96d63732bdceb710e95714bad68bf400f8eaaf35ca3b6a382 WatchSource:0}: Error finding container 77f332f26d1ad7b96d63732bdceb710e95714bad68bf400f8eaaf35ca3b6a382: Status 404 returned error can't find the container with id 77f332f26d1ad7b96d63732bdceb710e95714bad68bf400f8eaaf35ca3b6a382 Jun 10 20:41:56.163505 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:56.163461 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b16548a_48d2_4a83_9bc6_ca8103fb630a.slice/crio-a6e3e0c303937ed3b38b304e90f51bcec155f8e550bd94a866bdae3aadd1175c WatchSource:0}: Error finding container a6e3e0c303937ed3b38b304e90f51bcec155f8e550bd94a866bdae3aadd1175c: Status 404 returned error can't find the container with id a6e3e0c303937ed3b38b304e90f51bcec155f8e550bd94a866bdae3aadd1175c Jun 10 20:41:56.164711 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:56.164688 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e775399_2b2b_45c1_823c_dc848145fd90.slice/crio-176daaf6993a76c2d77889b05e6451e413ccb7258a13e50aff4f33a6022b1f2e WatchSource:0}: Error finding container 176daaf6993a76c2d77889b05e6451e413ccb7258a13e50aff4f33a6022b1f2e: Status 404 returned error can't find the container with id 176daaf6993a76c2d77889b05e6451e413ccb7258a13e50aff4f33a6022b1f2e Jun 10 20:41:56.166554 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:56.166071 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe8a6911_3511_4477_8ad3_bede37c12310.slice/crio-496f99a669ef85bfb05d609d8e97d3b3084540ea1364979255195dbe2d32ab60 WatchSource:0}: Error finding container 496f99a669ef85bfb05d609d8e97d3b3084540ea1364979255195dbe2d32ab60: Status 404 returned error can't find the container with id 496f99a669ef85bfb05d609d8e97d3b3084540ea1364979255195dbe2d32ab60 Jun 10 20:41:56.167384 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:56.167258 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfb762df_1072_4f6d_af60_da1fe0c98b0d.slice/crio-1570e45e3c247ebfb3c46634d120ef91e45617070469750f50ecc375ce901d0a WatchSource:0}: Error finding container 1570e45e3c247ebfb3c46634d120ef91e45617070469750f50ecc375ce901d0a: Status 404 returned error can't find the container with id 1570e45e3c247ebfb3c46634d120ef91e45617070469750f50ecc375ce901d0a Jun 10 20:41:56.168500 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:41:56.168395 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce79514f_80c6_42db_b060_1823e18a9bca.slice/crio-9a63ddeaa23213567dde8df4c62267e7a1a9bd3e3867c865a97ff96efb88d34d WatchSource:0}: Error finding container 9a63ddeaa23213567dde8df4c62267e7a1a9bd3e3867c865a97ff96efb88d34d: Status 404 returned error can't find the container with id 9a63ddeaa23213567dde8df4c62267e7a1a9bd3e3867c865a97ff96efb88d34d Jun 10 20:41:56.216023 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.215961 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 20:36:55 +0000 UTC" deadline="2028-02-20 20:13:00.474416834 +0000 UTC" Jun 10 20:41:56.216023 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.216002 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14879h31m4.258416925s" Jun 10 20:41:56.254663 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.254569 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wkzj6" event={"ID":"2f817cd6-446c-4995-b2d5-ebf8f614d598","Type":"ContainerStarted","Data":"2cee4f855a5b337a24e42ba4982dbab31bf3e6e9611dcf27e04eb6c4dd1ba3e7"} Jun 10 20:41:56.256340 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.256316 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-84.ec2.internal" event={"ID":"eb606e6e49ab7c92af3bf94d0bc58e30","Type":"ContainerStarted","Data":"2b234baac6e307db918af2bd535834fee6799b176b6c109202c8caa1e25681d6"} Jun 10 20:41:56.257833 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.257809 2554 generic.go:356] "Generic (PLEG): container finished" podID="681550990802757c8d9284c7e126bbe0" containerID="24426f23ff14d0111adebd6ca0caa2e9529200f999de28e10e688de1b2ca5aa3" exitCode=0 Jun 10 20:41:56.257924 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.257874 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal" event={"ID":"681550990802757c8d9284c7e126bbe0","Type":"ContainerDied","Data":"24426f23ff14d0111adebd6ca0caa2e9529200f999de28e10e688de1b2ca5aa3"} Jun 10 20:41:56.259022 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.258985 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zfl89" event={"ID":"dfb762df-1072-4f6d-af60-da1fe0c98b0d","Type":"ContainerStarted","Data":"1570e45e3c247ebfb3c46634d120ef91e45617070469750f50ecc375ce901d0a"} Jun 10 20:41:56.260094 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.260060 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mc66f" event={"ID":"ce79514f-80c6-42db-b060-1823e18a9bca","Type":"ContainerStarted","Data":"9a63ddeaa23213567dde8df4c62267e7a1a9bd3e3867c865a97ff96efb88d34d"} Jun 10 20:41:56.263046 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.263021 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qrx7z" event={"ID":"be8a6911-3511-4477-8ad3-bede37c12310","Type":"ContainerStarted","Data":"496f99a669ef85bfb05d609d8e97d3b3084540ea1364979255195dbe2d32ab60"} Jun 10 20:41:56.264122 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.264103 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5mnxb" event={"ID":"8e775399-2b2b-45c1-823c-dc848145fd90","Type":"ContainerStarted","Data":"176daaf6993a76c2d77889b05e6451e413ccb7258a13e50aff4f33a6022b1f2e"} Jun 10 20:41:56.265128 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.265105 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" event={"ID":"0b16548a-48d2-4a83-9bc6-ca8103fb630a","Type":"ContainerStarted","Data":"a6e3e0c303937ed3b38b304e90f51bcec155f8e550bd94a866bdae3aadd1175c"} Jun 10 20:41:56.266118 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.266098 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" event={"ID":"2ea4153e-5118-4192-be41-025c35f7c9f2","Type":"ContainerStarted","Data":"77f332f26d1ad7b96d63732bdceb710e95714bad68bf400f8eaaf35ca3b6a382"} Jun 10 20:41:56.267188 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.267168 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" event={"ID":"d056ae52-f669-4b21-abb9-1223de0b748e","Type":"ContainerStarted","Data":"f4b92aef071dc5b4a021e9882d479deeb1fea86dc30c411147ca943b312da39b"} Jun 10 20:41:56.268140 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.268124 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kgsz7" event={"ID":"ce4e2367-1145-42ee-be5f-2c17bd0d13ff","Type":"ContainerStarted","Data":"877474af55bdc4cc72b63ed3ebef361370f9d16ef7eba09aff40d954370ea413"} Jun 10 20:41:56.277231 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.276853 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-84.ec2.internal" podStartSLOduration=2.276838765 podStartE2EDuration="2.276838765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:41:56.276601629 +0000 UTC m=+3.444640372" watchObservedRunningTime="2026-06-10 20:41:56.276838765 +0000 UTC m=+3.444877494" Jun 10 20:41:56.811280 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.811237 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret\") pod \"global-pull-secret-syncer-888f4\" (UID: \"a48d3544-c7a8-49d0-b6f0-720732a6f056\") " pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:41:56.811464 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:56.811440 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:41:56.811545 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:56.811505 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret podName:a48d3544-c7a8-49d0-b6f0-720732a6f056 nodeName:}" failed. No retries permitted until 2026-06-10 20:41:58.811488107 +0000 UTC m=+5.979526816 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret") pod "global-pull-secret-syncer-888f4" (UID: "a48d3544-c7a8-49d0-b6f0-720732a6f056") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:41:56.912426 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:56.912381 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs\") pod \"network-metrics-daemon-5wvlk\" (UID: \"7e9deb0d-98eb-49cf-8fe2-e863232c7d47\") " pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:41:56.912594 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:56.912583 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:41:56.912664 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:56.912652 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs podName:7e9deb0d-98eb-49cf-8fe2-e863232c7d47 nodeName:}" failed. No retries permitted until 2026-06-10 20:41:58.912632122 +0000 UTC m=+6.080670835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs") pod "network-metrics-daemon-5wvlk" (UID: "7e9deb0d-98eb-49cf-8fe2-e863232c7d47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:41:57.013754 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:57.013708 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm8fj\" (UniqueName: \"kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj\") pod \"network-check-target-frh2j\" (UID: \"f6f0966a-134e-47fd-b989-63a633ca073e\") " pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:41:57.013949 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:57.013889 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:41:57.013949 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:57.013912 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:41:57.013949 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:57.013924 2554 projected.go:196] Error preparing data for projected volume kube-api-access-tm8fj for pod openshift-network-diagnostics/network-check-target-frh2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:41:57.014175 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:57.013982 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj podName:f6f0966a-134e-47fd-b989-63a633ca073e nodeName:}" failed. No retries permitted until 2026-06-10 20:41:59.013965084 +0000 UTC m=+6.182003791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tm8fj" (UniqueName: "kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj") pod "network-check-target-frh2j" (UID: "f6f0966a-134e-47fd-b989-63a633ca073e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:41:57.217937 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:57.217867 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 20:36:55 +0000 UTC" deadline="2028-01-03 18:55:45.392208934 +0000 UTC" Jun 10 20:41:57.217937 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:57.217908 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13726h13m48.174305312s" Jun 10 20:41:57.250751 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:57.249919 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:41:57.250751 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:57.250098 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:41:57.250751 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:57.250498 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:41:57.250751 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:57.250591 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-888f4" podUID="a48d3544-c7a8-49d0-b6f0-720732a6f056" Jun 10 20:41:57.250751 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:57.250651 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:41:57.250751 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:57.250718 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frh2j" podUID="f6f0966a-134e-47fd-b989-63a633ca073e" Jun 10 20:41:57.286753 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:57.286678 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal" event={"ID":"681550990802757c8d9284c7e126bbe0","Type":"ContainerStarted","Data":"d2348d622450e4d9ce43cbc46b2f6bee9ca6ad73db0bc2d61d3a53710d3eaf38"} Jun 10 20:41:58.831817 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:58.831767 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret\") pod \"global-pull-secret-syncer-888f4\" (UID: \"a48d3544-c7a8-49d0-b6f0-720732a6f056\") " pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:41:58.832294 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:58.831952 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:41:58.832294 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:58.832089 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret podName:a48d3544-c7a8-49d0-b6f0-720732a6f056 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:02.832064904 +0000 UTC m=+10.000103614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret") pod "global-pull-secret-syncer-888f4" (UID: "a48d3544-c7a8-49d0-b6f0-720732a6f056") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:41:58.933354 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:58.932646 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs\") pod \"network-metrics-daemon-5wvlk\" (UID: \"7e9deb0d-98eb-49cf-8fe2-e863232c7d47\") " pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:41:58.933354 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:58.932850 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:41:58.933354 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:58.932922 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs podName:7e9deb0d-98eb-49cf-8fe2-e863232c7d47 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:02.932898401 +0000 UTC m=+10.100937118 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs") pod "network-metrics-daemon-5wvlk" (UID: "7e9deb0d-98eb-49cf-8fe2-e863232c7d47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:41:59.034044 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:59.033377 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm8fj\" (UniqueName: \"kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj\") pod \"network-check-target-frh2j\" (UID: \"f6f0966a-134e-47fd-b989-63a633ca073e\") " pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:41:59.034044 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:59.033558 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:41:59.034044 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:59.033582 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:41:59.034044 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:59.033596 2554 projected.go:196] Error preparing data for projected volume kube-api-access-tm8fj for pod openshift-network-diagnostics/network-check-target-frh2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:41:59.034044 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:59.033657 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj podName:f6f0966a-134e-47fd-b989-63a633ca073e nodeName:}" failed. No retries permitted until 2026-06-10 20:42:03.033638506 +0000 UTC m=+10.201677217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tm8fj" (UniqueName: "kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj") pod "network-check-target-frh2j" (UID: "f6f0966a-134e-47fd-b989-63a633ca073e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:41:59.248200 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:59.248161 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:41:59.248385 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:59.248301 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:41:59.248452 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:59.248398 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-888f4" podUID="a48d3544-c7a8-49d0-b6f0-720732a6f056" Jun 10 20:41:59.248550 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:41:59.248536 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:41:59.248636 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:59.248613 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frh2j" podUID="f6f0966a-134e-47fd-b989-63a633ca073e" Jun 10 20:41:59.249084 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:41:59.249050 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:42:01.249035 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:01.247994 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:01.249035 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:01.248157 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:42:01.249035 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:01.248222 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:01.249035 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:01.248296 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-888f4" podUID="a48d3544-c7a8-49d0-b6f0-720732a6f056" Jun 10 20:42:01.249035 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:01.247942 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:01.249710 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:01.249066 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frh2j" podUID="f6f0966a-134e-47fd-b989-63a633ca073e" Jun 10 20:42:02.863768 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:02.863711 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret\") pod \"global-pull-secret-syncer-888f4\" (UID: \"a48d3544-c7a8-49d0-b6f0-720732a6f056\") " pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:02.864245 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:02.863897 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:02.864245 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:02.863966 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret podName:a48d3544-c7a8-49d0-b6f0-720732a6f056 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:10.863949002 +0000 UTC m=+18.031987710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret") pod "global-pull-secret-syncer-888f4" (UID: "a48d3544-c7a8-49d0-b6f0-720732a6f056") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:02.964577 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:02.964489 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs\") pod \"network-metrics-daemon-5wvlk\" (UID: \"7e9deb0d-98eb-49cf-8fe2-e863232c7d47\") " pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:02.964746 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:02.964646 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:02.964746 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:02.964713 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs podName:7e9deb0d-98eb-49cf-8fe2-e863232c7d47 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:10.964694826 +0000 UTC m=+18.132733547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs") pod "network-metrics-daemon-5wvlk" (UID: "7e9deb0d-98eb-49cf-8fe2-e863232c7d47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:03.065254 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:03.065216 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm8fj\" (UniqueName: \"kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj\") pod \"network-check-target-frh2j\" (UID: \"f6f0966a-134e-47fd-b989-63a633ca073e\") " pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:03.065445 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:03.065412 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:42:03.065445 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:03.065436 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:42:03.065562 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:03.065453 2554 projected.go:196] Error preparing data for projected volume kube-api-access-tm8fj for pod openshift-network-diagnostics/network-check-target-frh2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:03.065562 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:03.065518 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj podName:f6f0966a-134e-47fd-b989-63a633ca073e nodeName:}" failed. No retries permitted until 2026-06-10 20:42:11.065498997 +0000 UTC m=+18.233537706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tm8fj" (UniqueName: "kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj") pod "network-check-target-frh2j" (UID: "f6f0966a-134e-47fd-b989-63a633ca073e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:03.247935 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:03.247902 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:03.248503 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:03.248210 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:03.248503 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:03.248359 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:42:03.248503 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:03.248406 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:03.248503 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:03.248469 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frh2j" podUID="f6f0966a-134e-47fd-b989-63a633ca073e" Jun 10 20:42:03.248851 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:03.248819 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-888f4" podUID="a48d3544-c7a8-49d0-b6f0-720732a6f056" Jun 10 20:42:05.247598 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:05.247554 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:05.248088 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:05.247558 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:05.248088 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:05.247703 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:05.248088 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:05.247695 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frh2j" podUID="f6f0966a-134e-47fd-b989-63a633ca073e" Jun 10 20:42:05.248088 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:05.247813 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:42:05.248088 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:05.247893 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-888f4" podUID="a48d3544-c7a8-49d0-b6f0-720732a6f056" Jun 10 20:42:07.247876 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:07.247842 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:07.248327 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:07.247842 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:07.248327 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:07.247968 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-888f4" podUID="a48d3544-c7a8-49d0-b6f0-720732a6f056" Jun 10 20:42:07.248327 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:07.248068 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frh2j" podUID="f6f0966a-134e-47fd-b989-63a633ca073e" Jun 10 20:42:07.248327 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:07.247843 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:07.248327 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:07.248184 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:42:09.247953 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:09.247908 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:09.248395 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:09.247907 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:09.248395 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:09.248064 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frh2j" podUID="f6f0966a-134e-47fd-b989-63a633ca073e" Jun 10 20:42:09.248395 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:09.247908 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:09.248395 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:09.248130 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:42:09.248395 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:09.248191 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-888f4" podUID="a48d3544-c7a8-49d0-b6f0-720732a6f056" Jun 10 20:42:10.925603 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:10.925553 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret\") pod \"global-pull-secret-syncer-888f4\" (UID: \"a48d3544-c7a8-49d0-b6f0-720732a6f056\") " pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:10.926059 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:10.925724 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:10.926059 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:10.925801 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret podName:a48d3544-c7a8-49d0-b6f0-720732a6f056 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:26.925785512 +0000 UTC m=+34.093824222 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret") pod "global-pull-secret-syncer-888f4" (UID: "a48d3544-c7a8-49d0-b6f0-720732a6f056") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:11.026188 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:11.026154 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs\") pod \"network-metrics-daemon-5wvlk\" (UID: \"7e9deb0d-98eb-49cf-8fe2-e863232c7d47\") " pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:11.026339 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:11.026293 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:11.026401 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:11.026355 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs podName:7e9deb0d-98eb-49cf-8fe2-e863232c7d47 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:27.026339517 +0000 UTC m=+34.194378228 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs") pod "network-metrics-daemon-5wvlk" (UID: "7e9deb0d-98eb-49cf-8fe2-e863232c7d47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:11.127478 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:11.127442 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm8fj\" (UniqueName: \"kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj\") pod \"network-check-target-frh2j\" (UID: \"f6f0966a-134e-47fd-b989-63a633ca073e\") " pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:11.127637 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:11.127612 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:42:11.127679 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:11.127642 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:42:11.127679 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:11.127655 2554 projected.go:196] Error preparing data for projected volume kube-api-access-tm8fj for pod openshift-network-diagnostics/network-check-target-frh2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:11.127764 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:11.127717 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj podName:f6f0966a-134e-47fd-b989-63a633ca073e nodeName:}" failed. No retries permitted until 2026-06-10 20:42:27.127700681 +0000 UTC m=+34.295739387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tm8fj" (UniqueName: "kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj") pod "network-check-target-frh2j" (UID: "f6f0966a-134e-47fd-b989-63a633ca073e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:11.247232 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:11.247196 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:11.247232 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:11.247220 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:11.247414 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:11.247197 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:11.247414 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:11.247329 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:42:11.247489 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:11.247440 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-888f4" podUID="a48d3544-c7a8-49d0-b6f0-720732a6f056" Jun 10 20:42:11.247527 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:11.247510 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frh2j" podUID="f6f0966a-134e-47fd-b989-63a633ca073e" Jun 10 20:42:13.248685 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:13.248474 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:13.249119 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:13.248539 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:13.249119 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:13.248801 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:42:13.249119 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:13.248833 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-888f4" podUID="a48d3544-c7a8-49d0-b6f0-720732a6f056" Jun 10 20:42:13.249119 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:13.248566 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:13.249119 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:13.248911 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frh2j" podUID="f6f0966a-134e-47fd-b989-63a633ca073e" Jun 10 20:42:15.247151 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:15.247119 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:15.247882 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:15.247330 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-888f4" podUID="a48d3544-c7a8-49d0-b6f0-720732a6f056" Jun 10 20:42:15.247882 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:15.247718 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:15.247882 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:15.247820 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frh2j" podUID="f6f0966a-134e-47fd-b989-63a633ca073e" Jun 10 20:42:15.248053 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:15.247892 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:15.248053 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:15.247977 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:42:15.326468 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:15.326244 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zfl89" event={"ID":"dfb762df-1072-4f6d-af60-da1fe0c98b0d","Type":"ContainerStarted","Data":"6068a70bece10263593054e60f24a480705f63b43b4460c0769394ef13016759"} Jun 10 20:42:15.328242 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:15.328170 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mc66f" event={"ID":"ce79514f-80c6-42db-b060-1823e18a9bca","Type":"ContainerStarted","Data":"d3cf6b0ea2495fd0fdfb50dc9a005dc4585cf4d448708a778462c823d29ebf6e"} Jun 10 20:42:15.329665 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:15.329637 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5mnxb" event={"ID":"8e775399-2b2b-45c1-823c-dc848145fd90","Type":"ContainerStarted","Data":"0341771deccdc48ffa48f37c53f04c835a27a5fffb8af1af6f00dc9e2d8e83b0"} Jun 10 20:42:15.330929 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:15.330898 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" event={"ID":"0b16548a-48d2-4a83-9bc6-ca8103fb630a","Type":"ContainerStarted","Data":"c3fbdd6334740764788bef06cfb8dc2e1764ddf9fea3dd083fd00985baf9514d"} Jun 10 20:42:15.332265 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:15.332245 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" event={"ID":"2ea4153e-5118-4192-be41-025c35f7c9f2","Type":"ContainerStarted","Data":"e226a7814a1b7b13470823ba949ff318f1a2ef72264bc03015fdf9ccfffede1c"} Jun 10 20:42:15.333801 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:15.333778 2554 generic.go:356] "Generic (PLEG): container finished" podID="2f817cd6-446c-4995-b2d5-ebf8f614d598" containerID="7585e7a60e351c8b8ee4c2d3145e78599aad0cb98aef974b875c86b93c746ad2" exitCode=0 Jun 10 20:42:15.333900 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:15.333809 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wkzj6" event={"ID":"2f817cd6-446c-4995-b2d5-ebf8f614d598","Type":"ContainerDied","Data":"7585e7a60e351c8b8ee4c2d3145e78599aad0cb98aef974b875c86b93c746ad2"} Jun 10 20:42:15.345021 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:15.344962 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-84.ec2.internal" podStartSLOduration=21.344942242 podStartE2EDuration="21.344942242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:41:57.30834535 +0000 UTC m=+4.476384085" watchObservedRunningTime="2026-06-10 20:42:15.344942242 +0000 UTC m=+22.512980970" Jun 10 20:42:15.365267 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:15.365091 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5mnxb" podStartSLOduration=3.53999598 podStartE2EDuration="22.365076257s" totalImagesPullingTime="18.825080277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:15.364605188 +0000 UTC m=+22.532643918" watchObservedRunningTime="2026-06-10 20:42:15.365076257 +0000 UTC m=+22.533114986" Jun 10 20:42:15.365392 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:15.365297 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zfl89" podStartSLOduration=3.549116377 podStartE2EDuration="22.365291752s" totalImagesPullingTime="18.816175375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:15.3461511 +0000 UTC m=+22.514189828" watchObservedRunningTime="2026-06-10 20:42:15.365291752 +0000 UTC m=+22.533330480" Jun 10 20:42:15.431792 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:15.431724 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mc66f" podStartSLOduration=3.6790641490000002 podStartE2EDuration="22.431697831s" totalImagesPullingTime="18.752633682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:15.411849852 +0000 UTC m=+22.579888584" watchObservedRunningTime="2026-06-10 20:42:15.431697831 +0000 UTC m=+22.599736556" Jun 10 20:42:15.431973 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:15.431942 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bzhjf" podStartSLOduration=3.6071324259999997 podStartE2EDuration="22.431932339s" totalImagesPullingTime="18.824799913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:15.431055974 +0000 UTC m=+22.599094700" watchObservedRunningTime="2026-06-10 20:42:15.431932339 +0000 UTC m=+22.599971069" Jun 10 20:42:15.961130 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:15.961047 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mc66f" Jun 10 20:42:15.962068 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:15.961820 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mc66f" Jun 10 20:42:16.338861 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:16.338841 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 20:42:16.339297 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:16.339192 2554 generic.go:356] "Generic (PLEG): container finished" podID="d056ae52-f669-4b21-abb9-1223de0b748e" containerID="1e8a6b5894186638710cb51e1420d96c331d71642e43413b45949ca76174d2d8" exitCode=1 Jun 10 20:42:16.339297 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:16.339224 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" event={"ID":"d056ae52-f669-4b21-abb9-1223de0b748e","Type":"ContainerStarted","Data":"d33bc47aed6ca528ddcde06d65a3d430f9ed459fd8019a9172e6d0564f6e3187"} Jun 10 20:42:16.339427 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:16.339312 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" event={"ID":"d056ae52-f669-4b21-abb9-1223de0b748e","Type":"ContainerStarted","Data":"f087a02d5ec0c62ac33dc6d254c0fbc383575d029fbbdfb05b6d588161acedd5"} Jun 10 20:42:16.339427 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:16.339360 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" event={"ID":"d056ae52-f669-4b21-abb9-1223de0b748e","Type":"ContainerStarted","Data":"5b5793b39b2d043206055b25fafe952faf1014f0705fc6903f2c38b5341b0600"} Jun 10 20:42:16.339427 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:16.339412 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" event={"ID":"d056ae52-f669-4b21-abb9-1223de0b748e","Type":"ContainerStarted","Data":"2f16723ef98cb8fb5583783034fd4b764467261cb69896f5182e4a6bdca9c64e"} Jun 10 20:42:16.339574 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:16.339459 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" event={"ID":"d056ae52-f669-4b21-abb9-1223de0b748e","Type":"ContainerDied","Data":"1e8a6b5894186638710cb51e1420d96c331d71642e43413b45949ca76174d2d8"} Jun 10 20:42:16.339574 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:16.339509 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" event={"ID":"d056ae52-f669-4b21-abb9-1223de0b748e","Type":"ContainerStarted","Data":"f4cb45c6e52390e5c44000ead6a0d69f95481ddc0c880b545f132e7cf66c97c6"} Jun 10 20:42:16.340834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:16.340809 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kgsz7" event={"ID":"ce4e2367-1145-42ee-be5f-2c17bd0d13ff","Type":"ContainerStarted","Data":"f4b9ed14eaaadf7caddc8c78e4a437c25ee4b44bb79147881cd4bc158f0368cf"} Jun 10 20:42:16.341731 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:16.341599 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mc66f" Jun 10 20:42:16.342057 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:16.342037 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mc66f" Jun 10 20:42:16.361718 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:16.361675 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kgsz7" podStartSLOduration=4.298643345 podStartE2EDuration="23.361659965s" totalImagesPullingTime="19.06301662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:16.360952089 +0000 UTC m=+23.528990819" watchObservedRunningTime="2026-06-10 20:42:16.361659965 +0000 UTC m=+23.529698694" Jun 10 20:42:16.482674 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:16.482496 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 20:42:17.245967 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:17.245849 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T20:42:16.482668878Z","UUID":"6abf827a-dc3a-4f77-ac8b-4c84e37b35cd","Handler":null,"Name":"","Endpoint":""} Jun 10 20:42:17.247371 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:17.247343 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:17.248237 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:17.247356 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:17.248237 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:17.247501 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-888f4" podUID="a48d3544-c7a8-49d0-b6f0-720732a6f056" Jun 10 20:42:17.248237 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:17.247579 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:42:17.248237 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:17.247625 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:17.248237 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:17.247711 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frh2j" podUID="f6f0966a-134e-47fd-b989-63a633ca073e" Jun 10 20:42:17.248237 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:17.248210 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 20:42:17.248579 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:17.248249 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 20:42:17.345281 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:17.345167 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qrx7z" event={"ID":"be8a6911-3511-4477-8ad3-bede37c12310","Type":"ContainerStarted","Data":"b680c38d05158b0f8f41bb5b5d24170790f60abc1739e909b9ec8da023109ad9"} Jun 10 20:42:17.350369 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:17.350282 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" event={"ID":"0b16548a-48d2-4a83-9bc6-ca8103fb630a","Type":"ContainerStarted","Data":"8bc52eaf41063bc5cfdc3b19bf9c72c4e26f61e6331779390e367168c2ca8405"} Jun 10 20:42:17.363845 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:17.363789 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qrx7z" podStartSLOduration=5.544924153 podStartE2EDuration="24.363769856s" totalImagesPullingTime="18.818845703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:17.363256251 +0000 UTC m=+24.531294992" watchObservedRunningTime="2026-06-10 20:42:17.363769856 +0000 UTC m=+24.531808592" Jun 10 20:42:18.354902 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:18.354816 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" event={"ID":"0b16548a-48d2-4a83-9bc6-ca8103fb630a","Type":"ContainerStarted","Data":"789f3db5fb474870ea0dafe8e66b48c5197461ad7ffc2d74e2983f032cc6708b"} Jun 10 20:42:18.377638 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:18.377584 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nslp" podStartSLOduration=4.403501108 podStartE2EDuration="25.377564047s" totalImagesPullingTime="20.974062939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:18.377534716 +0000 UTC m=+25.545573446" watchObservedRunningTime="2026-06-10 20:42:18.377564047 +0000 UTC m=+25.545602759" Jun 10 20:42:19.247783 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:19.247749 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:19.247985 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:19.247749 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:19.247985 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:19.247894 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:42:19.247985 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:19.247751 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:19.247985 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:19.247970 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-888f4" podUID="a48d3544-c7a8-49d0-b6f0-720732a6f056" Jun 10 20:42:19.248224 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:19.248081 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frh2j" podUID="f6f0966a-134e-47fd-b989-63a633ca073e" Jun 10 20:42:20.364190 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:20.364163 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 20:42:20.365001 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:20.364567 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" event={"ID":"d056ae52-f669-4b21-abb9-1223de0b748e","Type":"ContainerStarted","Data":"75e680fc23fe5994448899a27349a8607dd969e198bd3344a9b393198c5a7ab8"} Jun 10 20:42:20.366160 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:20.366131 2554 generic.go:356] "Generic (PLEG): container finished" podID="2f817cd6-446c-4995-b2d5-ebf8f614d598" containerID="b47c9979a732bb086944d00d2b03e8cea4f318631728f66a8b33ae7c382bc8f4" exitCode=0 Jun 10 20:42:20.366248 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:20.366176 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wkzj6" event={"ID":"2f817cd6-446c-4995-b2d5-ebf8f614d598","Type":"ContainerDied","Data":"b47c9979a732bb086944d00d2b03e8cea4f318631728f66a8b33ae7c382bc8f4"} Jun 10 20:42:21.247214 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:21.247183 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:21.247214 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:21.247197 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:21.247450 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:21.247291 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:42:21.247450 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:21.247364 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-888f4" podUID="a48d3544-c7a8-49d0-b6f0-720732a6f056" Jun 10 20:42:21.247450 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:21.247412 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:21.247564 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:21.247517 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frh2j" podUID="f6f0966a-134e-47fd-b989-63a633ca073e" Jun 10 20:42:21.370895 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:21.370865 2554 generic.go:356] "Generic (PLEG): container finished" podID="2f817cd6-446c-4995-b2d5-ebf8f614d598" containerID="d9428de2fdb6ed96f8be8d1e140064799faa8e3107729da7a08c89360fca9ab7" exitCode=0 Jun 10 20:42:21.370895 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:21.370900 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wkzj6" event={"ID":"2f817cd6-446c-4995-b2d5-ebf8f614d598","Type":"ContainerDied","Data":"d9428de2fdb6ed96f8be8d1e140064799faa8e3107729da7a08c89360fca9ab7"} Jun 10 20:42:22.377151 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:22.376970 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 20:42:22.377599 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:22.377543 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" event={"ID":"d056ae52-f669-4b21-abb9-1223de0b748e","Type":"ContainerStarted","Data":"bd66329705876e64328a3684da90d06b8e3dc2165016e7b3bdf0ac5c7537d300"} Jun 10 20:42:22.377792 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:22.377766 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:42:22.378022 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:22.377989 2554 scope.go:117] "RemoveContainer" containerID="1e8a6b5894186638710cb51e1420d96c331d71642e43413b45949ca76174d2d8" Jun 10 20:42:22.380331 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:22.380305 2554 generic.go:356] "Generic (PLEG): container finished" podID="2f817cd6-446c-4995-b2d5-ebf8f614d598" containerID="07695f4250e957966b03febf36fbf62b7986ad7d78a032fc7e7a320d352a7152" exitCode=0 Jun 10 20:42:22.380435 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:22.380344 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wkzj6" event={"ID":"2f817cd6-446c-4995-b2d5-ebf8f614d598","Type":"ContainerDied","Data":"07695f4250e957966b03febf36fbf62b7986ad7d78a032fc7e7a320d352a7152"} Jun 10 20:42:22.395118 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:22.395095 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:42:23.170681 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:23.170641 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:42:23.248472 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:23.248441 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:23.248642 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:23.248537 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:23.248642 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:23.248581 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:23.248642 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:23.248578 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:42:23.248827 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:23.248651 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-888f4" podUID="a48d3544-c7a8-49d0-b6f0-720732a6f056" Jun 10 20:42:23.248827 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:23.248771 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frh2j" podUID="f6f0966a-134e-47fd-b989-63a633ca073e" Jun 10 20:42:23.387217 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:23.387004 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 20:42:23.387778 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:23.387752 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" event={"ID":"d056ae52-f669-4b21-abb9-1223de0b748e","Type":"ContainerStarted","Data":"6cbb329e87c7d72194a74c178a8743676be166f6712dcc2c4aefbfef9cc7fb9c"} Jun 10 20:42:23.388225 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:23.388132 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:42:23.406749 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:23.406716 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:42:23.421995 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:23.421889 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" podStartSLOduration=11.364288566 podStartE2EDuration="30.421873205s" totalImagesPullingTime="19.057584639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:23.419739673 +0000 UTC m=+30.587778403" watchObservedRunningTime="2026-06-10 20:42:23.421873205 +0000 UTC m=+30.589911934" Jun 10 20:42:23.900588 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:23.900546 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-888f4"] Jun 10 20:42:23.900768 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:23.900681 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:23.900907 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:23.900798 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-888f4" podUID="a48d3544-c7a8-49d0-b6f0-720732a6f056" Jun 10 20:42:23.903666 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:23.903634 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5wvlk"] Jun 10 20:42:23.903880 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:23.903765 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:23.904032 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:23.903877 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:42:23.904320 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:23.904282 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-frh2j"] Jun 10 20:42:23.904927 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:23.904363 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:23.904927 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:23.904452 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frh2j" podUID="f6f0966a-134e-47fd-b989-63a633ca073e" Jun 10 20:42:26.247655 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:26.247611 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:26.247655 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:26.247637 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:26.248530 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:26.247632 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:26.248530 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:26.247759 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frh2j" podUID="f6f0966a-134e-47fd-b989-63a633ca073e" Jun 10 20:42:26.248530 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:26.247835 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-888f4" podUID="a48d3544-c7a8-49d0-b6f0-720732a6f056" Jun 10 20:42:26.248530 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:26.247932 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:42:26.949540 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:26.949508 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret\") pod \"global-pull-secret-syncer-888f4\" (UID: \"a48d3544-c7a8-49d0-b6f0-720732a6f056\") " pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:26.949741 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:26.949642 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:26.949741 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:26.949707 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret podName:a48d3544-c7a8-49d0-b6f0-720732a6f056 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:58.949687267 +0000 UTC m=+66.117725975 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret") pod "global-pull-secret-syncer-888f4" (UID: "a48d3544-c7a8-49d0-b6f0-720732a6f056") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:27.050854 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:27.050816 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs\") pod \"network-metrics-daemon-5wvlk\" (UID: \"7e9deb0d-98eb-49cf-8fe2-e863232c7d47\") " pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:27.051048 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:27.050966 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:27.051048 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:27.051039 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs podName:7e9deb0d-98eb-49cf-8fe2-e863232c7d47 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:59.05102063 +0000 UTC m=+66.219059351 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs") pod "network-metrics-daemon-5wvlk" (UID: "7e9deb0d-98eb-49cf-8fe2-e863232c7d47") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:27.151978 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:27.151946 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm8fj\" (UniqueName: \"kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj\") pod \"network-check-target-frh2j\" (UID: \"f6f0966a-134e-47fd-b989-63a633ca073e\") " pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:27.152164 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:27.152121 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:42:27.152164 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:27.152143 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:42:27.152164 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:27.152153 2554 projected.go:196] Error preparing data for projected volume kube-api-access-tm8fj for pod openshift-network-diagnostics/network-check-target-frh2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:27.152318 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:27.152217 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj podName:f6f0966a-134e-47fd-b989-63a633ca073e nodeName:}" failed. No retries permitted until 2026-06-10 20:42:59.152198404 +0000 UTC m=+66.320237130 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tm8fj" (UniqueName: "kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj") pod "network-check-target-frh2j" (UID: "f6f0966a-134e-47fd-b989-63a633ca073e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:27.401044 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:27.400812 2554 generic.go:356] "Generic (PLEG): container finished" podID="2f817cd6-446c-4995-b2d5-ebf8f614d598" containerID="756055b19c798c18a4f8ff59713913aaba3b27afe569bed3ea73ebb18a4e1099" exitCode=0 Jun 10 20:42:27.401401 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:27.400892 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wkzj6" event={"ID":"2f817cd6-446c-4995-b2d5-ebf8f614d598","Type":"ContainerDied","Data":"756055b19c798c18a4f8ff59713913aaba3b27afe569bed3ea73ebb18a4e1099"} Jun 10 20:42:28.153746 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.153718 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-84.ec2.internal" event="NodeReady" Jun 10 20:42:28.153916 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.153846 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 20:42:28.199367 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.199335 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b454d5d46-h8m5g"] Jun 10 20:42:28.225492 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.225458 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t6qck"] Jun 10 20:42:28.225651 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.225587 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.228953 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.228850 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 20:42:28.228953 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.228872 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 20:42:28.229881 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.229859 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-754v9\"" Jun 10 20:42:28.230021 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.229890 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 20:42:28.236463 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.236442 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 20:42:28.241599 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.241576 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b454d5d46-h8m5g"] Jun 10 20:42:28.241702 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.241613 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6t6v2"] Jun 10 20:42:28.241702 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.241685 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t6qck" Jun 10 20:42:28.244479 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.244459 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 20:42:28.244574 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.244480 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 20:42:28.244574 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.244491 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqr9w\"" Jun 10 20:42:28.255542 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.255521 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t6qck"] Jun 10 20:42:28.255648 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.255559 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6t6v2"] Jun 10 20:42:28.255648 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.255642 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6t6v2" Jun 10 20:42:28.255727 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.255673 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:28.255727 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.255712 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:28.255998 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.255923 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:28.260439 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.260384 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 20:42:28.260439 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.260398 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 20:42:28.260595 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.260456 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 20:42:28.260595 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.260480 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 20:42:28.260595 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.260496 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 20:42:28.260595 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.260506 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 20:42:28.260780 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.260609 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 20:42:28.260923 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.260902 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-822dd\"" Jun 10 20:42:28.261035 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.260952 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j48kb\"" Jun 10 20:42:28.261035 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.260993 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hk7c2\"" Jun 10 20:42:28.361248 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.361210 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.361248 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.361250 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9964f961-20d9-4e7f-b456-76023883f432-tmp-dir\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:42:28.361474 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.361277 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9964f961-20d9-4e7f-b456-76023883f432-config-volume\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:42:28.361474 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.361299 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1196aa7e-0de4-4288-b2ce-1d8ab82f532d-cert\") pod \"ingress-canary-6t6v2\" (UID: \"1196aa7e-0de4-4288-b2ce-1d8ab82f532d\") " pod="openshift-ingress-canary/ingress-canary-6t6v2" Jun 10 20:42:28.361474 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.361364 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-ca-trust-extracted\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.361474 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.361403 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6bbb\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-kube-api-access-f6bbb\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.361474 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.361427 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-certificates\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.361474 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.361458 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-bound-sa-token\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.361685 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.361478 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg2tz\" (UniqueName: \"kubernetes.io/projected/9964f961-20d9-4e7f-b456-76023883f432-kube-api-access-pg2tz\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:42:28.361685 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.361498 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-trusted-ca\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.361685 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.361517 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-installation-pull-secrets\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.361685 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.361609 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-image-registry-private-configuration\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.361685 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.361642 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:42:28.361685 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.361663 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stwq9\" (UniqueName: \"kubernetes.io/projected/1196aa7e-0de4-4288-b2ce-1d8ab82f532d-kube-api-access-stwq9\") pod \"ingress-canary-6t6v2\" (UID: \"1196aa7e-0de4-4288-b2ce-1d8ab82f532d\") " pod="openshift-ingress-canary/ingress-canary-6t6v2" Jun 10 20:42:28.406240 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.406156 2554 generic.go:356] "Generic (PLEG): container finished" podID="2f817cd6-446c-4995-b2d5-ebf8f614d598" containerID="c7c6c5f4034e59e76e2f9af071a02d82f5b239e1f861dab145ad03e387efe578" exitCode=0 Jun 10 20:42:28.406240 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.406189 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wkzj6" event={"ID":"2f817cd6-446c-4995-b2d5-ebf8f614d598","Type":"ContainerDied","Data":"c7c6c5f4034e59e76e2f9af071a02d82f5b239e1f861dab145ad03e387efe578"} Jun 10 20:42:28.462805 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.462762 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-trusted-ca\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.462984 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.462816 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-installation-pull-secrets\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.463073 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.463051 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-image-registry-private-configuration\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.463112 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.463084 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:42:28.463145 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.463112 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stwq9\" (UniqueName: \"kubernetes.io/projected/1196aa7e-0de4-4288-b2ce-1d8ab82f532d-kube-api-access-stwq9\") pod \"ingress-canary-6t6v2\" (UID: \"1196aa7e-0de4-4288-b2ce-1d8ab82f532d\") " pod="openshift-ingress-canary/ingress-canary-6t6v2" Jun 10 20:42:28.463181 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.463144 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.463181 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.463168 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9964f961-20d9-4e7f-b456-76023883f432-tmp-dir\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:42:28.463243 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.463194 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9964f961-20d9-4e7f-b456-76023883f432-config-volume\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:42:28.463243 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.463213 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1196aa7e-0de4-4288-b2ce-1d8ab82f532d-cert\") pod \"ingress-canary-6t6v2\" (UID: \"1196aa7e-0de4-4288-b2ce-1d8ab82f532d\") " pod="openshift-ingress-canary/ingress-canary-6t6v2" Jun 10 20:42:28.463302 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.463248 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-ca-trust-extracted\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.463302 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.463275 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6bbb\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-kube-api-access-f6bbb\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.463363 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.463313 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-certificates\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.463363 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.463354 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-bound-sa-token\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.463422 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.463385 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg2tz\" (UniqueName: \"kubernetes.io/projected/9964f961-20d9-4e7f-b456-76023883f432-kube-api-access-pg2tz\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:42:28.464178 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:28.463840 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:42:28.464178 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:28.463862 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b454d5d46-h8m5g: secret "image-registry-tls" not found Jun 10 20:42:28.464178 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:28.463927 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls podName:49d8d16e-b992-4c11-b1f1-daf9ec7c3f41 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:28.96390968 +0000 UTC m=+36.131948387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls") pod "image-registry-7b454d5d46-h8m5g" (UID: "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41") : secret "image-registry-tls" not found Jun 10 20:42:28.464178 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.463949 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9964f961-20d9-4e7f-b456-76023883f432-config-volume\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:42:28.464178 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:28.464046 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:28.464178 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:28.464100 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls podName:9964f961-20d9-4e7f-b456-76023883f432 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:28.964084272 +0000 UTC m=+36.132122991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls") pod "dns-default-t6qck" (UID: "9964f961-20d9-4e7f-b456-76023883f432") : secret "dns-default-metrics-tls" not found Jun 10 20:42:28.464178 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.464099 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-trusted-ca\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.464178 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.464145 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-certificates\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.464596 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.464186 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9964f961-20d9-4e7f-b456-76023883f432-tmp-dir\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:42:28.464596 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.464204 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-ca-trust-extracted\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.468281 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.468234 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-installation-pull-secrets\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.468834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.468813 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1196aa7e-0de4-4288-b2ce-1d8ab82f532d-cert\") pod \"ingress-canary-6t6v2\" (UID: \"1196aa7e-0de4-4288-b2ce-1d8ab82f532d\") " pod="openshift-ingress-canary/ingress-canary-6t6v2" Jun 10 20:42:28.471305 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.471278 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-image-registry-private-configuration\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.475185 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.475158 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stwq9\" (UniqueName: \"kubernetes.io/projected/1196aa7e-0de4-4288-b2ce-1d8ab82f532d-kube-api-access-stwq9\") pod \"ingress-canary-6t6v2\" (UID: \"1196aa7e-0de4-4288-b2ce-1d8ab82f532d\") " pod="openshift-ingress-canary/ingress-canary-6t6v2" Jun 10 20:42:28.475827 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.475711 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg2tz\" (UniqueName: \"kubernetes.io/projected/9964f961-20d9-4e7f-b456-76023883f432-kube-api-access-pg2tz\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:42:28.475827 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.475751 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-bound-sa-token\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.476683 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.476665 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6bbb\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-kube-api-access-f6bbb\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.564725 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.564706 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6t6v2" Jun 10 20:42:28.745844 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.745808 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6t6v2"] Jun 10 20:42:28.750169 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:42:28.750002 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1196aa7e_0de4_4288_b2ce_1d8ab82f532d.slice/crio-d89742aaf5b77e02cc50537f007eb7f6454d2796d3bfc38c2a97562fa1cad25a WatchSource:0}: Error finding container d89742aaf5b77e02cc50537f007eb7f6454d2796d3bfc38c2a97562fa1cad25a: Status 404 returned error can't find the container with id d89742aaf5b77e02cc50537f007eb7f6454d2796d3bfc38c2a97562fa1cad25a Jun 10 20:42:28.967346 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.967313 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:42:28.967509 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:28.967356 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:28.967509 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:28.967469 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:42:28.967509 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:28.967474 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:28.967697 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:28.967546 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls podName:9964f961-20d9-4e7f-b456-76023883f432 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:29.967526606 +0000 UTC m=+37.135565314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls") pod "dns-default-t6qck" (UID: "9964f961-20d9-4e7f-b456-76023883f432") : secret "dns-default-metrics-tls" not found Jun 10 20:42:28.967697 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:28.967480 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b454d5d46-h8m5g: secret "image-registry-tls" not found Jun 10 20:42:28.967697 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:28.967606 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls podName:49d8d16e-b992-4c11-b1f1-daf9ec7c3f41 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:29.967595104 +0000 UTC m=+37.135633810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls") pod "image-registry-7b454d5d46-h8m5g" (UID: "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41") : secret "image-registry-tls" not found Jun 10 20:42:29.413429 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:29.413347 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wkzj6" event={"ID":"2f817cd6-446c-4995-b2d5-ebf8f614d598","Type":"ContainerStarted","Data":"3b3d0a0c3911baa47549f53a55daa28d1c4159680a019783e0ff9d57017ab119"} Jun 10 20:42:29.414714 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:29.414687 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6t6v2" event={"ID":"1196aa7e-0de4-4288-b2ce-1d8ab82f532d","Type":"ContainerStarted","Data":"d89742aaf5b77e02cc50537f007eb7f6454d2796d3bfc38c2a97562fa1cad25a"} Jun 10 20:42:29.444075 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:29.444000 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wkzj6" podStartSLOduration=6.899571353 podStartE2EDuration="36.443977448s" totalImagesPullingTime="29.544406095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:29.441547288 +0000 UTC m=+36.609586018" watchObservedRunningTime="2026-06-10 20:42:29.443977448 +0000 UTC m=+36.612016178" Jun 10 20:42:29.974680 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:29.974638 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:42:29.974680 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:29.974684 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:29.974893 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:29.974793 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:29.974893 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:29.974855 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls podName:9964f961-20d9-4e7f-b456-76023883f432 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:31.974839663 +0000 UTC m=+39.142878373 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls") pod "dns-default-t6qck" (UID: "9964f961-20d9-4e7f-b456-76023883f432") : secret "dns-default-metrics-tls" not found Jun 10 20:42:29.974893 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:29.974797 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:42:29.974893 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:29.974894 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b454d5d46-h8m5g: secret "image-registry-tls" not found Jun 10 20:42:29.975042 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:29.974935 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls podName:49d8d16e-b992-4c11-b1f1-daf9ec7c3f41 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:31.97492369 +0000 UTC m=+39.142962397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls") pod "image-registry-7b454d5d46-h8m5g" (UID: "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41") : secret "image-registry-tls" not found Jun 10 20:42:31.420825 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:31.420788 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6t6v2" event={"ID":"1196aa7e-0de4-4288-b2ce-1d8ab82f532d","Type":"ContainerStarted","Data":"f49d02f5e4013fbc9ed21408c198ca0723be76766199fa65c7c24e97f55f90bd"} Jun 10 20:42:31.440919 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:31.440866 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6t6v2" podStartSLOduration=1.38240365 podStartE2EDuration="3.440850199s" totalImagesPullingTime="2.058446549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:31.440323609 +0000 UTC m=+38.608362338" watchObservedRunningTime="2026-06-10 20:42:31.440850199 +0000 UTC m=+38.608888928" Jun 10 20:42:31.991221 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:31.991172 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:42:31.991221 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:31.991229 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:31.991457 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:31.991363 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:31.991457 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:31.991427 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls podName:9964f961-20d9-4e7f-b456-76023883f432 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:35.99141242 +0000 UTC m=+43.159451132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls") pod "dns-default-t6qck" (UID: "9964f961-20d9-4e7f-b456-76023883f432") : secret "dns-default-metrics-tls" not found Jun 10 20:42:31.991457 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:31.991367 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:42:31.991579 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:31.991465 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b454d5d46-h8m5g: secret "image-registry-tls" not found Jun 10 20:42:31.991579 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:31.991506 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls podName:49d8d16e-b992-4c11-b1f1-daf9ec7c3f41 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:35.991494828 +0000 UTC m=+43.159533535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls") pod "image-registry-7b454d5d46-h8m5g" (UID: "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41") : secret "image-registry-tls" not found Jun 10 20:42:36.017714 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:36.017679 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:42:36.018234 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:36.017721 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:36.018234 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:36.017836 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:42:36.018234 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:36.017848 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b454d5d46-h8m5g: secret "image-registry-tls" not found Jun 10 20:42:36.018234 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:36.017894 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls podName:49d8d16e-b992-4c11-b1f1-daf9ec7c3f41 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:44.017880171 +0000 UTC m=+51.185918878 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls") pod "image-registry-7b454d5d46-h8m5g" (UID: "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41") : secret "image-registry-tls" not found Jun 10 20:42:36.018234 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:36.017836 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:36.018234 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:36.017965 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls podName:9964f961-20d9-4e7f-b456-76023883f432 nodeName:}" failed. No retries permitted until 2026-06-10 20:42:44.017951886 +0000 UTC m=+51.185990592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls") pod "dns-default-t6qck" (UID: "9964f961-20d9-4e7f-b456-76023883f432") : secret "dns-default-metrics-tls" not found Jun 10 20:42:44.073806 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:44.073763 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:42:44.074363 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:44.073816 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:42:44.074363 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:44.073933 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:44.074363 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:44.073974 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:42:44.074363 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:44.073991 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b454d5d46-h8m5g: secret "image-registry-tls" not found Jun 10 20:42:44.074363 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:44.074038 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls podName:9964f961-20d9-4e7f-b456-76023883f432 nodeName:}" failed. No retries permitted until 2026-06-10 20:43:00.073999497 +0000 UTC m=+67.242038204 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls") pod "dns-default-t6qck" (UID: "9964f961-20d9-4e7f-b456-76023883f432") : secret "dns-default-metrics-tls" not found Jun 10 20:42:44.074363 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:44.074073 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls podName:49d8d16e-b992-4c11-b1f1-daf9ec7c3f41 nodeName:}" failed. No retries permitted until 2026-06-10 20:43:00.07405708 +0000 UTC m=+67.242095790 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls") pod "image-registry-7b454d5d46-h8m5g" (UID: "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41") : secret "image-registry-tls" not found Jun 10 20:42:55.404134 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:55.404103 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5dd9" Jun 10 20:42:58.979933 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:58.979889 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret\") pod \"global-pull-secret-syncer-888f4\" (UID: \"a48d3544-c7a8-49d0-b6f0-720732a6f056\") " pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:58.983337 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:58.983315 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 20:42:58.993439 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:58.993405 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a48d3544-c7a8-49d0-b6f0-720732a6f056-original-pull-secret\") pod \"global-pull-secret-syncer-888f4\" (UID: \"a48d3544-c7a8-49d0-b6f0-720732a6f056\") " pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:59.080451 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:59.080405 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs\") pod \"network-metrics-daemon-5wvlk\" (UID: \"7e9deb0d-98eb-49cf-8fe2-e863232c7d47\") " pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:42:59.083994 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:59.083973 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 20:42:59.090879 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:59.090859 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 20:42:59.090947 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:42:59.090934 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs podName:7e9deb0d-98eb-49cf-8fe2-e863232c7d47 nodeName:}" failed. No retries permitted until 2026-06-10 20:44:03.090914809 +0000 UTC m=+130.258953521 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs") pod "network-metrics-daemon-5wvlk" (UID: "7e9deb0d-98eb-49cf-8fe2-e863232c7d47") : secret "metrics-daemon-secret" not found Jun 10 20:42:59.171966 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:59.171935 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-888f4" Jun 10 20:42:59.181339 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:59.181157 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm8fj\" (UniqueName: \"kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj\") pod \"network-check-target-frh2j\" (UID: \"f6f0966a-134e-47fd-b989-63a633ca073e\") " pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:59.184795 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:59.184771 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 20:42:59.194564 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:59.194542 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 20:42:59.204443 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:59.204420 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm8fj\" (UniqueName: \"kubernetes.io/projected/f6f0966a-134e-47fd-b989-63a633ca073e-kube-api-access-tm8fj\") pod \"network-check-target-frh2j\" (UID: \"f6f0966a-134e-47fd-b989-63a633ca073e\") " pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:59.300747 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:59.298511 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-888f4"] Jun 10 20:42:59.301546 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:42:59.301520 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48d3544_c7a8_49d0_b6f0_720732a6f056.slice/crio-f71cd6df162d7f18627c8302a5abdedfc67f3776971ca47274af7f2b6264d640 WatchSource:0}: Error finding container f71cd6df162d7f18627c8302a5abdedfc67f3776971ca47274af7f2b6264d640: Status 404 returned error can't find the container with id f71cd6df162d7f18627c8302a5abdedfc67f3776971ca47274af7f2b6264d640 Jun 10 20:42:59.480570 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:59.480538 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hk7c2\"" Jun 10 20:42:59.487402 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:59.487382 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:42:59.488357 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:59.488333 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-888f4" event={"ID":"a48d3544-c7a8-49d0-b6f0-720732a6f056","Type":"ContainerStarted","Data":"f71cd6df162d7f18627c8302a5abdedfc67f3776971ca47274af7f2b6264d640"} Jun 10 20:42:59.622747 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:42:59.622713 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-frh2j"] Jun 10 20:42:59.626051 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:42:59.626027 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f0966a_134e_47fd_b989_63a633ca073e.slice/crio-05517ffd2803c278fda592d5c776be47fa82f30b63fa23cb19b0ac840e2f5f3a WatchSource:0}: Error finding container 05517ffd2803c278fda592d5c776be47fa82f30b63fa23cb19b0ac840e2f5f3a: Status 404 returned error can't find the container with id 05517ffd2803c278fda592d5c776be47fa82f30b63fa23cb19b0ac840e2f5f3a Jun 10 20:43:00.088048 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:43:00.087991 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:43:00.088468 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:43:00.088126 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:43:00.088468 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:43:00.088138 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:43:00.088468 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:43:00.088160 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b454d5d46-h8m5g: secret "image-registry-tls" not found Jun 10 20:43:00.088468 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:43:00.088229 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls podName:49d8d16e-b992-4c11-b1f1-daf9ec7c3f41 nodeName:}" failed. No retries permitted until 2026-06-10 20:43:32.08820649 +0000 UTC m=+99.256245200 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls") pod "image-registry-7b454d5d46-h8m5g" (UID: "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41") : secret "image-registry-tls" not found Jun 10 20:43:00.088468 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:43:00.088232 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:43:00.088468 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:43:00.088283 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls podName:9964f961-20d9-4e7f-b456-76023883f432 nodeName:}" failed. No retries permitted until 2026-06-10 20:43:32.088267123 +0000 UTC m=+99.256305833 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls") pod "dns-default-t6qck" (UID: "9964f961-20d9-4e7f-b456-76023883f432") : secret "dns-default-metrics-tls" not found Jun 10 20:43:00.493277 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:43:00.493229 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-frh2j" event={"ID":"f6f0966a-134e-47fd-b989-63a633ca073e","Type":"ContainerStarted","Data":"05517ffd2803c278fda592d5c776be47fa82f30b63fa23cb19b0ac840e2f5f3a"} Jun 10 20:43:03.502567 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:43:03.502514 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-frh2j" event={"ID":"f6f0966a-134e-47fd-b989-63a633ca073e","Type":"ContainerStarted","Data":"b0cc2961fe3098e7e901d3a20f5ca50b0ed6a00629a9eb46040c601118922e92"} Jun 10 20:43:03.503057 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:43:03.502648 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:43:03.529687 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:43:03.529626 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-frh2j" podStartSLOduration=67.667482952 podStartE2EDuration="1m10.529606326s" totalImagesPullingTime="2.862123374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:43:03.529241407 +0000 UTC m=+70.697280136" watchObservedRunningTime="2026-06-10 20:43:03.529606326 +0000 UTC m=+70.697645096" Jun 10 20:43:05.508937 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:43:05.508899 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-888f4" event={"ID":"a48d3544-c7a8-49d0-b6f0-720732a6f056","Type":"ContainerStarted","Data":"09759e14c717f3da0b4e459f9b11aa3e024ab3074efd8ce36b19c0f9d0eb830b"} Jun 10 20:43:05.530279 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:43:05.530229 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-888f4" podStartSLOduration=67.301397131 podStartE2EDuration="1m12.5302135s" totalImagesPullingTime="5.228816369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:43:05.529681126 +0000 UTC m=+72.697719852" watchObservedRunningTime="2026-06-10 20:43:05.5302135 +0000 UTC m=+72.698252229" Jun 10 20:43:32.111869 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:43:32.111719 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:43:32.111869 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:43:32.111779 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:43:32.111869 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:43:32.111873 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:43:32.112448 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:43:32.111884 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b454d5d46-h8m5g: secret "image-registry-tls" not found Jun 10 20:43:32.112448 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:43:32.111895 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:43:32.112448 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:43:32.111936 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls podName:49d8d16e-b992-4c11-b1f1-daf9ec7c3f41 nodeName:}" failed. No retries permitted until 2026-06-10 20:44:36.111923511 +0000 UTC m=+163.279962218 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls") pod "image-registry-7b454d5d46-h8m5g" (UID: "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41") : secret "image-registry-tls" not found Jun 10 20:43:32.112448 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:43:32.111968 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls podName:9964f961-20d9-4e7f-b456-76023883f432 nodeName:}" failed. No retries permitted until 2026-06-10 20:44:36.111951591 +0000 UTC m=+163.279990297 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls") pod "dns-default-t6qck" (UID: "9964f961-20d9-4e7f-b456-76023883f432") : secret "dns-default-metrics-tls" not found Jun 10 20:43:34.508260 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:43:34.508232 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-frh2j" Jun 10 20:44:03.138694 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:44:03.138648 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs\") pod \"network-metrics-daemon-5wvlk\" (UID: \"7e9deb0d-98eb-49cf-8fe2-e863232c7d47\") " pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:44:03.139199 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:44:03.138800 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 20:44:03.139199 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:44:03.138877 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs podName:7e9deb0d-98eb-49cf-8fe2-e863232c7d47 nodeName:}" failed. No retries permitted until 2026-06-10 20:46:05.138860423 +0000 UTC m=+252.306899130 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs") pod "network-metrics-daemon-5wvlk" (UID: "7e9deb0d-98eb-49cf-8fe2-e863232c7d47") : secret "metrics-daemon-secret" not found Jun 10 20:44:31.235968 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:44:31.235919 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" podUID="49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" Jun 10 20:44:31.249987 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:44:31.249953 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-t6qck" podUID="9964f961-20d9-4e7f-b456-76023883f432" Jun 10 20:44:31.281255 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:44:31.281203 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5wvlk" podUID="7e9deb0d-98eb-49cf-8fe2-e863232c7d47" Jun 10 20:44:31.714174 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:44:31.714145 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t6qck" Jun 10 20:44:31.714333 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:44:31.714145 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:44:36.180196 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:44:36.180162 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:44:36.180196 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:44:36.180203 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:44:36.180697 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:44:36.180309 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 20:44:36.180697 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:44:36.180319 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b454d5d46-h8m5g: secret "image-registry-tls" not found Jun 10 20:44:36.180697 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:44:36.180339 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:44:36.180697 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:44:36.180373 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls podName:49d8d16e-b992-4c11-b1f1-daf9ec7c3f41 nodeName:}" failed. No retries permitted until 2026-06-10 20:46:38.180359257 +0000 UTC m=+285.348397964 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls") pod "image-registry-7b454d5d46-h8m5g" (UID: "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41") : secret "image-registry-tls" not found Jun 10 20:44:36.180697 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:44:36.180392 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls podName:9964f961-20d9-4e7f-b456-76023883f432 nodeName:}" failed. No retries permitted until 2026-06-10 20:46:38.180378483 +0000 UTC m=+285.348417189 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls") pod "dns-default-t6qck" (UID: "9964f961-20d9-4e7f-b456-76023883f432") : secret "dns-default-metrics-tls" not found Jun 10 20:44:44.247280 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:44:44.247177 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:45:33.630059 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.630022 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq"] Jun 10 20:45:33.631806 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.631788 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq" Jun 10 20:45:33.633451 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.633424 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v"] Jun 10 20:45:33.634907 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.634889 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v" Jun 10 20:45:33.635450 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.635428 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2vx68\"" Jun 10 20:45:33.635723 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.635703 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 10 20:45:33.638774 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.638424 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 10 20:45:33.639820 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.639800 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 20:45:33.640023 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.639990 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:45:33.640106 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.640028 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 20:45:33.640197 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.640168 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tfc2h\"" Jun 10 20:45:33.640301 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.640287 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 20:45:33.642367 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.642351 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-8g77m"] Jun 10 20:45:33.643965 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.643948 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn"] Jun 10 20:45:33.644103 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.644085 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.645687 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.645663 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn" Jun 10 20:45:33.647280 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.647261 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 20:45:33.647525 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.647510 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 20:45:33.647603 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.647552 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 20:45:33.647705 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.647691 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-h8nmh\"" Jun 10 20:45:33.648976 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.648959 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 10 20:45:33.649118 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.649101 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 10 20:45:33.649233 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.649217 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:45:33.649297 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.649284 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 10 20:45:33.654420 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.654399 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 20:45:33.654694 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.654672 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-l4k42\"" Jun 10 20:45:33.656222 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.656199 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq"] Jun 10 20:45:33.656530 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.656479 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v"] Jun 10 20:45:33.661970 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.661939 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 20:45:33.665347 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.665313 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-8g77m"] Jun 10 20:45:33.666274 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.666254 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn"] Jun 10 20:45:33.738085 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.738056 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl"] Jun 10 20:45:33.739866 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.739850 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" Jun 10 20:45:33.743285 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.743263 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vlrwz\"" Jun 10 20:45:33.743732 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.743719 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 20:45:33.744246 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.744231 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 20:45:33.745955 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.745796 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 10 20:45:33.745955 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.745816 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 10 20:45:33.756378 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.756349 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-q45zb"] Jun 10 20:45:33.758369 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.758349 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:45:33.762138 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:33.762111 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"console-operator-config\" is forbidden: User \"system:node:ip-10-0-140-84.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-140-84.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" type="*v1.ConfigMap" Jun 10 20:45:33.762834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.762818 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:45:33.762955 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:33.762924 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"serving-cert\" is forbidden: User \"system:node:ip-10-0-140-84.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-140-84.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" type="*v1.Secret" Jun 10 20:45:33.769100 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.769081 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 20:45:33.773534 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.773518 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xfjsh\"" Jun 10 20:45:33.773861 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.773846 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 20:45:33.780646 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.780622 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-q45zb"] Jun 10 20:45:33.781346 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.781323 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl"] Jun 10 20:45:33.797807 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.797780 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87fb2abe-9f87-4b54-8dee-185d03cb44df-tmp\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.797984 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.797840 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3502f4bb-82a1-406e-8aa7-d3208d930019-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-r6k8v\" (UID: \"3502f4bb-82a1-406e-8aa7-d3208d930019\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v" Jun 10 20:45:33.797984 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.797868 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87fb2abe-9f87-4b54-8dee-185d03cb44df-trusted-ca-bundle\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.797984 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.797892 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/613bd58e-71b8-46cc-a1ce-624d082f1bb7-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-mcsmq\" (UID: \"613bd58e-71b8-46cc-a1ce-624d082f1bb7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq" Jun 10 20:45:33.797984 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.797916 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dwl8\" (UniqueName: \"kubernetes.io/projected/3502f4bb-82a1-406e-8aa7-d3208d930019-kube-api-access-8dwl8\") pod \"service-ca-operator-6bc5ff68f5-r6k8v\" (UID: \"3502f4bb-82a1-406e-8aa7-d3208d930019\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v" Jun 10 20:45:33.797984 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.797964 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkjmx\" (UniqueName: \"kubernetes.io/projected/87fb2abe-9f87-4b54-8dee-185d03cb44df-kube-api-access-nkjmx\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.798272 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.797996 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-mcsmq\" (UID: \"613bd58e-71b8-46cc-a1ce-624d082f1bb7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq" Jun 10 20:45:33.798272 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.798040 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/87fb2abe-9f87-4b54-8dee-185d03cb44df-snapshots\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.798272 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.798056 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58bb00d7-2d5c-4874-9325-2064a631a4cd-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gpxxn\" (UID: \"58bb00d7-2d5c-4874-9325-2064a631a4cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn" Jun 10 20:45:33.798272 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.798103 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87fb2abe-9f87-4b54-8dee-185d03cb44df-service-ca-bundle\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.798272 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.798121 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58bb00d7-2d5c-4874-9325-2064a631a4cd-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gpxxn\" (UID: \"58bb00d7-2d5c-4874-9325-2064a631a4cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn" Jun 10 20:45:33.798272 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.798136 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3502f4bb-82a1-406e-8aa7-d3208d930019-config\") pod \"service-ca-operator-6bc5ff68f5-r6k8v\" (UID: \"3502f4bb-82a1-406e-8aa7-d3208d930019\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v" Jun 10 20:45:33.798272 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.798153 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75z5z\" (UniqueName: \"kubernetes.io/projected/58bb00d7-2d5c-4874-9325-2064a631a4cd-kube-api-access-75z5z\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gpxxn\" (UID: \"58bb00d7-2d5c-4874-9325-2064a631a4cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn" Jun 10 20:45:33.798272 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.798241 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/87fb2abe-9f87-4b54-8dee-185d03cb44df-serving-cert\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.899232 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899139 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dwl8\" (UniqueName: \"kubernetes.io/projected/3502f4bb-82a1-406e-8aa7-d3208d930019-kube-api-access-8dwl8\") pod \"service-ca-operator-6bc5ff68f5-r6k8v\" (UID: \"3502f4bb-82a1-406e-8aa7-d3208d930019\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v" Jun 10 20:45:33.899232 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899181 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkjmx\" (UniqueName: \"kubernetes.io/projected/87fb2abe-9f87-4b54-8dee-185d03cb44df-kube-api-access-nkjmx\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.899232 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899197 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-mcsmq\" (UID: \"613bd58e-71b8-46cc-a1ce-624d082f1bb7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq" Jun 10 20:45:33.899232 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899231 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0cb4cf3-6f97-486a-aa96-515ce709fcc5-trusted-ca\") pod \"console-operator-668fdbf85c-q45zb\" (UID: \"d0cb4cf3-6f97-486a-aa96-515ce709fcc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:45:33.899532 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899266 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/87fb2abe-9f87-4b54-8dee-185d03cb44df-snapshots\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.899532 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899291 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58bb00d7-2d5c-4874-9325-2064a631a4cd-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gpxxn\" (UID: \"58bb00d7-2d5c-4874-9325-2064a631a4cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn" Jun 10 20:45:33.899532 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:33.899309 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 20:45:33.899532 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:33.899388 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert podName:613bd58e-71b8-46cc-a1ce-624d082f1bb7 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:34.399369521 +0000 UTC m=+221.567408231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-mcsmq" (UID: "613bd58e-71b8-46cc-a1ce-624d082f1bb7") : secret "networking-console-plugin-cert" not found Jun 10 20:45:33.899532 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899444 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d0cb4cf3-6f97-486a-aa96-515ce709fcc5-config\") pod \"console-operator-668fdbf85c-q45zb\" (UID: \"d0cb4cf3-6f97-486a-aa96-515ce709fcc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:45:33.899532 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899471 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87fb2abe-9f87-4b54-8dee-185d03cb44df-service-ca-bundle\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.899532 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899490 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d0cb4cf3-6f97-486a-aa96-515ce709fcc5-serving-cert\") pod \"console-operator-668fdbf85c-q45zb\" (UID: \"d0cb4cf3-6f97-486a-aa96-515ce709fcc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:45:33.899868 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899593 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58bb00d7-2d5c-4874-9325-2064a631a4cd-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gpxxn\" (UID: \"58bb00d7-2d5c-4874-9325-2064a631a4cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn" Jun 10 20:45:33.899868 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899631 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3502f4bb-82a1-406e-8aa7-d3208d930019-config\") pod \"service-ca-operator-6bc5ff68f5-r6k8v\" (UID: \"3502f4bb-82a1-406e-8aa7-d3208d930019\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v" Jun 10 20:45:33.899868 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899650 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75z5z\" (UniqueName: \"kubernetes.io/projected/58bb00d7-2d5c-4874-9325-2064a631a4cd-kube-api-access-75z5z\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gpxxn\" (UID: \"58bb00d7-2d5c-4874-9325-2064a631a4cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn" Jun 10 20:45:33.899868 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899673 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlldj\" (UniqueName: \"kubernetes.io/projected/ad054163-9b63-4bb4-88ca-3fb640a1e913-kube-api-access-wlldj\") pod \"cluster-monitoring-operator-74bbf69bbb-crtkl\" (UID: \"ad054163-9b63-4bb4-88ca-3fb640a1e913\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" Jun 10 20:45:33.899868 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899704 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/87fb2abe-9f87-4b54-8dee-185d03cb44df-serving-cert\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.899868 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899726 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87fb2abe-9f87-4b54-8dee-185d03cb44df-tmp\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.899868 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899783 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnwvs\" (UniqueName: \"kubernetes.io/projected/d0cb4cf3-6f97-486a-aa96-515ce709fcc5-kube-api-access-cnwvs\") pod \"console-operator-668fdbf85c-q45zb\" (UID: \"d0cb4cf3-6f97-486a-aa96-515ce709fcc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:45:33.899868 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899842 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3502f4bb-82a1-406e-8aa7-d3208d930019-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-r6k8v\" (UID: \"3502f4bb-82a1-406e-8aa7-d3208d930019\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v" Jun 10 20:45:33.900311 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899875 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87fb2abe-9f87-4b54-8dee-185d03cb44df-trusted-ca-bundle\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.900311 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899902 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/613bd58e-71b8-46cc-a1ce-624d082f1bb7-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-mcsmq\" (UID: \"613bd58e-71b8-46cc-a1ce-624d082f1bb7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq" Jun 10 20:45:33.900311 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899927 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ad054163-9b63-4bb4-88ca-3fb640a1e913-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-crtkl\" (UID: \"ad054163-9b63-4bb4-88ca-3fb640a1e913\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" Jun 10 20:45:33.900311 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.899954 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-crtkl\" (UID: \"ad054163-9b63-4bb4-88ca-3fb640a1e913\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" Jun 10 20:45:33.900311 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.900040 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87fb2abe-9f87-4b54-8dee-185d03cb44df-tmp\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.900311 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.900052 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/87fb2abe-9f87-4b54-8dee-185d03cb44df-snapshots\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.900747 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.900725 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3502f4bb-82a1-406e-8aa7-d3208d930019-config\") pod \"service-ca-operator-6bc5ff68f5-r6k8v\" (UID: \"3502f4bb-82a1-406e-8aa7-d3208d930019\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v" Jun 10 20:45:33.900819 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.900762 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58bb00d7-2d5c-4874-9325-2064a631a4cd-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gpxxn\" (UID: \"58bb00d7-2d5c-4874-9325-2064a631a4cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn" Jun 10 20:45:33.901028 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.900984 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87fb2abe-9f87-4b54-8dee-185d03cb44df-service-ca-bundle\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.901092 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.900992 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/613bd58e-71b8-46cc-a1ce-624d082f1bb7-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-mcsmq\" (UID: \"613bd58e-71b8-46cc-a1ce-624d082f1bb7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq" Jun 10 20:45:33.901092 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.901048 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87fb2abe-9f87-4b54-8dee-185d03cb44df-trusted-ca-bundle\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.902183 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.902163 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3502f4bb-82a1-406e-8aa7-d3208d930019-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-r6k8v\" (UID: \"3502f4bb-82a1-406e-8aa7-d3208d930019\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v" Jun 10 20:45:33.902504 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.902483 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58bb00d7-2d5c-4874-9325-2064a631a4cd-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gpxxn\" (UID: \"58bb00d7-2d5c-4874-9325-2064a631a4cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn" Jun 10 20:45:33.902583 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.902508 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/87fb2abe-9f87-4b54-8dee-185d03cb44df-serving-cert\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.933265 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.933224 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75z5z\" (UniqueName: \"kubernetes.io/projected/58bb00d7-2d5c-4874-9325-2064a631a4cd-kube-api-access-75z5z\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gpxxn\" (UID: \"58bb00d7-2d5c-4874-9325-2064a631a4cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn" Jun 10 20:45:33.933265 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.933252 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dwl8\" (UniqueName: \"kubernetes.io/projected/3502f4bb-82a1-406e-8aa7-d3208d930019-kube-api-access-8dwl8\") pod \"service-ca-operator-6bc5ff68f5-r6k8v\" (UID: \"3502f4bb-82a1-406e-8aa7-d3208d930019\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v" Jun 10 20:45:33.937627 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.937590 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkjmx\" (UniqueName: \"kubernetes.io/projected/87fb2abe-9f87-4b54-8dee-185d03cb44df-kube-api-access-nkjmx\") pod \"insights-operator-896549976-8g77m\" (UID: \"87fb2abe-9f87-4b54-8dee-185d03cb44df\") " pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.948395 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.948364 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v" Jun 10 20:45:33.957310 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.957282 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-8g77m" Jun 10 20:45:33.964432 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:33.964408 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn" Jun 10 20:45:34.001709 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.000712 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnwvs\" (UniqueName: \"kubernetes.io/projected/d0cb4cf3-6f97-486a-aa96-515ce709fcc5-kube-api-access-cnwvs\") pod \"console-operator-668fdbf85c-q45zb\" (UID: \"d0cb4cf3-6f97-486a-aa96-515ce709fcc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:45:34.001709 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.000783 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ad054163-9b63-4bb4-88ca-3fb640a1e913-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-crtkl\" (UID: \"ad054163-9b63-4bb4-88ca-3fb640a1e913\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" Jun 10 20:45:34.001709 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.000810 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-crtkl\" (UID: \"ad054163-9b63-4bb4-88ca-3fb640a1e913\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" Jun 10 20:45:34.001709 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.000860 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0cb4cf3-6f97-486a-aa96-515ce709fcc5-trusted-ca\") pod \"console-operator-668fdbf85c-q45zb\" (UID: \"d0cb4cf3-6f97-486a-aa96-515ce709fcc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:45:34.001709 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.000925 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d0cb4cf3-6f97-486a-aa96-515ce709fcc5-config\") pod \"console-operator-668fdbf85c-q45zb\" (UID: \"d0cb4cf3-6f97-486a-aa96-515ce709fcc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:45:34.001709 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.000951 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d0cb4cf3-6f97-486a-aa96-515ce709fcc5-serving-cert\") pod \"console-operator-668fdbf85c-q45zb\" (UID: \"d0cb4cf3-6f97-486a-aa96-515ce709fcc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:45:34.001709 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.000985 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlldj\" (UniqueName: \"kubernetes.io/projected/ad054163-9b63-4bb4-88ca-3fb640a1e913-kube-api-access-wlldj\") pod \"cluster-monitoring-operator-74bbf69bbb-crtkl\" (UID: \"ad054163-9b63-4bb4-88ca-3fb640a1e913\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" Jun 10 20:45:34.002344 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.002038 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ad054163-9b63-4bb4-88ca-3fb640a1e913-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-crtkl\" (UID: \"ad054163-9b63-4bb4-88ca-3fb640a1e913\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" Jun 10 20:45:34.002344 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:34.002193 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 20:45:34.002344 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:34.002250 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls podName:ad054163-9b63-4bb4-88ca-3fb640a1e913 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:34.502232725 +0000 UTC m=+221.670271432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-crtkl" (UID: "ad054163-9b63-4bb4-88ca-3fb640a1e913") : secret "cluster-monitoring-operator-tls" not found Jun 10 20:45:34.002690 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.002671 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0cb4cf3-6f97-486a-aa96-515ce709fcc5-trusted-ca\") pod \"console-operator-668fdbf85c-q45zb\" (UID: \"d0cb4cf3-6f97-486a-aa96-515ce709fcc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:45:34.025117 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.025065 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlldj\" (UniqueName: \"kubernetes.io/projected/ad054163-9b63-4bb4-88ca-3fb640a1e913-kube-api-access-wlldj\") pod \"cluster-monitoring-operator-74bbf69bbb-crtkl\" (UID: \"ad054163-9b63-4bb4-88ca-3fb640a1e913\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" Jun 10 20:45:34.034189 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.034121 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnwvs\" (UniqueName: \"kubernetes.io/projected/d0cb4cf3-6f97-486a-aa96-515ce709fcc5-kube-api-access-cnwvs\") pod \"console-operator-668fdbf85c-q45zb\" (UID: \"d0cb4cf3-6f97-486a-aa96-515ce709fcc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:45:34.098829 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.098798 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v"] Jun 10 20:45:34.104641 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:45:34.104611 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3502f4bb_82a1_406e_8aa7_d3208d930019.slice/crio-8bb1305237ec0404f0f4b8f68d0cf09b30577b2188a3483373926538874c56a3 WatchSource:0}: Error finding container 8bb1305237ec0404f0f4b8f68d0cf09b30577b2188a3483373926538874c56a3: Status 404 returned error can't find the container with id 8bb1305237ec0404f0f4b8f68d0cf09b30577b2188a3483373926538874c56a3 Jun 10 20:45:34.121928 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.121895 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-8g77m"] Jun 10 20:45:34.125568 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:45:34.125544 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87fb2abe_9f87_4b54_8dee_185d03cb44df.slice/crio-8997f25d01afa95da94572a38190ec859794b08f21efd7ad5d63b07bef4e645a WatchSource:0}: Error finding container 8997f25d01afa95da94572a38190ec859794b08f21efd7ad5d63b07bef4e645a: Status 404 returned error can't find the container with id 8997f25d01afa95da94572a38190ec859794b08f21efd7ad5d63b07bef4e645a Jun 10 20:45:34.133664 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.133638 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn"] Jun 10 20:45:34.136739 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:45:34.136715 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58bb00d7_2d5c_4874_9325_2064a631a4cd.slice/crio-4c4c58080e11b1804ac599ded7b02c58462ced2c8e2241fe605e25bf93ae3fc4 WatchSource:0}: Error finding container 4c4c58080e11b1804ac599ded7b02c58462ced2c8e2241fe605e25bf93ae3fc4: Status 404 returned error can't find the container with id 4c4c58080e11b1804ac599ded7b02c58462ced2c8e2241fe605e25bf93ae3fc4 Jun 10 20:45:34.405738 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.405705 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-mcsmq\" (UID: \"613bd58e-71b8-46cc-a1ce-624d082f1bb7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq" Jun 10 20:45:34.405928 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:34.405811 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 20:45:34.405928 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:34.405865 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert podName:613bd58e-71b8-46cc-a1ce-624d082f1bb7 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:35.405851222 +0000 UTC m=+222.573889930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-mcsmq" (UID: "613bd58e-71b8-46cc-a1ce-624d082f1bb7") : secret "networking-console-plugin-cert" not found Jun 10 20:45:34.506392 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.506353 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-crtkl\" (UID: \"ad054163-9b63-4bb4-88ca-3fb640a1e913\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" Jun 10 20:45:34.506571 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:34.506514 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 20:45:34.506613 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:34.506591 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls podName:ad054163-9b63-4bb4-88ca-3fb640a1e913 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:35.506573232 +0000 UTC m=+222.674611938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-crtkl" (UID: "ad054163-9b63-4bb4-88ca-3fb640a1e913") : secret "cluster-monitoring-operator-tls" not found Jun 10 20:45:34.750183 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.750138 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 20:45:34.756394 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.756330 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d0cb4cf3-6f97-486a-aa96-515ce709fcc5-serving-cert\") pod \"console-operator-668fdbf85c-q45zb\" (UID: \"d0cb4cf3-6f97-486a-aa96-515ce709fcc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:45:34.865585 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.865480 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-8g77m" event={"ID":"87fb2abe-9f87-4b54-8dee-185d03cb44df","Type":"ContainerStarted","Data":"8997f25d01afa95da94572a38190ec859794b08f21efd7ad5d63b07bef4e645a"} Jun 10 20:45:34.868428 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.868357 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v" event={"ID":"3502f4bb-82a1-406e-8aa7-d3208d930019","Type":"ContainerStarted","Data":"8bb1305237ec0404f0f4b8f68d0cf09b30577b2188a3483373926538874c56a3"} Jun 10 20:45:34.869966 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:34.869943 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn" event={"ID":"58bb00d7-2d5c-4874-9325-2064a631a4cd","Type":"ContainerStarted","Data":"4c4c58080e11b1804ac599ded7b02c58462ced2c8e2241fe605e25bf93ae3fc4"} Jun 10 20:45:35.002706 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:35.002621 2554 configmap.go:193] Couldn't get configMap openshift-console-operator/console-operator-config: failed to sync configmap cache: timed out waiting for the condition Jun 10 20:45:35.002870 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:35.002728 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0cb4cf3-6f97-486a-aa96-515ce709fcc5-config podName:d0cb4cf3-6f97-486a-aa96-515ce709fcc5 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:35.502705457 +0000 UTC m=+222.670744167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/d0cb4cf3-6f97-486a-aa96-515ce709fcc5-config") pod "console-operator-668fdbf85c-q45zb" (UID: "d0cb4cf3-6f97-486a-aa96-515ce709fcc5") : failed to sync configmap cache: timed out waiting for the condition Jun 10 20:45:35.106525 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:35.106488 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 20:45:35.416040 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:35.415945 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-mcsmq\" (UID: \"613bd58e-71b8-46cc-a1ce-624d082f1bb7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq" Jun 10 20:45:35.416188 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:35.416162 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 20:45:35.416264 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:35.416245 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert podName:613bd58e-71b8-46cc-a1ce-624d082f1bb7 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:37.416226886 +0000 UTC m=+224.584265594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-mcsmq" (UID: "613bd58e-71b8-46cc-a1ce-624d082f1bb7") : secret "networking-console-plugin-cert" not found Jun 10 20:45:35.517352 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:35.517279 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d0cb4cf3-6f97-486a-aa96-515ce709fcc5-config\") pod \"console-operator-668fdbf85c-q45zb\" (UID: \"d0cb4cf3-6f97-486a-aa96-515ce709fcc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:45:35.517533 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:35.517401 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-crtkl\" (UID: \"ad054163-9b63-4bb4-88ca-3fb640a1e913\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" Jun 10 20:45:35.517609 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:35.517597 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 20:45:35.517727 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:35.517663 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls podName:ad054163-9b63-4bb4-88ca-3fb640a1e913 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:37.517643921 +0000 UTC m=+224.685682632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-crtkl" (UID: "ad054163-9b63-4bb4-88ca-3fb640a1e913") : secret "cluster-monitoring-operator-tls" not found Jun 10 20:45:35.518028 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:35.517962 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d0cb4cf3-6f97-486a-aa96-515ce709fcc5-config\") pod \"console-operator-668fdbf85c-q45zb\" (UID: \"d0cb4cf3-6f97-486a-aa96-515ce709fcc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:45:35.566244 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:35.566201 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:45:37.009390 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:37.009273 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-q45zb"] Jun 10 20:45:37.014578 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:45:37.014539 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0cb4cf3_6f97_486a_aa96_515ce709fcc5.slice/crio-a4e601edcdcbaaa2325b7207bfff8b02941d0dc865b857cdb50472e045266b2e WatchSource:0}: Error finding container a4e601edcdcbaaa2325b7207bfff8b02941d0dc865b857cdb50472e045266b2e: Status 404 returned error can't find the container with id a4e601edcdcbaaa2325b7207bfff8b02941d0dc865b857cdb50472e045266b2e Jun 10 20:45:37.435216 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:37.435176 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-mcsmq\" (UID: \"613bd58e-71b8-46cc-a1ce-624d082f1bb7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq" Jun 10 20:45:37.435432 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:37.435354 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 20:45:37.435490 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:37.435438 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert podName:613bd58e-71b8-46cc-a1ce-624d082f1bb7 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:41.435417232 +0000 UTC m=+228.603455942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-mcsmq" (UID: "613bd58e-71b8-46cc-a1ce-624d082f1bb7") : secret "networking-console-plugin-cert" not found Jun 10 20:45:37.536281 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:37.536244 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-crtkl\" (UID: \"ad054163-9b63-4bb4-88ca-3fb640a1e913\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" Jun 10 20:45:37.536491 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:37.536436 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 20:45:37.536550 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:37.536517 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls podName:ad054163-9b63-4bb4-88ca-3fb640a1e913 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:41.536496535 +0000 UTC m=+228.704535246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-crtkl" (UID: "ad054163-9b63-4bb4-88ca-3fb640a1e913") : secret "cluster-monitoring-operator-tls" not found Jun 10 20:45:37.883177 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:37.882885 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v" event={"ID":"3502f4bb-82a1-406e-8aa7-d3208d930019","Type":"ContainerStarted","Data":"df30325845e2eac3e9c6f2a1da9d32b4a4993420270165b61abc1cc1649b5630"} Jun 10 20:45:37.884436 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:37.884407 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" event={"ID":"d0cb4cf3-6f97-486a-aa96-515ce709fcc5","Type":"ContainerStarted","Data":"a4e601edcdcbaaa2325b7207bfff8b02941d0dc865b857cdb50472e045266b2e"} Jun 10 20:45:37.886028 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:37.885966 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn" event={"ID":"58bb00d7-2d5c-4874-9325-2064a631a4cd","Type":"ContainerStarted","Data":"a6b996d5aec4dad559aeb0db8c44d5f119c76ca965c4f8e9dfc9cea1b1489e1b"} Jun 10 20:45:37.887531 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:37.887485 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-8g77m" event={"ID":"87fb2abe-9f87-4b54-8dee-185d03cb44df","Type":"ContainerStarted","Data":"71bf023aeee6168456d37d5055ee2c9ee6583bcb31f525a7ca20514a22977ceb"} Jun 10 20:45:37.958729 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:37.958604 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn" podStartSLOduration=2.222613041 podStartE2EDuration="4.958583028s" totalImagesPullingTime="2.735969987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:45:37.956522225 +0000 UTC m=+225.124560954" watchObservedRunningTime="2026-06-10 20:45:37.958583028 +0000 UTC m=+225.126621758" Jun 10 20:45:37.959053 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:37.958971 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v" podStartSLOduration=2.193325658 podStartE2EDuration="4.958962862s" totalImagesPullingTime="2.765637204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:45:37.916853425 +0000 UTC m=+225.084892154" watchObservedRunningTime="2026-06-10 20:45:37.958962862 +0000 UTC m=+225.127001589" Jun 10 20:45:37.985825 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:37.985751 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-8g77m" podStartSLOduration=2.244601423 podStartE2EDuration="4.985724527s" totalImagesPullingTime="2.741123104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:45:37.982485222 +0000 UTC m=+225.150523952" watchObservedRunningTime="2026-06-10 20:45:37.985724527 +0000 UTC m=+225.153763257" Jun 10 20:45:38.154445 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:38.154364 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-rv7mm"] Jun 10 20:45:38.156498 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:38.156476 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rv7mm" Jun 10 20:45:38.159811 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:38.159500 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 10 20:45:38.159811 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:38.159499 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 10 20:45:38.159811 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:38.159612 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hqr9z\"" Jun 10 20:45:38.166729 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:38.166694 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-rv7mm"] Jun 10 20:45:38.243432 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:38.243395 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7t4l\" (UniqueName: \"kubernetes.io/projected/6f713b5f-df73-49f4-8418-8a5cee09ed4a-kube-api-access-c7t4l\") pod \"migrator-955ffdf5f-rv7mm\" (UID: \"6f713b5f-df73-49f4-8418-8a5cee09ed4a\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rv7mm" Jun 10 20:45:38.344937 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:38.344896 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7t4l\" (UniqueName: \"kubernetes.io/projected/6f713b5f-df73-49f4-8418-8a5cee09ed4a-kube-api-access-c7t4l\") pod \"migrator-955ffdf5f-rv7mm\" (UID: \"6f713b5f-df73-49f4-8418-8a5cee09ed4a\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rv7mm" Jun 10 20:45:38.354378 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:38.354342 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7t4l\" (UniqueName: \"kubernetes.io/projected/6f713b5f-df73-49f4-8418-8a5cee09ed4a-kube-api-access-c7t4l\") pod \"migrator-955ffdf5f-rv7mm\" (UID: \"6f713b5f-df73-49f4-8418-8a5cee09ed4a\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rv7mm" Jun 10 20:45:38.467058 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:38.467025 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rv7mm" Jun 10 20:45:38.620025 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:38.619980 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-rv7mm"] Jun 10 20:45:38.624289 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:45:38.624261 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f713b5f_df73_49f4_8418_8a5cee09ed4a.slice/crio-be6d30316bce2ca2ee34a5bed22a939d887034fdf48794d92623e2ffd38b246f WatchSource:0}: Error finding container be6d30316bce2ca2ee34a5bed22a939d887034fdf48794d92623e2ffd38b246f: Status 404 returned error can't find the container with id be6d30316bce2ca2ee34a5bed22a939d887034fdf48794d92623e2ffd38b246f Jun 10 20:45:38.892214 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:38.892122 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rv7mm" event={"ID":"6f713b5f-df73-49f4-8418-8a5cee09ed4a","Type":"ContainerStarted","Data":"be6d30316bce2ca2ee34a5bed22a939d887034fdf48794d92623e2ffd38b246f"} Jun 10 20:45:40.900790 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:40.900763 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/0.log" Jun 10 20:45:40.901201 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:40.900803 2554 generic.go:356] "Generic (PLEG): container finished" podID="d0cb4cf3-6f97-486a-aa96-515ce709fcc5" containerID="651d4219192848f986ce2876a11a149f55a7604bfa547819f79d330b10573878" exitCode=255 Jun 10 20:45:40.901201 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:40.900901 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" event={"ID":"d0cb4cf3-6f97-486a-aa96-515ce709fcc5","Type":"ContainerDied","Data":"651d4219192848f986ce2876a11a149f55a7604bfa547819f79d330b10573878"} Jun 10 20:45:40.901201 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:40.901134 2554 scope.go:117] "RemoveContainer" containerID="651d4219192848f986ce2876a11a149f55a7604bfa547819f79d330b10573878" Jun 10 20:45:40.902491 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:40.902468 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rv7mm" event={"ID":"6f713b5f-df73-49f4-8418-8a5cee09ed4a","Type":"ContainerStarted","Data":"400714f13f30f81e7952bc6eeb7a1bff96c6b7f1148fdd1be82a7e04f1d1db54"} Jun 10 20:45:40.902582 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:40.902513 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rv7mm" event={"ID":"6f713b5f-df73-49f4-8418-8a5cee09ed4a","Type":"ContainerStarted","Data":"0852d1117b17506cb983ee3410c55e21315b5a2559f6e98cc28825d098104027"} Jun 10 20:45:40.938597 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:40.938542 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rv7mm" podStartSLOduration=1.557850945 podStartE2EDuration="2.93851988s" totalImagesPullingTime="1.380668935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:45:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:45:40.937972411 +0000 UTC m=+228.106011142" watchObservedRunningTime="2026-06-10 20:45:40.93851988 +0000 UTC m=+228.106558608" Jun 10 20:45:41.251504 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.251477 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-vx7mp"] Jun 10 20:45:41.254370 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.254354 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-vx7mp" Jun 10 20:45:41.257351 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.257325 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 10 20:45:41.257503 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.257325 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 10 20:45:41.257630 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.257615 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-plm25\"" Jun 10 20:45:41.257707 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.257619 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 10 20:45:41.258885 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.258868 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 10 20:45:41.262494 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.262472 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-vx7mp"] Jun 10 20:45:41.369302 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.369246 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c2d8cf68-c2c7-4ff5-a473-9b84485a06eb-signing-cabundle\") pod \"service-ca-7d74d578b8-vx7mp\" (UID: \"c2d8cf68-c2c7-4ff5-a473-9b84485a06eb\") " pod="openshift-service-ca/service-ca-7d74d578b8-vx7mp" Jun 10 20:45:41.369487 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.369383 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z82c7\" (UniqueName: \"kubernetes.io/projected/c2d8cf68-c2c7-4ff5-a473-9b84485a06eb-kube-api-access-z82c7\") pod \"service-ca-7d74d578b8-vx7mp\" (UID: \"c2d8cf68-c2c7-4ff5-a473-9b84485a06eb\") " pod="openshift-service-ca/service-ca-7d74d578b8-vx7mp" Jun 10 20:45:41.369487 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.369423 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c2d8cf68-c2c7-4ff5-a473-9b84485a06eb-signing-key\") pod \"service-ca-7d74d578b8-vx7mp\" (UID: \"c2d8cf68-c2c7-4ff5-a473-9b84485a06eb\") " pod="openshift-service-ca/service-ca-7d74d578b8-vx7mp" Jun 10 20:45:41.469993 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.469952 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z82c7\" (UniqueName: \"kubernetes.io/projected/c2d8cf68-c2c7-4ff5-a473-9b84485a06eb-kube-api-access-z82c7\") pod \"service-ca-7d74d578b8-vx7mp\" (UID: \"c2d8cf68-c2c7-4ff5-a473-9b84485a06eb\") " pod="openshift-service-ca/service-ca-7d74d578b8-vx7mp" Jun 10 20:45:41.469993 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.469990 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c2d8cf68-c2c7-4ff5-a473-9b84485a06eb-signing-key\") pod \"service-ca-7d74d578b8-vx7mp\" (UID: \"c2d8cf68-c2c7-4ff5-a473-9b84485a06eb\") " pod="openshift-service-ca/service-ca-7d74d578b8-vx7mp" Jun 10 20:45:41.470246 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.470030 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-mcsmq\" (UID: \"613bd58e-71b8-46cc-a1ce-624d082f1bb7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq" Jun 10 20:45:41.470246 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.470097 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c2d8cf68-c2c7-4ff5-a473-9b84485a06eb-signing-cabundle\") pod \"service-ca-7d74d578b8-vx7mp\" (UID: \"c2d8cf68-c2c7-4ff5-a473-9b84485a06eb\") " pod="openshift-service-ca/service-ca-7d74d578b8-vx7mp" Jun 10 20:45:41.470246 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:41.470214 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 20:45:41.470353 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:41.470279 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert podName:613bd58e-71b8-46cc-a1ce-624d082f1bb7 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:49.470261331 +0000 UTC m=+236.638300047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-mcsmq" (UID: "613bd58e-71b8-46cc-a1ce-624d082f1bb7") : secret "networking-console-plugin-cert" not found Jun 10 20:45:41.470777 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.470760 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c2d8cf68-c2c7-4ff5-a473-9b84485a06eb-signing-cabundle\") pod \"service-ca-7d74d578b8-vx7mp\" (UID: \"c2d8cf68-c2c7-4ff5-a473-9b84485a06eb\") " pod="openshift-service-ca/service-ca-7d74d578b8-vx7mp" Jun 10 20:45:41.472456 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.472437 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c2d8cf68-c2c7-4ff5-a473-9b84485a06eb-signing-key\") pod \"service-ca-7d74d578b8-vx7mp\" (UID: \"c2d8cf68-c2c7-4ff5-a473-9b84485a06eb\") " pod="openshift-service-ca/service-ca-7d74d578b8-vx7mp" Jun 10 20:45:41.478807 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.478786 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z82c7\" (UniqueName: \"kubernetes.io/projected/c2d8cf68-c2c7-4ff5-a473-9b84485a06eb-kube-api-access-z82c7\") pod \"service-ca-7d74d578b8-vx7mp\" (UID: \"c2d8cf68-c2c7-4ff5-a473-9b84485a06eb\") " pod="openshift-service-ca/service-ca-7d74d578b8-vx7mp" Jun 10 20:45:41.564647 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.564548 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-vx7mp" Jun 10 20:45:41.570852 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.570826 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-crtkl\" (UID: \"ad054163-9b63-4bb4-88ca-3fb640a1e913\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" Jun 10 20:45:41.571036 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:41.570996 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 20:45:41.571112 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:41.571097 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls podName:ad054163-9b63-4bb4-88ca-3fb640a1e913 nodeName:}" failed. No retries permitted until 2026-06-10 20:45:49.571074702 +0000 UTC m=+236.739113422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-crtkl" (UID: "ad054163-9b63-4bb4-88ca-3fb640a1e913") : secret "cluster-monitoring-operator-tls" not found Jun 10 20:45:41.696460 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.696429 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-vx7mp"] Jun 10 20:45:41.699684 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:45:41.699646 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d8cf68_c2c7_4ff5_a473_9b84485a06eb.slice/crio-b83ee390bf3386fd3f8565b34a576422a949a4679c1dcd2f843306c71713af7a WatchSource:0}: Error finding container b83ee390bf3386fd3f8565b34a576422a949a4679c1dcd2f843306c71713af7a: Status 404 returned error can't find the container with id b83ee390bf3386fd3f8565b34a576422a949a4679c1dcd2f843306c71713af7a Jun 10 20:45:41.776177 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.776149 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5mnxb_8e775399-2b2b-45c1-823c-dc848145fd90/dns-node-resolver/0.log" Jun 10 20:45:41.908219 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.908148 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 20:45:41.908609 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.908589 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/0.log" Jun 10 20:45:41.908669 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.908629 2554 generic.go:356] "Generic (PLEG): container finished" podID="d0cb4cf3-6f97-486a-aa96-515ce709fcc5" containerID="37dee2660fe5598f7372d5a224f5347f9aec5c25b9bd2cac7e27576efe8209c1" exitCode=255 Jun 10 20:45:41.908736 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.908711 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" event={"ID":"d0cb4cf3-6f97-486a-aa96-515ce709fcc5","Type":"ContainerDied","Data":"37dee2660fe5598f7372d5a224f5347f9aec5c25b9bd2cac7e27576efe8209c1"} Jun 10 20:45:41.908788 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.908777 2554 scope.go:117] "RemoveContainer" containerID="651d4219192848f986ce2876a11a149f55a7604bfa547819f79d330b10573878" Jun 10 20:45:41.909045 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.908991 2554 scope.go:117] "RemoveContainer" containerID="37dee2660fe5598f7372d5a224f5347f9aec5c25b9bd2cac7e27576efe8209c1" Jun 10 20:45:41.909234 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:41.909214 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-q45zb_openshift-console-operator(d0cb4cf3-6f97-486a-aa96-515ce709fcc5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" podUID="d0cb4cf3-6f97-486a-aa96-515ce709fcc5" Jun 10 20:45:41.910327 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.910301 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-vx7mp" event={"ID":"c2d8cf68-c2c7-4ff5-a473-9b84485a06eb","Type":"ContainerStarted","Data":"dcd6eb27f23f5e9999ec9ceffa129c8cc19a0e593b71ca4f99d2e65ede5818e4"} Jun 10 20:45:41.910432 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.910344 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-vx7mp" event={"ID":"c2d8cf68-c2c7-4ff5-a473-9b84485a06eb","Type":"ContainerStarted","Data":"b83ee390bf3386fd3f8565b34a576422a949a4679c1dcd2f843306c71713af7a"} Jun 10 20:45:41.942564 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:41.942504 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-vx7mp" podStartSLOduration=0.94249009 podStartE2EDuration="942.49009ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:45:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:45:41.94158803 +0000 UTC m=+229.109626760" watchObservedRunningTime="2026-06-10 20:45:41.94249009 +0000 UTC m=+229.110528818" Jun 10 20:45:42.916665 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:42.916631 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 20:45:42.917497 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:42.917475 2554 scope.go:117] "RemoveContainer" containerID="37dee2660fe5598f7372d5a224f5347f9aec5c25b9bd2cac7e27576efe8209c1" Jun 10 20:45:42.917645 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:42.917621 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-q45zb_openshift-console-operator(d0cb4cf3-6f97-486a-aa96-515ce709fcc5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" podUID="d0cb4cf3-6f97-486a-aa96-515ce709fcc5" Jun 10 20:45:43.176360 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:43.176270 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zfl89_dfb762df-1072-4f6d-af60-da1fe0c98b0d/node-ca/0.log" Jun 10 20:45:43.575993 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:43.575960 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6t6v2_1196aa7e-0de4-4288-b2ce-1d8ab82f532d/serve-healthcheck-canary/0.log" Jun 10 20:45:44.175559 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:44.175531 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-rv7mm_6f713b5f-df73-49f4-8418-8a5cee09ed4a/migrator/0.log" Jun 10 20:45:44.376586 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:44.376552 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-rv7mm_6f713b5f-df73-49f4-8418-8a5cee09ed4a/graceful-termination/0.log" Jun 10 20:45:44.577516 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:44.577489 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-gpxxn_58bb00d7-2d5c-4874-9325-2064a631a4cd/kube-storage-version-migrator-operator/0.log" Jun 10 20:45:45.566672 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:45.566633 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:45:45.567089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:45.566691 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:45:45.567089 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:45.567054 2554 scope.go:117] "RemoveContainer" containerID="37dee2660fe5598f7372d5a224f5347f9aec5c25b9bd2cac7e27576efe8209c1" Jun 10 20:45:45.567222 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:45.567204 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-q45zb_openshift-console-operator(d0cb4cf3-6f97-486a-aa96-515ce709fcc5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" podUID="d0cb4cf3-6f97-486a-aa96-515ce709fcc5" Jun 10 20:45:49.537622 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:49.537580 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-mcsmq\" (UID: \"613bd58e-71b8-46cc-a1ce-624d082f1bb7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq" Jun 10 20:45:49.538005 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:49.537731 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 20:45:49.538005 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:49.537796 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert podName:613bd58e-71b8-46cc-a1ce-624d082f1bb7 nodeName:}" failed. No retries permitted until 2026-06-10 20:46:05.537779745 +0000 UTC m=+252.705818459 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-mcsmq" (UID: "613bd58e-71b8-46cc-a1ce-624d082f1bb7") : secret "networking-console-plugin-cert" not found Jun 10 20:45:49.638937 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:45:49.638892 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-crtkl\" (UID: \"ad054163-9b63-4bb4-88ca-3fb640a1e913\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" Jun 10 20:45:49.639136 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:49.639052 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 20:45:49.639136 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:45:49.639118 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls podName:ad054163-9b63-4bb4-88ca-3fb640a1e913 nodeName:}" failed. No retries permitted until 2026-06-10 20:46:05.639102056 +0000 UTC m=+252.807140764 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-crtkl" (UID: "ad054163-9b63-4bb4-88ca-3fb640a1e913") : secret "cluster-monitoring-operator-tls" not found Jun 10 20:46:00.247737 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:00.247699 2554 scope.go:117] "RemoveContainer" containerID="37dee2660fe5598f7372d5a224f5347f9aec5c25b9bd2cac7e27576efe8209c1" Jun 10 20:46:00.976197 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:00.976170 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 20:46:00.976356 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:00.976241 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" event={"ID":"d0cb4cf3-6f97-486a-aa96-515ce709fcc5","Type":"ContainerStarted","Data":"4adf1a6d5d9f30cfa0119721a91aa238614d390b9973774f606f459edde8c012"} Jun 10 20:46:00.976581 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:00.976558 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:46:01.000486 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:01.000431 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" podStartSLOduration=25.009853087 podStartE2EDuration="28.000414147s" totalImagesPullingTime="2.99056106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:00.999673401 +0000 UTC m=+248.167712131" watchObservedRunningTime="2026-06-10 20:46:01.000414147 +0000 UTC m=+248.168452942" Jun 10 20:46:01.126060 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:01.126002 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-q45zb" Jun 10 20:46:03.708274 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.708242 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8v7nj"] Jun 10 20:46:03.711554 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.711529 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8v7nj" Jun 10 20:46:03.714900 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.714880 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nzswp\"" Jun 10 20:46:03.715048 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.714897 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 20:46:03.716330 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.716314 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 20:46:03.725894 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.725870 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8v7nj"] Jun 10 20:46:03.750863 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.750828 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e969446-840b-469c-b684-a2be448cbe75-crio-socket\") pod \"insights-runtime-extractor-8v7nj\" (UID: \"4e969446-840b-469c-b684-a2be448cbe75\") " pod="openshift-insights/insights-runtime-extractor-8v7nj" Jun 10 20:46:03.750863 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.750862 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsmsr\" (UniqueName: \"kubernetes.io/projected/4e969446-840b-469c-b684-a2be448cbe75-kube-api-access-zsmsr\") pod \"insights-runtime-extractor-8v7nj\" (UID: \"4e969446-840b-469c-b684-a2be448cbe75\") " pod="openshift-insights/insights-runtime-extractor-8v7nj" Jun 10 20:46:03.751126 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.750933 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e969446-840b-469c-b684-a2be448cbe75-data-volume\") pod \"insights-runtime-extractor-8v7nj\" (UID: \"4e969446-840b-469c-b684-a2be448cbe75\") " pod="openshift-insights/insights-runtime-extractor-8v7nj" Jun 10 20:46:03.751126 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.751038 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e969446-840b-469c-b684-a2be448cbe75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8v7nj\" (UID: \"4e969446-840b-469c-b684-a2be448cbe75\") " pod="openshift-insights/insights-runtime-extractor-8v7nj" Jun 10 20:46:03.751221 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.751124 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e969446-840b-469c-b684-a2be448cbe75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8v7nj\" (UID: \"4e969446-840b-469c-b684-a2be448cbe75\") " pod="openshift-insights/insights-runtime-extractor-8v7nj" Jun 10 20:46:03.852242 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.852204 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e969446-840b-469c-b684-a2be448cbe75-crio-socket\") pod \"insights-runtime-extractor-8v7nj\" (UID: \"4e969446-840b-469c-b684-a2be448cbe75\") " pod="openshift-insights/insights-runtime-extractor-8v7nj" Jun 10 20:46:03.852242 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.852244 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsmsr\" (UniqueName: \"kubernetes.io/projected/4e969446-840b-469c-b684-a2be448cbe75-kube-api-access-zsmsr\") pod \"insights-runtime-extractor-8v7nj\" (UID: \"4e969446-840b-469c-b684-a2be448cbe75\") " pod="openshift-insights/insights-runtime-extractor-8v7nj" Jun 10 20:46:03.852485 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.852302 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e969446-840b-469c-b684-a2be448cbe75-data-volume\") pod \"insights-runtime-extractor-8v7nj\" (UID: \"4e969446-840b-469c-b684-a2be448cbe75\") " pod="openshift-insights/insights-runtime-extractor-8v7nj" Jun 10 20:46:03.852485 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.852341 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e969446-840b-469c-b684-a2be448cbe75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8v7nj\" (UID: \"4e969446-840b-469c-b684-a2be448cbe75\") " pod="openshift-insights/insights-runtime-extractor-8v7nj" Jun 10 20:46:03.852485 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.852350 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e969446-840b-469c-b684-a2be448cbe75-crio-socket\") pod \"insights-runtime-extractor-8v7nj\" (UID: \"4e969446-840b-469c-b684-a2be448cbe75\") " pod="openshift-insights/insights-runtime-extractor-8v7nj" Jun 10 20:46:03.852485 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.852475 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e969446-840b-469c-b684-a2be448cbe75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8v7nj\" (UID: \"4e969446-840b-469c-b684-a2be448cbe75\") " pod="openshift-insights/insights-runtime-extractor-8v7nj" Jun 10 20:46:03.852741 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.852720 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e969446-840b-469c-b684-a2be448cbe75-data-volume\") pod \"insights-runtime-extractor-8v7nj\" (UID: \"4e969446-840b-469c-b684-a2be448cbe75\") " pod="openshift-insights/insights-runtime-extractor-8v7nj" Jun 10 20:46:03.853114 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.853087 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e969446-840b-469c-b684-a2be448cbe75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8v7nj\" (UID: \"4e969446-840b-469c-b684-a2be448cbe75\") " pod="openshift-insights/insights-runtime-extractor-8v7nj" Jun 10 20:46:03.855035 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.854998 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e969446-840b-469c-b684-a2be448cbe75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8v7nj\" (UID: \"4e969446-840b-469c-b684-a2be448cbe75\") " pod="openshift-insights/insights-runtime-extractor-8v7nj" Jun 10 20:46:03.873819 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:03.873788 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsmsr\" (UniqueName: \"kubernetes.io/projected/4e969446-840b-469c-b684-a2be448cbe75-kube-api-access-zsmsr\") pod \"insights-runtime-extractor-8v7nj\" (UID: \"4e969446-840b-469c-b684-a2be448cbe75\") " pod="openshift-insights/insights-runtime-extractor-8v7nj" Jun 10 20:46:04.020408 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:04.020309 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8v7nj" Jun 10 20:46:04.153039 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:04.152884 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8v7nj"] Jun 10 20:46:04.155552 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:46:04.155527 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e969446_840b_469c_b684_a2be448cbe75.slice/crio-c035212d542ae19be1b5c4730b295e3cd4642dbbdf332f79b2e34e201bb17f8d WatchSource:0}: Error finding container c035212d542ae19be1b5c4730b295e3cd4642dbbdf332f79b2e34e201bb17f8d: Status 404 returned error can't find the container with id c035212d542ae19be1b5c4730b295e3cd4642dbbdf332f79b2e34e201bb17f8d Jun 10 20:46:04.994662 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:04.994627 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8v7nj" event={"ID":"4e969446-840b-469c-b684-a2be448cbe75","Type":"ContainerStarted","Data":"c643d7344d8d0066c08852cb447d308dc6d922df242a626823ca1438d078ebee"} Jun 10 20:46:04.995078 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:04.994680 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8v7nj" event={"ID":"4e969446-840b-469c-b684-a2be448cbe75","Type":"ContainerStarted","Data":"d17d52c0edc024d5d9fee690fa90e87a86aa9f5a8cda32a2d05dc2d919c748e0"} Jun 10 20:46:04.995078 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:04.994701 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8v7nj" event={"ID":"4e969446-840b-469c-b684-a2be448cbe75","Type":"ContainerStarted","Data":"c035212d542ae19be1b5c4730b295e3cd4642dbbdf332f79b2e34e201bb17f8d"} Jun 10 20:46:05.164740 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:05.164638 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs\") pod \"network-metrics-daemon-5wvlk\" (UID: \"7e9deb0d-98eb-49cf-8fe2-e863232c7d47\") " pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:46:05.167021 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:05.166981 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e9deb0d-98eb-49cf-8fe2-e863232c7d47-metrics-certs\") pod \"network-metrics-daemon-5wvlk\" (UID: \"7e9deb0d-98eb-49cf-8fe2-e863232c7d47\") " pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:46:05.251673 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:05.251637 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j48kb\"" Jun 10 20:46:05.258212 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:05.258185 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wvlk" Jun 10 20:46:05.404321 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:05.404286 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5wvlk"] Jun 10 20:46:05.407171 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:46:05.407139 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e9deb0d_98eb_49cf_8fe2_e863232c7d47.slice/crio-640ba9a18e44ab32f97585a31f6a97bad0c21ee6fe3254ed08d032cc0e235e68 WatchSource:0}: Error finding container 640ba9a18e44ab32f97585a31f6a97bad0c21ee6fe3254ed08d032cc0e235e68: Status 404 returned error can't find the container with id 640ba9a18e44ab32f97585a31f6a97bad0c21ee6fe3254ed08d032cc0e235e68 Jun 10 20:46:05.567773 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:05.567689 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-mcsmq\" (UID: \"613bd58e-71b8-46cc-a1ce-624d082f1bb7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq" Jun 10 20:46:05.570701 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:05.570654 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/613bd58e-71b8-46cc-a1ce-624d082f1bb7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-mcsmq\" (UID: \"613bd58e-71b8-46cc-a1ce-624d082f1bb7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq" Jun 10 20:46:05.668171 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:05.668134 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-crtkl\" (UID: \"ad054163-9b63-4bb4-88ca-3fb640a1e913\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" Jun 10 20:46:05.670794 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:05.670759 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad054163-9b63-4bb4-88ca-3fb640a1e913-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-crtkl\" (UID: \"ad054163-9b63-4bb4-88ca-3fb640a1e913\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" Jun 10 20:46:05.745453 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:05.745414 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2vx68\"" Jun 10 20:46:05.753363 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:05.753330 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq" Jun 10 20:46:05.851764 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:05.851683 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vlrwz\"" Jun 10 20:46:05.859411 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:05.859372 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" Jun 10 20:46:06.001365 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:06.001322 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5wvlk" event={"ID":"7e9deb0d-98eb-49cf-8fe2-e863232c7d47","Type":"ContainerStarted","Data":"640ba9a18e44ab32f97585a31f6a97bad0c21ee6fe3254ed08d032cc0e235e68"} Jun 10 20:46:06.326391 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:06.326329 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq"] Jun 10 20:46:06.328818 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:46:06.328786 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod613bd58e_71b8_46cc_a1ce_624d082f1bb7.slice/crio-88b5202ed7074adb1926c771adf02217ce9f734c6e278a73757a063b325d3c62 WatchSource:0}: Error finding container 88b5202ed7074adb1926c771adf02217ce9f734c6e278a73757a063b325d3c62: Status 404 returned error can't find the container with id 88b5202ed7074adb1926c771adf02217ce9f734c6e278a73757a063b325d3c62 Jun 10 20:46:06.343416 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:06.343269 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl"] Jun 10 20:46:06.346438 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:46:06.346406 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad054163_9b63_4bb4_88ca_3fb640a1e913.slice/crio-c0fffe507d0d722dd6efb77c1fb58ae1f5614117ff60e865ecfbfd5ff91401fe WatchSource:0}: Error finding container c0fffe507d0d722dd6efb77c1fb58ae1f5614117ff60e865ecfbfd5ff91401fe: Status 404 returned error can't find the container with id c0fffe507d0d722dd6efb77c1fb58ae1f5614117ff60e865ecfbfd5ff91401fe Jun 10 20:46:07.009463 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:07.009424 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8v7nj" event={"ID":"4e969446-840b-469c-b684-a2be448cbe75","Type":"ContainerStarted","Data":"4e1774d21125c50f92a8027831e820e5ece5bfe73643d5a97d1672b5d69fa843"} Jun 10 20:46:07.012597 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:07.012542 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5wvlk" event={"ID":"7e9deb0d-98eb-49cf-8fe2-e863232c7d47","Type":"ContainerStarted","Data":"c9f28c116822d8b65e629b01c5ed05a08af53e2b3a54cca1e7db763a06e90d80"} Jun 10 20:46:07.012750 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:07.012603 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5wvlk" event={"ID":"7e9deb0d-98eb-49cf-8fe2-e863232c7d47","Type":"ContainerStarted","Data":"9ecec938c37ebab24c314e263d682360083f0725910992f3143742d5c8dd6bfc"} Jun 10 20:46:07.014785 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:07.014758 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" event={"ID":"ad054163-9b63-4bb4-88ca-3fb640a1e913","Type":"ContainerStarted","Data":"c0fffe507d0d722dd6efb77c1fb58ae1f5614117ff60e865ecfbfd5ff91401fe"} Jun 10 20:46:07.016484 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:07.016456 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq" event={"ID":"613bd58e-71b8-46cc-a1ce-624d082f1bb7","Type":"ContainerStarted","Data":"88b5202ed7074adb1926c771adf02217ce9f734c6e278a73757a063b325d3c62"} Jun 10 20:46:07.033385 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:07.033336 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8v7nj" podStartSLOduration=2.084061936 podStartE2EDuration="4.033317411s" totalImagesPullingTime="1.949255475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:46:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:07.030573037 +0000 UTC m=+254.198611768" watchObservedRunningTime="2026-06-10 20:46:07.033317411 +0000 UTC m=+254.201356144" Jun 10 20:46:07.049836 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:07.049751 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5wvlk" podStartSLOduration=252.645811657 podStartE2EDuration="4m14.049730847s" totalImagesPullingTime="1.40391919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:07.04891845 +0000 UTC m=+254.216957183" watchObservedRunningTime="2026-06-10 20:46:07.049730847 +0000 UTC m=+254.217769577" Jun 10 20:46:08.021545 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:08.021498 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq" event={"ID":"613bd58e-71b8-46cc-a1ce-624d082f1bb7","Type":"ContainerStarted","Data":"d8883f94fe1ddebcf8fddbfdd392c15a0e8a4e53c8f6c06616ebc29f64848384"} Jun 10 20:46:08.053978 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:08.053893 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-mcsmq" podStartSLOduration=33.726781355 podStartE2EDuration="35.053870841s" totalImagesPullingTime="1.327089486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:08.053231402 +0000 UTC m=+255.221270133" watchObservedRunningTime="2026-06-10 20:46:08.053870841 +0000 UTC m=+255.221909572" Jun 10 20:46:09.026475 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:09.026427 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" event={"ID":"ad054163-9b63-4bb4-88ca-3fb640a1e913","Type":"ContainerStarted","Data":"9f19b2e36a197b2dff436cb3c2a3eab33f066ea065ea4cdc038c5ad6134972d8"} Jun 10 20:46:09.047346 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:09.047282 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-crtkl" podStartSLOduration=34.062352617 podStartE2EDuration="36.047260133s" totalImagesPullingTime="1.984907516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:09.046251053 +0000 UTC m=+256.214289783" watchObservedRunningTime="2026-06-10 20:46:09.047260133 +0000 UTC m=+256.215298863" Jun 10 20:46:11.213651 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.213582 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86bb475b97-lk8ld"] Jun 10 20:46:11.243311 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.243279 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86bb475b97-lk8ld"] Jun 10 20:46:11.243458 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.243375 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.246972 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.246945 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 20:46:11.246972 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.246945 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 20:46:11.247189 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.246998 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 20:46:11.248303 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.248274 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 20:46:11.248303 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.248278 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d7cfp\"" Jun 10 20:46:11.248483 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.248309 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 20:46:11.248483 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.248335 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 20:46:11.248483 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.248279 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 20:46:11.316383 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.316345 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-config\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.316383 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.316384 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-service-ca\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.316596 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.316461 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7nzb\" (UniqueName: \"kubernetes.io/projected/663b36b0-6159-4eb6-9a05-59bfc41b12a6-kube-api-access-z7nzb\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.316596 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.316542 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-oauth-serving-cert\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.316596 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.316569 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-serving-cert\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.316596 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.316591 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-oauth-config\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.417977 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.417936 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-serving-cert\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.417977 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.417979 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-oauth-config\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.418179 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.418044 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-config\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.418179 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.418069 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-service-ca\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.418179 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.418110 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7nzb\" (UniqueName: \"kubernetes.io/projected/663b36b0-6159-4eb6-9a05-59bfc41b12a6-kube-api-access-z7nzb\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.418179 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.418160 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-oauth-serving-cert\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.418907 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.418877 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-oauth-serving-cert\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.419076 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.418932 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-service-ca\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.419076 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.418932 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-config\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.420480 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.420459 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-oauth-config\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.420480 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.420476 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-serving-cert\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.427293 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.427273 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7nzb\" (UniqueName: \"kubernetes.io/projected/663b36b0-6159-4eb6-9a05-59bfc41b12a6-kube-api-access-z7nzb\") pod \"console-86bb475b97-lk8ld\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.553438 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.553353 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:11.700244 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:11.700218 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86bb475b97-lk8ld"] Jun 10 20:46:11.702676 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:46:11.702649 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod663b36b0_6159_4eb6_9a05_59bfc41b12a6.slice/crio-f96da77757f3d9bfe33efa5b782d993f7004bdc01564c7466bf992999e2e9053 WatchSource:0}: Error finding container f96da77757f3d9bfe33efa5b782d993f7004bdc01564c7466bf992999e2e9053: Status 404 returned error can't find the container with id f96da77757f3d9bfe33efa5b782d993f7004bdc01564c7466bf992999e2e9053 Jun 10 20:46:12.041875 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:12.041843 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bb475b97-lk8ld" event={"ID":"663b36b0-6159-4eb6-9a05-59bfc41b12a6","Type":"ContainerStarted","Data":"f96da77757f3d9bfe33efa5b782d993f7004bdc01564c7466bf992999e2e9053"} Jun 10 20:46:16.057984 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:16.057945 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bb475b97-lk8ld" event={"ID":"663b36b0-6159-4eb6-9a05-59bfc41b12a6","Type":"ContainerStarted","Data":"b6c9bc3fb7f63c5c4faf59fb3fbe0b9a1e4cdd347c39dc4e3a204700709c2be9"} Jun 10 20:46:16.080196 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:16.077307 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86bb475b97-lk8ld" podStartSLOduration=1.711489712 podStartE2EDuration="5.077286837s" totalImagesPullingTime="3.365797125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:46:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:16.076681084 +0000 UTC m=+263.244719811" watchObservedRunningTime="2026-06-10 20:46:16.077286837 +0000 UTC m=+263.245325569" Jun 10 20:46:18.220904 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.220863 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x"] Jun 10 20:46:18.223711 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.223687 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" Jun 10 20:46:18.226640 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.226573 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 10 20:46:18.226876 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.226847 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 10 20:46:18.228060 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.228040 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 20:46:18.228220 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.228100 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-g9rhm\"" Jun 10 20:46:18.231575 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.231554 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t5xds"] Jun 10 20:46:18.234652 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.234632 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.236267 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.236245 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x"] Jun 10 20:46:18.237415 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.237395 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hxgnn\"" Jun 10 20:46:18.237767 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.237750 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 20:46:18.238143 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.238122 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 20:46:18.238450 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.238433 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 20:46:18.244849 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.243405 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s"] Jun 10 20:46:18.246396 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.246375 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.250330 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.250308 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 10 20:46:18.250330 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.250321 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-m46f6\"" Jun 10 20:46:18.250879 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.250863 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 10 20:46:18.251071 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.251000 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 10 20:46:18.258371 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.258351 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s"] Jun 10 20:46:18.280691 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.280663 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqwqk\" (UniqueName: \"kubernetes.io/projected/828b2a61-2655-4337-9201-96550b142c98-kube-api-access-kqwqk\") pod \"openshift-state-metrics-65f78d5c66-8854x\" (UID: \"828b2a61-2655-4337-9201-96550b142c98\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" Jun 10 20:46:18.280857 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.280723 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/828b2a61-2655-4337-9201-96550b142c98-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-8854x\" (UID: \"828b2a61-2655-4337-9201-96550b142c98\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" Jun 10 20:46:18.280857 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.280773 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/828b2a61-2655-4337-9201-96550b142c98-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-8854x\" (UID: \"828b2a61-2655-4337-9201-96550b142c98\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" Jun 10 20:46:18.280857 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.280836 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/828b2a61-2655-4337-9201-96550b142c98-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-8854x\" (UID: \"828b2a61-2655-4337-9201-96550b142c98\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" Jun 10 20:46:18.381597 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.381564 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msgz6\" (UniqueName: \"kubernetes.io/projected/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-kube-api-access-msgz6\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.381773 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.381609 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfpg8\" (UniqueName: \"kubernetes.io/projected/1a35aa25-09af-4299-be16-538f5b62359d-kube-api-access-pfpg8\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.381773 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.381665 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.381773 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.381701 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-tls\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.381773 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.381736 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/828b2a61-2655-4337-9201-96550b142c98-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-8854x\" (UID: \"828b2a61-2655-4337-9201-96550b142c98\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" Jun 10 20:46:18.381967 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.381836 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-accelerators-collector-config\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.381967 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.381893 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.381967 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.381918 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqwqk\" (UniqueName: \"kubernetes.io/projected/828b2a61-2655-4337-9201-96550b142c98-kube-api-access-kqwqk\") pod \"openshift-state-metrics-65f78d5c66-8854x\" (UID: \"828b2a61-2655-4337-9201-96550b142c98\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" Jun 10 20:46:18.382093 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.381998 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-textfile\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.382093 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.382051 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a35aa25-09af-4299-be16-538f5b62359d-metrics-client-ca\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.382093 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.382081 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/828b2a61-2655-4337-9201-96550b142c98-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-8854x\" (UID: \"828b2a61-2655-4337-9201-96550b142c98\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" Jun 10 20:46:18.382219 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.382109 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-wtmp\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.382219 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.382204 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a35aa25-09af-4299-be16-538f5b62359d-sys\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.382319 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.382239 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.382319 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.382289 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a35aa25-09af-4299-be16-538f5b62359d-root\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.382430 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.382324 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.382430 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.382377 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.382529 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.382438 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.382529 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.382506 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/828b2a61-2655-4337-9201-96550b142c98-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-8854x\" (UID: \"828b2a61-2655-4337-9201-96550b142c98\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" Jun 10 20:46:18.382927 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.382873 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/828b2a61-2655-4337-9201-96550b142c98-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-8854x\" (UID: \"828b2a61-2655-4337-9201-96550b142c98\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" Jun 10 20:46:18.384805 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.384783 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/828b2a61-2655-4337-9201-96550b142c98-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-8854x\" (UID: \"828b2a61-2655-4337-9201-96550b142c98\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" Jun 10 20:46:18.384805 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.384790 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/828b2a61-2655-4337-9201-96550b142c98-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-8854x\" (UID: \"828b2a61-2655-4337-9201-96550b142c98\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" Jun 10 20:46:18.391441 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.391419 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqwqk\" (UniqueName: \"kubernetes.io/projected/828b2a61-2655-4337-9201-96550b142c98-kube-api-access-kqwqk\") pod \"openshift-state-metrics-65f78d5c66-8854x\" (UID: \"828b2a61-2655-4337-9201-96550b142c98\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" Jun 10 20:46:18.483358 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483258 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.483358 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483311 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-textfile\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.483358 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483336 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a35aa25-09af-4299-be16-538f5b62359d-metrics-client-ca\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.483358 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483359 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-wtmp\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.483692 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483374 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a35aa25-09af-4299-be16-538f5b62359d-sys\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.483692 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483392 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.483692 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483419 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a35aa25-09af-4299-be16-538f5b62359d-root\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.483692 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483442 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.483692 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483473 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.483692 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483482 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a35aa25-09af-4299-be16-538f5b62359d-sys\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.483692 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483499 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.483692 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483520 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msgz6\" (UniqueName: \"kubernetes.io/projected/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-kube-api-access-msgz6\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.483692 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483551 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfpg8\" (UniqueName: \"kubernetes.io/projected/1a35aa25-09af-4299-be16-538f5b62359d-kube-api-access-pfpg8\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.483692 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483579 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-wtmp\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.483692 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483602 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.483692 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483635 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-tls\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.483692 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483686 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-accelerators-collector-config\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.484318 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.483791 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-textfile\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.484318 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.484105 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a35aa25-09af-4299-be16-538f5b62359d-metrics-client-ca\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.484318 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.484153 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.484318 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.484181 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.484318 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.484214 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a35aa25-09af-4299-be16-538f5b62359d-root\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.484318 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:46:18.484263 2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 20:46:18.484600 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.484260 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-accelerators-collector-config\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.484600 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:46:18.484325 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-tls podName:1a35aa25-09af-4299-be16-538f5b62359d nodeName:}" failed. No retries permitted until 2026-06-10 20:46:18.984308979 +0000 UTC m=+266.152347697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-tls") pod "node-exporter-t5xds" (UID: "1a35aa25-09af-4299-be16-538f5b62359d") : secret "node-exporter-tls" not found Jun 10 20:46:18.484600 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.484525 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.486515 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.486489 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.486670 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.486646 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.486724 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.486692 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.494044 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.494001 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfpg8\" (UniqueName: \"kubernetes.io/projected/1a35aa25-09af-4299-be16-538f5b62359d-kube-api-access-pfpg8\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.494367 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.494346 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msgz6\" (UniqueName: \"kubernetes.io/projected/67e51b72-61a4-4c2a-a58c-8a34f7470ee9-kube-api-access-msgz6\") pod \"kube-state-metrics-57bbf8bfb5-sx86s\" (UID: \"67e51b72-61a4-4c2a-a58c-8a34f7470ee9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.535300 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.535263 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" Jun 10 20:46:18.558640 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.557917 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" Jun 10 20:46:18.683574 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.683546 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x"] Jun 10 20:46:18.686342 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:46:18.686310 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod828b2a61_2655_4337_9201_96550b142c98.slice/crio-b84d7b50add04a516aab735ba314950756a4a44a30bc26816abcb1887683d1c3 WatchSource:0}: Error finding container b84d7b50add04a516aab735ba314950756a4a44a30bc26816abcb1887683d1c3: Status 404 returned error can't find the container with id b84d7b50add04a516aab735ba314950756a4a44a30bc26816abcb1887683d1c3 Jun 10 20:46:18.702226 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.702203 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s"] Jun 10 20:46:18.703929 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:46:18.703907 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67e51b72_61a4_4c2a_a58c_8a34f7470ee9.slice/crio-6e1dfe8f2367a5fae3079daf6ef30ced312a629f4d1d3561d55645a9021439e5 WatchSource:0}: Error finding container 6e1dfe8f2367a5fae3079daf6ef30ced312a629f4d1d3561d55645a9021439e5: Status 404 returned error can't find the container with id 6e1dfe8f2367a5fae3079daf6ef30ced312a629f4d1d3561d55645a9021439e5 Jun 10 20:46:18.989351 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.989259 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-tls\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:18.991701 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:18.991673 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a35aa25-09af-4299-be16-538f5b62359d-node-exporter-tls\") pod \"node-exporter-t5xds\" (UID: \"1a35aa25-09af-4299-be16-538f5b62359d\") " pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:19.070153 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.070116 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" event={"ID":"828b2a61-2655-4337-9201-96550b142c98","Type":"ContainerStarted","Data":"0117e4a8d05fcdec97908957fd6d5f06a6a8f1a1457011abdd7ebfa44e2dd14c"} Jun 10 20:46:19.070319 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.070182 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" event={"ID":"828b2a61-2655-4337-9201-96550b142c98","Type":"ContainerStarted","Data":"7f28f8fba9e4d7ca129443c326e1c55365535784ed4ca9d71dedbc55f5e561bf"} Jun 10 20:46:19.070319 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.070211 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" event={"ID":"828b2a61-2655-4337-9201-96550b142c98","Type":"ContainerStarted","Data":"b84d7b50add04a516aab735ba314950756a4a44a30bc26816abcb1887683d1c3"} Jun 10 20:46:19.071215 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.071191 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" event={"ID":"67e51b72-61a4-4c2a-a58c-8a34f7470ee9","Type":"ContainerStarted","Data":"6e1dfe8f2367a5fae3079daf6ef30ced312a629f4d1d3561d55645a9021439e5"} Jun 10 20:46:19.147263 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.147227 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t5xds" Jun 10 20:46:19.157034 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:46:19.156984 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a35aa25_09af_4299_be16_538f5b62359d.slice/crio-f3ff2be750c296256e7a659673652fae4d54e9f1463c411eaea076d7e54fe841 WatchSource:0}: Error finding container f3ff2be750c296256e7a659673652fae4d54e9f1463c411eaea076d7e54fe841: Status 404 returned error can't find the container with id f3ff2be750c296256e7a659673652fae4d54e9f1463c411eaea076d7e54fe841 Jun 10 20:46:19.292241 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.292139 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:46:19.295518 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.295490 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.298735 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.298570 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 20:46:19.298735 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.298596 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 20:46:19.298961 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.298949 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 20:46:19.299064 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.298966 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 20:46:19.299064 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.299031 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 20:46:19.299064 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.299054 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 20:46:19.299212 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.298952 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 20:46:19.299462 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.299433 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ncj5r\"" Jun 10 20:46:19.299559 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.299510 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 20:46:19.300197 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.300051 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 20:46:19.315424 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.315386 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:46:19.392789 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.392728 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90569a93-b177-4715-9bad-c5bcafe496bd-config-out\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.392789 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.392777 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.393044 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.392798 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqwvk\" (UniqueName: \"kubernetes.io/projected/90569a93-b177-4715-9bad-c5bcafe496bd-kube-api-access-tqwvk\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.393044 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.392948 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90569a93-b177-4715-9bad-c5bcafe496bd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.393044 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.392989 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.393203 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.393057 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-config-volume\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.393203 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.393088 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90569a93-b177-4715-9bad-c5bcafe496bd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.393203 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.393139 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90569a93-b177-4715-9bad-c5bcafe496bd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.393357 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.393198 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.393357 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.393223 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.393357 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.393281 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-web-config\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.393357 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.393306 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90569a93-b177-4715-9bad-c5bcafe496bd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.393550 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.393371 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.494955 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.493898 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-config-volume\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.494955 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.493954 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90569a93-b177-4715-9bad-c5bcafe496bd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.494955 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.493993 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90569a93-b177-4715-9bad-c5bcafe496bd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.494955 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.494070 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.494955 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.494098 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.494955 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.494144 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-web-config\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.494955 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.494176 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90569a93-b177-4715-9bad-c5bcafe496bd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.494955 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.494215 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.494955 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.494256 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90569a93-b177-4715-9bad-c5bcafe496bd-config-out\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.494955 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.494280 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.494955 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.494305 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqwvk\" (UniqueName: \"kubernetes.io/projected/90569a93-b177-4715-9bad-c5bcafe496bd-kube-api-access-tqwvk\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.494955 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.494348 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90569a93-b177-4715-9bad-c5bcafe496bd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.494955 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:46:19.494363 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90569a93-b177-4715-9bad-c5bcafe496bd-alertmanager-trusted-ca-bundle podName:90569a93-b177-4715-9bad-c5bcafe496bd nodeName:}" failed. No retries permitted until 2026-06-10 20:46:19.994343002 +0000 UTC m=+267.162381732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/90569a93-b177-4715-9bad-c5bcafe496bd-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "90569a93-b177-4715-9bad-c5bcafe496bd") : configmap references non-existent config key: ca-bundle.crt Jun 10 20:46:19.494955 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.494402 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.494955 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:46:19.494609 2554 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 10 20:46:19.494955 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:46:19.494654 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-main-tls podName:90569a93-b177-4715-9bad-c5bcafe496bd nodeName:}" failed. No retries permitted until 2026-06-10 20:46:19.994639659 +0000 UTC m=+267.162678377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "90569a93-b177-4715-9bad-c5bcafe496bd") : secret "alertmanager-main-tls" not found Jun 10 20:46:19.497071 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.496457 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90569a93-b177-4715-9bad-c5bcafe496bd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.497071 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.497030 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90569a93-b177-4715-9bad-c5bcafe496bd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.499752 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.499723 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-web-config\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.500426 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.500398 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.500649 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.500624 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-config-volume\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.501169 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.501130 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90569a93-b177-4715-9bad-c5bcafe496bd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.501781 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.501740 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.502249 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.502222 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.502338 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.502297 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.503742 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.503712 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90569a93-b177-4715-9bad-c5bcafe496bd-config-out\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:19.507642 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:19.507620 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqwvk\" (UniqueName: \"kubernetes.io/projected/90569a93-b177-4715-9bad-c5bcafe496bd-kube-api-access-tqwvk\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:20.000105 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.000069 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:20.000294 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.000131 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90569a93-b177-4715-9bad-c5bcafe496bd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:20.000294 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:46:20.000258 2554 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 10 20:46:20.000400 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:46:20.000346 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-main-tls podName:90569a93-b177-4715-9bad-c5bcafe496bd nodeName:}" failed. No retries permitted until 2026-06-10 20:46:21.000325158 +0000 UTC m=+268.168363892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "90569a93-b177-4715-9bad-c5bcafe496bd") : secret "alertmanager-main-tls" not found Jun 10 20:46:20.000974 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.000952 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90569a93-b177-4715-9bad-c5bcafe496bd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:20.076559 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.076518 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5xds" event={"ID":"1a35aa25-09af-4299-be16-538f5b62359d","Type":"ContainerStarted","Data":"f3ff2be750c296256e7a659673652fae4d54e9f1463c411eaea076d7e54fe841"} Jun 10 20:46:20.220285 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.220247 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-cd6886545-lf48h"] Jun 10 20:46:20.223710 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.223677 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.226744 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.226718 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 10 20:46:20.226744 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.226734 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 10 20:46:20.226975 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.226881 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9ajbbq8nmkfs9\"" Jun 10 20:46:20.227081 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.227060 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 10 20:46:20.228239 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.228223 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 10 20:46:20.228333 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.228224 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 10 20:46:20.228333 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.228226 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7tgwx\"" Jun 10 20:46:20.234161 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.234139 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cd6886545-lf48h"] Jun 10 20:46:20.303061 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.302956 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.303061 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.303000 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.303061 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.303057 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdfc548f-21a6-430a-8571-a4a385ee71b2-metrics-client-ca\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.303640 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.303118 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvplk\" (UniqueName: \"kubernetes.io/projected/cdfc548f-21a6-430a-8571-a4a385ee71b2-kube-api-access-gvplk\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.303640 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.303168 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.303640 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.303220 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-grpc-tls\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.303640 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.303264 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.303640 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.303301 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-thanos-querier-tls\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.404719 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.404679 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.404906 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.404744 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-thanos-querier-tls\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.404906 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.404810 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.404906 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.404838 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.404906 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.404866 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdfc548f-21a6-430a-8571-a4a385ee71b2-metrics-client-ca\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.405146 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.404910 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvplk\" (UniqueName: \"kubernetes.io/projected/cdfc548f-21a6-430a-8571-a4a385ee71b2-kube-api-access-gvplk\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.405146 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.404954 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.405146 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.405060 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-grpc-tls\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.405849 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.405819 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdfc548f-21a6-430a-8571-a4a385ee71b2-metrics-client-ca\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.408076 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.408054 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.408215 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.408190 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-thanos-querier-tls\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.408516 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.408488 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-grpc-tls\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.408613 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.408553 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.408676 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.408626 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.408958 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.408934 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cdfc548f-21a6-430a-8571-a4a385ee71b2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.414611 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.414576 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvplk\" (UniqueName: \"kubernetes.io/projected/cdfc548f-21a6-430a-8571-a4a385ee71b2-kube-api-access-gvplk\") pod \"thanos-querier-cd6886545-lf48h\" (UID: \"cdfc548f-21a6-430a-8571-a4a385ee71b2\") " pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.534762 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.534733 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:20.707336 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:20.707255 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cd6886545-lf48h"] Jun 10 20:46:20.779080 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:46:20.779048 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdfc548f_21a6_430a_8571_a4a385ee71b2.slice/crio-e85e57bad0824794b9d92a5b48a2b5b687253b91fcd8ec9d3ac42ed4e566c142 WatchSource:0}: Error finding container e85e57bad0824794b9d92a5b48a2b5b687253b91fcd8ec9d3ac42ed4e566c142: Status 404 returned error can't find the container with id e85e57bad0824794b9d92a5b48a2b5b687253b91fcd8ec9d3ac42ed4e566c142 Jun 10 20:46:21.010005 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:21.009969 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:21.012335 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:21.012308 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:21.083032 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:21.082967 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" event={"ID":"67e51b72-61a4-4c2a-a58c-8a34f7470ee9","Type":"ContainerStarted","Data":"65e10b4971c6297d806a4613f8f86ad505760fc61c776ee5ff7df145a42de0f0"} Jun 10 20:46:21.083229 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:21.083060 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" event={"ID":"67e51b72-61a4-4c2a-a58c-8a34f7470ee9","Type":"ContainerStarted","Data":"b69784fd431fff44cec6fc8c011ba398db3a3e28f4631f813dc86a5d4fb25111"} Jun 10 20:46:21.083229 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:21.083091 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" event={"ID":"67e51b72-61a4-4c2a-a58c-8a34f7470ee9","Type":"ContainerStarted","Data":"fb4c368a19a3485eec2b50013556d490995de4a4ea5e21b46ce240447245ae5a"} Jun 10 20:46:21.084739 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:21.084704 2554 generic.go:356] "Generic (PLEG): container finished" podID="1a35aa25-09af-4299-be16-538f5b62359d" containerID="0008f9d2d0a49e766f999c8a619e23f9eef804550b58098ebc38504f067d8af1" exitCode=0 Jun 10 20:46:21.084870 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:21.084794 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5xds" event={"ID":"1a35aa25-09af-4299-be16-538f5b62359d","Type":"ContainerDied","Data":"0008f9d2d0a49e766f999c8a619e23f9eef804550b58098ebc38504f067d8af1"} Jun 10 20:46:21.086156 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:21.086131 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" event={"ID":"cdfc548f-21a6-430a-8571-a4a385ee71b2","Type":"ContainerStarted","Data":"e85e57bad0824794b9d92a5b48a2b5b687253b91fcd8ec9d3ac42ed4e566c142"} Jun 10 20:46:21.088886 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:21.088859 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" event={"ID":"828b2a61-2655-4337-9201-96550b142c98","Type":"ContainerStarted","Data":"fe31996839275dd86b608e1b556a3c664819a27c0838ac0b432b2adfb0053b05"} Jun 10 20:46:21.106922 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:21.106862 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sx86s" podStartSLOduration=1.301290912 podStartE2EDuration="3.106845254s" totalImagesPullingTime="1.805554342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:21.106255599 +0000 UTC m=+268.274294327" watchObservedRunningTime="2026-06-10 20:46:21.106845254 +0000 UTC m=+268.274883983" Jun 10 20:46:21.112890 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:21.112865 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:46:21.157841 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:21.157093 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8854x" podStartSLOduration=1.452069562 podStartE2EDuration="3.157069013s" totalImagesPullingTime="1.704999451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:21.154527908 +0000 UTC m=+268.322566638" watchObservedRunningTime="2026-06-10 20:46:21.157069013 +0000 UTC m=+268.325107744" Jun 10 20:46:21.285583 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:21.285551 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:46:21.553676 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:21.553579 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:21.553676 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:21.553640 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:21.554967 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:21.554942 2554 patch_prober.go:28] interesting pod/console-86bb475b97-lk8ld container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body= Jun 10 20:46:21.555047 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:21.554986 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86bb475b97-lk8ld" podUID="663b36b0-6159-4eb6-9a05-59bfc41b12a6" containerName="console" probeResult="failure" output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" Jun 10 20:46:22.095172 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:22.095128 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90569a93-b177-4715-9bad-c5bcafe496bd","Type":"ContainerStarted","Data":"916e4c9553b90ad0aeabeb0a5a3b9308423032b5f0ae86750f3071854ab3250b"} Jun 10 20:46:22.097887 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:22.097809 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5xds" event={"ID":"1a35aa25-09af-4299-be16-538f5b62359d","Type":"ContainerStarted","Data":"080056c8f9e3f098b63cd77f216ee8aed28312b2d69361222e74c2c206d53680"} Jun 10 20:46:22.097887 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:22.097865 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t5xds" event={"ID":"1a35aa25-09af-4299-be16-538f5b62359d","Type":"ContainerStarted","Data":"79315266032d6f22e51ea8356caffb7abcb9c68ee306fb07961bcbfb57403c71"} Jun 10 20:46:22.123257 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:22.123203 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t5xds" podStartSLOduration=2.669517182 podStartE2EDuration="4.123187034s" totalImagesPullingTime="1.355570699s" totalInitContainerRuntime="98.099153ms" isStatefulPod=true podCreationTimestamp="2026-06-10 20:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:22.121245046 +0000 UTC m=+269.289283803" watchObservedRunningTime="2026-06-10 20:46:22.123187034 +0000 UTC m=+269.291225762" Jun 10 20:46:23.029173 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:23.029086 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86bb475b97-lk8ld"] Jun 10 20:46:23.104227 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:23.104187 2554 generic.go:356] "Generic (PLEG): container finished" podID="90569a93-b177-4715-9bad-c5bcafe496bd" containerID="75c71b2bb9c3725bbc1cb5be9238d6c2e61fc9dbf01fb01c6e26fed4d1911f08" exitCode=0 Jun 10 20:46:23.104422 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:23.104273 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90569a93-b177-4715-9bad-c5bcafe496bd","Type":"ContainerDied","Data":"75c71b2bb9c3725bbc1cb5be9238d6c2e61fc9dbf01fb01c6e26fed4d1911f08"} Jun 10 20:46:24.112566 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:24.112516 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" event={"ID":"cdfc548f-21a6-430a-8571-a4a385ee71b2","Type":"ContainerStarted","Data":"785bd1644b230abdce54b51cda0b576637814a83132fe9e9478f9dae2952c62a"} Jun 10 20:46:24.113061 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:24.112640 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" event={"ID":"cdfc548f-21a6-430a-8571-a4a385ee71b2","Type":"ContainerStarted","Data":"c661f0deb634a083cf1b0ced7f6dcf986bd004134798fb02fe9f0c21dc43f535"} Jun 10 20:46:24.113061 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:24.112683 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" event={"ID":"cdfc548f-21a6-430a-8571-a4a385ee71b2","Type":"ContainerStarted","Data":"ec94b2775cc7bdea83e955f676a1d782338f9bfd05a627f84e424f374d7f3728"} Jun 10 20:46:26.124597 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:26.124556 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90569a93-b177-4715-9bad-c5bcafe496bd","Type":"ContainerStarted","Data":"5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9"} Jun 10 20:46:26.125077 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:26.124626 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90569a93-b177-4715-9bad-c5bcafe496bd","Type":"ContainerStarted","Data":"827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1"} Jun 10 20:46:26.125077 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:26.124653 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90569a93-b177-4715-9bad-c5bcafe496bd","Type":"ContainerStarted","Data":"a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed"} Jun 10 20:46:26.125077 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:26.124686 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90569a93-b177-4715-9bad-c5bcafe496bd","Type":"ContainerStarted","Data":"30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e"} Jun 10 20:46:26.125077 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:26.124710 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90569a93-b177-4715-9bad-c5bcafe496bd","Type":"ContainerStarted","Data":"ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47"} Jun 10 20:46:26.125077 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:26.124741 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90569a93-b177-4715-9bad-c5bcafe496bd","Type":"ContainerStarted","Data":"ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95"} Jun 10 20:46:26.127297 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:26.127271 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" event={"ID":"cdfc548f-21a6-430a-8571-a4a385ee71b2","Type":"ContainerStarted","Data":"f68c85fce3ca6094fcb073f4e95145fff75a840704855918712615645af47881"} Jun 10 20:46:26.127400 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:26.127336 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" event={"ID":"cdfc548f-21a6-430a-8571-a4a385ee71b2","Type":"ContainerStarted","Data":"c419bde3566200853b2a62918584e989e47259f63223130e9ba748fe2c00ea42"} Jun 10 20:46:26.127400 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:26.127375 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" event={"ID":"cdfc548f-21a6-430a-8571-a4a385ee71b2","Type":"ContainerStarted","Data":"3238a07c69dde4cca3fc1731047dbf9402d81bf2a802e2384292d6bbfe8aec3a"} Jun 10 20:46:26.127470 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:26.127436 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:26.155229 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:26.155175 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.583130896 podStartE2EDuration="7.155127899s" totalImagesPullingTime="3.555782555s" totalInitContainerRuntime="16.214448ms" isStatefulPod=false podCreationTimestamp="2026-06-10 20:46:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:26.153161099 +0000 UTC m=+273.321199827" watchObservedRunningTime="2026-06-10 20:46:26.155127899 +0000 UTC m=+273.323166629" Jun 10 20:46:26.179678 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:26.179613 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" podStartSLOduration=1.960241634 podStartE2EDuration="6.179593511s" totalImagesPullingTime="4.219351877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:46:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:26.17844539 +0000 UTC m=+273.346484120" watchObservedRunningTime="2026-06-10 20:46:26.179593511 +0000 UTC m=+273.347632266" Jun 10 20:46:28.026400 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.026361 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69bdbf68bc-8nzc9"] Jun 10 20:46:28.029935 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.029917 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.039135 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.039110 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 20:46:28.040740 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.040717 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69bdbf68bc-8nzc9"] Jun 10 20:46:28.184938 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.184887 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-service-ca\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.185188 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.184987 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-trusted-ca-bundle\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.185188 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.185079 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-oauth-serving-cert\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.185188 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.185108 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9db2f61-e800-4ed1-97ad-14c098dff051-console-serving-cert\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.185188 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.185138 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9db2f61-e800-4ed1-97ad-14c098dff051-console-oauth-config\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.185326 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.185183 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm6bz\" (UniqueName: \"kubernetes.io/projected/e9db2f61-e800-4ed1-97ad-14c098dff051-kube-api-access-nm6bz\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.185326 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.185230 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-console-config\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.286760 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.286665 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9db2f61-e800-4ed1-97ad-14c098dff051-console-oauth-config\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.286760 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.286706 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm6bz\" (UniqueName: \"kubernetes.io/projected/e9db2f61-e800-4ed1-97ad-14c098dff051-kube-api-access-nm6bz\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.286760 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.286724 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-console-config\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.287070 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.286826 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-service-ca\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.287070 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.286881 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-trusted-ca-bundle\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.287070 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.287052 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-oauth-serving-cert\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.287219 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.287095 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9db2f61-e800-4ed1-97ad-14c098dff051-console-serving-cert\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.287602 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.287577 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-console-config\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.287704 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.287577 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-service-ca\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.287770 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.287741 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-oauth-serving-cert\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.287831 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.287812 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-trusted-ca-bundle\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.289276 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.289250 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9db2f61-e800-4ed1-97ad-14c098dff051-console-oauth-config\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.289477 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.289460 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9db2f61-e800-4ed1-97ad-14c098dff051-console-serving-cert\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.295756 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.295735 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm6bz\" (UniqueName: \"kubernetes.io/projected/e9db2f61-e800-4ed1-97ad-14c098dff051-kube-api-access-nm6bz\") pod \"console-69bdbf68bc-8nzc9\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.341670 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.341639 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:28.475253 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:28.475224 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69bdbf68bc-8nzc9"] Jun 10 20:46:28.477963 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:46:28.477928 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9db2f61_e800_4ed1_97ad_14c098dff051.slice/crio-2507a86e7e8aa682f820938438fa7e67a4396fb63ed56e1e618b4c69c53c66ec WatchSource:0}: Error finding container 2507a86e7e8aa682f820938438fa7e67a4396fb63ed56e1e618b4c69c53c66ec: Status 404 returned error can't find the container with id 2507a86e7e8aa682f820938438fa7e67a4396fb63ed56e1e618b4c69c53c66ec Jun 10 20:46:29.140480 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:29.140447 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69bdbf68bc-8nzc9" event={"ID":"e9db2f61-e800-4ed1-97ad-14c098dff051","Type":"ContainerStarted","Data":"c8b38f1ec479cfd8947ae0150482f8b0598ceb7e5be3295549aec95c6bf6528f"} Jun 10 20:46:29.140874 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:29.140498 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69bdbf68bc-8nzc9" event={"ID":"e9db2f61-e800-4ed1-97ad-14c098dff051","Type":"ContainerStarted","Data":"2507a86e7e8aa682f820938438fa7e67a4396fb63ed56e1e618b4c69c53c66ec"} Jun 10 20:46:29.162615 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:29.162563 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69bdbf68bc-8nzc9" podStartSLOduration=1.16254597 podStartE2EDuration="1.16254597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:46:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:29.160148096 +0000 UTC m=+276.328186824" watchObservedRunningTime="2026-06-10 20:46:29.16254597 +0000 UTC m=+276.330584699" Jun 10 20:46:32.136857 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:32.136828 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-cd6886545-lf48h" Jun 10 20:46:34.715160 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:46:34.715103 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" podUID="49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" Jun 10 20:46:34.715160 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:46:34.715103 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-t6qck" podUID="9964f961-20d9-4e7f-b456-76023883f432" Jun 10 20:46:35.166793 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:35.166713 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:46:35.166943 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:35.166713 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t6qck" Jun 10 20:46:38.280306 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:38.280256 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:46:38.280711 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:38.280335 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:46:38.282633 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:38.282605 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9964f961-20d9-4e7f-b456-76023883f432-metrics-tls\") pod \"dns-default-t6qck\" (UID: \"9964f961-20d9-4e7f-b456-76023883f432\") " pod="openshift-dns/dns-default-t6qck" Jun 10 20:46:38.282805 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:38.282788 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls\") pod \"image-registry-7b454d5d46-h8m5g\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:46:38.342472 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:38.342435 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:38.342661 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:38.342492 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:38.343957 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:38.343924 2554 patch_prober.go:28] interesting pod/console-69bdbf68bc-8nzc9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 10 20:46:38.344097 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:38.343967 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-69bdbf68bc-8nzc9" podUID="e9db2f61-e800-4ed1-97ad-14c098dff051" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 10 20:46:38.470448 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:38.470417 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqr9w\"" Jun 10 20:46:38.471877 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:38.471857 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-754v9\"" Jun 10 20:46:38.478166 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:38.478149 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:46:38.478222 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:38.478164 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t6qck" Jun 10 20:46:38.650549 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:38.650518 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t6qck"] Jun 10 20:46:38.652758 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:46:38.652722 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9964f961_20d9_4e7f_b456_76023883f432.slice/crio-473c2cd407c386fa2db83354435743693e05174bb9b1a516ceed50f9e67276d0 WatchSource:0}: Error finding container 473c2cd407c386fa2db83354435743693e05174bb9b1a516ceed50f9e67276d0: Status 404 returned error can't find the container with id 473c2cd407c386fa2db83354435743693e05174bb9b1a516ceed50f9e67276d0 Jun 10 20:46:38.677574 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:38.677545 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b454d5d46-h8m5g"] Jun 10 20:46:38.680587 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:46:38.680561 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49d8d16e_b992_4c11_b1f1_daf9ec7c3f41.slice/crio-3fd3e4960eea333ce535b0f4ae2f09f65b0875356c0c70dcbe07a97e0859a343 WatchSource:0}: Error finding container 3fd3e4960eea333ce535b0f4ae2f09f65b0875356c0c70dcbe07a97e0859a343: Status 404 returned error can't find the container with id 3fd3e4960eea333ce535b0f4ae2f09f65b0875356c0c70dcbe07a97e0859a343 Jun 10 20:46:39.185082 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:39.185041 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t6qck" event={"ID":"9964f961-20d9-4e7f-b456-76023883f432","Type":"ContainerStarted","Data":"473c2cd407c386fa2db83354435743693e05174bb9b1a516ceed50f9e67276d0"} Jun 10 20:46:39.186883 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:39.186846 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" event={"ID":"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41","Type":"ContainerStarted","Data":"66c1d326b734ba7b4e2a4c225b2c6c68fac6ad941df5ffedc646da3f54717364"} Jun 10 20:46:39.187047 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:39.186894 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" event={"ID":"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41","Type":"ContainerStarted","Data":"3fd3e4960eea333ce535b0f4ae2f09f65b0875356c0c70dcbe07a97e0859a343"} Jun 10 20:46:39.187047 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:39.187035 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:46:39.210436 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:39.210366 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" podStartSLOduration=286.210346294 podStartE2EDuration="4m46.210346294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:41:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:39.20994345 +0000 UTC m=+286.377982181" watchObservedRunningTime="2026-06-10 20:46:39.210346294 +0000 UTC m=+286.378385022" Jun 10 20:46:41.197359 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:41.197319 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t6qck" event={"ID":"9964f961-20d9-4e7f-b456-76023883f432","Type":"ContainerStarted","Data":"7575d16bc6ecd3a7183600201e42dd4976a439786fadbf82859bd22045b4e128"} Jun 10 20:46:41.197830 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:41.197494 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t6qck" Jun 10 20:46:41.197830 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:41.197518 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t6qck" event={"ID":"9964f961-20d9-4e7f-b456-76023883f432","Type":"ContainerStarted","Data":"a8649094d2aea7961305ba9bb18067c3c0b982e57b6f172b3a6a9cedd04a8b66"} Jun 10 20:46:41.217345 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:41.217289 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-t6qck" podStartSLOduration=251.187040553 podStartE2EDuration="4m13.217274158s" totalImagesPullingTime="2.030233605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:41.216432233 +0000 UTC m=+288.384470962" watchObservedRunningTime="2026-06-10 20:46:41.217274158 +0000 UTC m=+288.385312887" Jun 10 20:46:43.206716 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:43.206681 2554 generic.go:356] "Generic (PLEG): container finished" podID="87fb2abe-9f87-4b54-8dee-185d03cb44df" containerID="71bf023aeee6168456d37d5055ee2c9ee6583bcb31f525a7ca20514a22977ceb" exitCode=0 Jun 10 20:46:43.207144 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:43.206747 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-8g77m" event={"ID":"87fb2abe-9f87-4b54-8dee-185d03cb44df","Type":"ContainerDied","Data":"71bf023aeee6168456d37d5055ee2c9ee6583bcb31f525a7ca20514a22977ceb"} Jun 10 20:46:43.207201 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:43.207144 2554 scope.go:117] "RemoveContainer" containerID="71bf023aeee6168456d37d5055ee2c9ee6583bcb31f525a7ca20514a22977ceb" Jun 10 20:46:43.208510 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:43.208456 2554 generic.go:356] "Generic (PLEG): container finished" podID="58bb00d7-2d5c-4874-9325-2064a631a4cd" containerID="a6b996d5aec4dad559aeb0db8c44d5f119c76ca965c4f8e9dfc9cea1b1489e1b" exitCode=0 Jun 10 20:46:43.208510 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:43.208493 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn" event={"ID":"58bb00d7-2d5c-4874-9325-2064a631a4cd","Type":"ContainerDied","Data":"a6b996d5aec4dad559aeb0db8c44d5f119c76ca965c4f8e9dfc9cea1b1489e1b"} Jun 10 20:46:43.208778 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:43.208763 2554 scope.go:117] "RemoveContainer" containerID="a6b996d5aec4dad559aeb0db8c44d5f119c76ca965c4f8e9dfc9cea1b1489e1b" Jun 10 20:46:44.214582 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:44.214545 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gpxxn" event={"ID":"58bb00d7-2d5c-4874-9325-2064a631a4cd","Type":"ContainerStarted","Data":"b387b2e31915c2239951593547f6ae116f09a4ad027a0d6adfd2ae221bd79671"} Jun 10 20:46:44.216344 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:44.216321 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-8g77m" event={"ID":"87fb2abe-9f87-4b54-8dee-185d03cb44df","Type":"ContainerStarted","Data":"68a4303e2b0d107aaeb1a88180f3510dae352c1c2b80faefc2467a18b02cf29e"} Jun 10 20:46:48.059612 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:48.059548 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-86bb475b97-lk8ld" podUID="663b36b0-6159-4eb6-9a05-59bfc41b12a6" containerName="console" containerID="cri-o://b6c9bc3fb7f63c5c4faf59fb3fbe0b9a1e4cdd347c39dc4e3a204700709c2be9" gracePeriod=15 Jun 10 20:46:48.342615 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:48.342529 2554 patch_prober.go:28] interesting pod/console-69bdbf68bc-8nzc9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 10 20:46:48.342615 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:48.342587 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-69bdbf68bc-8nzc9" podUID="e9db2f61-e800-4ed1-97ad-14c098dff051" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 10 20:46:51.203978 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:51.203947 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t6qck" Jun 10 20:46:53.200653 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:53.200626 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 20:46:53.201124 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:53.200847 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 20:46:53.207420 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:53.207396 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 20:46:53.207420 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:53.207419 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 20:46:53.212353 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:53.212332 2554 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 20:46:55.514279 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.514248 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:55.634442 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.634342 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-oauth-config\") pod \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " Jun 10 20:46:55.634442 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.634394 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7nzb\" (UniqueName: \"kubernetes.io/projected/663b36b0-6159-4eb6-9a05-59bfc41b12a6-kube-api-access-z7nzb\") pod \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " Jun 10 20:46:55.634442 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.634428 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-service-ca\") pod \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " Jun 10 20:46:55.634679 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.634448 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-config\") pod \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " Jun 10 20:46:55.634679 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.634477 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-oauth-serving-cert\") pod \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " Jun 10 20:46:55.634679 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.634544 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-serving-cert\") pod \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\" (UID: \"663b36b0-6159-4eb6-9a05-59bfc41b12a6\") " Jun 10 20:46:55.634922 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.634893 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-config" (OuterVolumeSpecName: "console-config") pod "663b36b0-6159-4eb6-9a05-59bfc41b12a6" (UID: "663b36b0-6159-4eb6-9a05-59bfc41b12a6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:46:55.634922 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.634908 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-service-ca" (OuterVolumeSpecName: "service-ca") pod "663b36b0-6159-4eb6-9a05-59bfc41b12a6" (UID: "663b36b0-6159-4eb6-9a05-59bfc41b12a6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:46:55.635110 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.634917 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "663b36b0-6159-4eb6-9a05-59bfc41b12a6" (UID: "663b36b0-6159-4eb6-9a05-59bfc41b12a6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:46:55.636883 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.636855 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "663b36b0-6159-4eb6-9a05-59bfc41b12a6" (UID: "663b36b0-6159-4eb6-9a05-59bfc41b12a6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:46:55.636883 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.636875 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/663b36b0-6159-4eb6-9a05-59bfc41b12a6-kube-api-access-z7nzb" (OuterVolumeSpecName: "kube-api-access-z7nzb") pod "663b36b0-6159-4eb6-9a05-59bfc41b12a6" (UID: "663b36b0-6159-4eb6-9a05-59bfc41b12a6"). InnerVolumeSpecName "kube-api-access-z7nzb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:46:55.637054 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.636890 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "663b36b0-6159-4eb6-9a05-59bfc41b12a6" (UID: "663b36b0-6159-4eb6-9a05-59bfc41b12a6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:46:55.735363 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.735320 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-serving-cert\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:46:55.735363 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.735352 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-oauth-config\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:46:55.735363 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.735361 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7nzb\" (UniqueName: \"kubernetes.io/projected/663b36b0-6159-4eb6-9a05-59bfc41b12a6-kube-api-access-z7nzb\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:46:55.735600 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.735371 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-service-ca\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:46:55.735600 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.735390 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-console-config\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:46:55.735600 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:55.735399 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/663b36b0-6159-4eb6-9a05-59bfc41b12a6-oauth-serving-cert\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:46:56.271976 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:56.271933 2554 generic.go:356] "Generic (PLEG): container finished" podID="663b36b0-6159-4eb6-9a05-59bfc41b12a6" containerID="b6c9bc3fb7f63c5c4faf59fb3fbe0b9a1e4cdd347c39dc4e3a204700709c2be9" exitCode=0 Jun 10 20:46:56.272184 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:56.271999 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bb475b97-lk8ld" Jun 10 20:46:56.272184 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:56.271999 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bb475b97-lk8ld" event={"ID":"663b36b0-6159-4eb6-9a05-59bfc41b12a6","Type":"ContainerDied","Data":"b6c9bc3fb7f63c5c4faf59fb3fbe0b9a1e4cdd347c39dc4e3a204700709c2be9"} Jun 10 20:46:56.272184 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:56.272076 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bb475b97-lk8ld" event={"ID":"663b36b0-6159-4eb6-9a05-59bfc41b12a6","Type":"ContainerDied","Data":"f96da77757f3d9bfe33efa5b782d993f7004bdc01564c7466bf992999e2e9053"} Jun 10 20:46:56.272184 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:56.272107 2554 scope.go:117] "RemoveContainer" containerID="b6c9bc3fb7f63c5c4faf59fb3fbe0b9a1e4cdd347c39dc4e3a204700709c2be9" Jun 10 20:46:56.281205 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:56.281185 2554 scope.go:117] "RemoveContainer" containerID="b6c9bc3fb7f63c5c4faf59fb3fbe0b9a1e4cdd347c39dc4e3a204700709c2be9" Jun 10 20:46:56.281514 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:46:56.281481 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6c9bc3fb7f63c5c4faf59fb3fbe0b9a1e4cdd347c39dc4e3a204700709c2be9\": container with ID starting with b6c9bc3fb7f63c5c4faf59fb3fbe0b9a1e4cdd347c39dc4e3a204700709c2be9 not found: ID does not exist" containerID="b6c9bc3fb7f63c5c4faf59fb3fbe0b9a1e4cdd347c39dc4e3a204700709c2be9" Jun 10 20:46:56.281565 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:56.281523 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6c9bc3fb7f63c5c4faf59fb3fbe0b9a1e4cdd347c39dc4e3a204700709c2be9"} err="failed to get container status \"b6c9bc3fb7f63c5c4faf59fb3fbe0b9a1e4cdd347c39dc4e3a204700709c2be9\": rpc error: code = NotFound desc = could not find container \"b6c9bc3fb7f63c5c4faf59fb3fbe0b9a1e4cdd347c39dc4e3a204700709c2be9\": container with ID starting with b6c9bc3fb7f63c5c4faf59fb3fbe0b9a1e4cdd347c39dc4e3a204700709c2be9 not found: ID does not exist" Jun 10 20:46:56.295199 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:56.295171 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86bb475b97-lk8ld"] Jun 10 20:46:56.299713 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:56.299691 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86bb475b97-lk8ld"] Jun 10 20:46:57.252804 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:57.252771 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="663b36b0-6159-4eb6-9a05-59bfc41b12a6" path="/var/lib/kubelet/pods/663b36b0-6159-4eb6-9a05-59bfc41b12a6/volumes" Jun 10 20:46:58.282583 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:58.282490 2554 generic.go:356] "Generic (PLEG): container finished" podID="3502f4bb-82a1-406e-8aa7-d3208d930019" containerID="df30325845e2eac3e9c6f2a1da9d32b4a4993420270165b61abc1cc1649b5630" exitCode=0 Jun 10 20:46:58.282583 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:58.282543 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v" event={"ID":"3502f4bb-82a1-406e-8aa7-d3208d930019","Type":"ContainerDied","Data":"df30325845e2eac3e9c6f2a1da9d32b4a4993420270165b61abc1cc1649b5630"} Jun 10 20:46:58.282971 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:58.282908 2554 scope.go:117] "RemoveContainer" containerID="df30325845e2eac3e9c6f2a1da9d32b4a4993420270165b61abc1cc1649b5630" Jun 10 20:46:58.346131 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:58.346090 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:58.351137 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:58.351112 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:46:58.482298 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:58.482260 2554 patch_prober.go:28] interesting pod/image-registry-7b454d5d46-h8m5g container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 20:46:58.482466 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:58.482311 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" podUID="49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 20:46:59.288514 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:46:59.288476 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-r6k8v" event={"ID":"3502f4bb-82a1-406e-8aa7-d3208d930019","Type":"ContainerStarted","Data":"49c4847eebcc89eb35a7891a2c2c1dc44e063aa82c1295afa743056c2f4d650c"} Jun 10 20:47:00.196164 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:00.196135 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:47:04.193151 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:04.193112 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b454d5d46-h8m5g"] Jun 10 20:47:29.213147 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:29.213080 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" podUID="49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" containerName="registry" containerID="cri-o://66c1d326b734ba7b4e2a4c225b2c6c68fac6ad941df5ffedc646da3f54717364" gracePeriod=30 Jun 10 20:47:30.192295 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.192257 2554 patch_prober.go:28] interesting pod/image-registry-7b454d5d46-h8m5g container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body= Jun 10 20:47:30.192491 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.192343 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" podUID="49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" Jun 10 20:47:30.415330 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.415299 2554 generic.go:356] "Generic (PLEG): container finished" podID="49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" containerID="66c1d326b734ba7b4e2a4c225b2c6c68fac6ad941df5ffedc646da3f54717364" exitCode=0 Jun 10 20:47:30.415713 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.415372 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" event={"ID":"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41","Type":"ContainerDied","Data":"66c1d326b734ba7b4e2a4c225b2c6c68fac6ad941df5ffedc646da3f54717364"} Jun 10 20:47:30.468900 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.468869 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:47:30.529344 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.529314 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-ca-trust-extracted\") pod \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " Jun 10 20:47:30.529344 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.529350 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6bbb\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-kube-api-access-f6bbb\") pod \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " Jun 10 20:47:30.529621 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.529376 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-installation-pull-secrets\") pod \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " Jun 10 20:47:30.529621 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.529412 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-bound-sa-token\") pod \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " Jun 10 20:47:30.529621 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.529561 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-certificates\") pod \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " Jun 10 20:47:30.529777 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.529626 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-trusted-ca\") pod \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " Jun 10 20:47:30.529777 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.529705 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls\") pod \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " Jun 10 20:47:30.529777 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.529737 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-image-registry-private-configuration\") pod \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\" (UID: \"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41\") " Jun 10 20:47:30.530395 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.530061 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" (UID: "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:47:30.530395 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.530355 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" (UID: "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:47:30.532323 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.532295 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" (UID: "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:30.532473 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.532427 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" (UID: "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:47:30.532534 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.532465 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" (UID: "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:30.532853 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.532823 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" (UID: "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:47:30.532853 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.532831 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-kube-api-access-f6bbb" (OuterVolumeSpecName: "kube-api-access-f6bbb") pod "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" (UID: "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41"). InnerVolumeSpecName "kube-api-access-f6bbb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:47:30.538887 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.538856 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" (UID: "49d8d16e-b992-4c11-b1f1-daf9ec7c3f41"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:47:30.630758 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.630723 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-tls\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:30.630758 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.630752 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-image-registry-private-configuration\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:30.630758 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.630763 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-ca-trust-extracted\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:30.630997 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.630774 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6bbb\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-kube-api-access-f6bbb\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:30.630997 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.630784 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-installation-pull-secrets\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:30.630997 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.630792 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-bound-sa-token\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:30.630997 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.630800 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-registry-certificates\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:30.630997 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:30.630810 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41-trusted-ca\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:31.421025 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:31.420977 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" Jun 10 20:47:31.421442 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:31.421033 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b454d5d46-h8m5g" event={"ID":"49d8d16e-b992-4c11-b1f1-daf9ec7c3f41","Type":"ContainerDied","Data":"3fd3e4960eea333ce535b0f4ae2f09f65b0875356c0c70dcbe07a97e0859a343"} Jun 10 20:47:31.421442 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:31.421115 2554 scope.go:117] "RemoveContainer" containerID="66c1d326b734ba7b4e2a4c225b2c6c68fac6ad941df5ffedc646da3f54717364" Jun 10 20:47:31.440655 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:31.440613 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b454d5d46-h8m5g"] Jun 10 20:47:31.447127 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:31.447099 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b454d5d46-h8m5g"] Jun 10 20:47:33.252402 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:33.252368 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" path="/var/lib/kubelet/pods/49d8d16e-b992-4c11-b1f1-daf9ec7c3f41/volumes" Jun 10 20:47:38.574937 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:38.574902 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:47:38.575389 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:38.575193 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="alertmanager" containerID="cri-o://ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95" gracePeriod=120 Jun 10 20:47:38.575389 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:38.575299 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="kube-rbac-proxy-web" containerID="cri-o://30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e" gracePeriod=120 Jun 10 20:47:38.575389 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:38.575348 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="config-reloader" containerID="cri-o://ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47" gracePeriod=120 Jun 10 20:47:38.575559 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:38.575306 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="kube-rbac-proxy-metric" containerID="cri-o://827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1" gracePeriod=120 Jun 10 20:47:38.575559 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:38.575314 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="kube-rbac-proxy" containerID="cri-o://a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed" gracePeriod=120 Jun 10 20:47:38.575559 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:38.575328 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="prom-label-proxy" containerID="cri-o://5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9" gracePeriod=120 Jun 10 20:47:39.458379 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.458346 2554 generic.go:356] "Generic (PLEG): container finished" podID="90569a93-b177-4715-9bad-c5bcafe496bd" containerID="5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9" exitCode=0 Jun 10 20:47:39.458379 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.458372 2554 generic.go:356] "Generic (PLEG): container finished" podID="90569a93-b177-4715-9bad-c5bcafe496bd" containerID="a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed" exitCode=0 Jun 10 20:47:39.458379 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.458380 2554 generic.go:356] "Generic (PLEG): container finished" podID="90569a93-b177-4715-9bad-c5bcafe496bd" containerID="ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47" exitCode=0 Jun 10 20:47:39.458379 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.458388 2554 generic.go:356] "Generic (PLEG): container finished" podID="90569a93-b177-4715-9bad-c5bcafe496bd" containerID="ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95" exitCode=0 Jun 10 20:47:39.458671 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.458403 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90569a93-b177-4715-9bad-c5bcafe496bd","Type":"ContainerDied","Data":"5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9"} Jun 10 20:47:39.458671 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.458468 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90569a93-b177-4715-9bad-c5bcafe496bd","Type":"ContainerDied","Data":"a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed"} Jun 10 20:47:39.458671 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.458519 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90569a93-b177-4715-9bad-c5bcafe496bd","Type":"ContainerDied","Data":"ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47"} Jun 10 20:47:39.458671 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.458545 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90569a93-b177-4715-9bad-c5bcafe496bd","Type":"ContainerDied","Data":"ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95"} Jun 10 20:47:39.832834 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.832808 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:39.904880 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.904850 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90569a93-b177-4715-9bad-c5bcafe496bd-config-out\") pod \"90569a93-b177-4715-9bad-c5bcafe496bd\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " Jun 10 20:47:39.905082 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.904894 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90569a93-b177-4715-9bad-c5bcafe496bd-alertmanager-trusted-ca-bundle\") pod \"90569a93-b177-4715-9bad-c5bcafe496bd\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " Jun 10 20:47:39.905082 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.904929 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-config-volume\") pod \"90569a93-b177-4715-9bad-c5bcafe496bd\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " Jun 10 20:47:39.905082 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.904955 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy-web\") pod \"90569a93-b177-4715-9bad-c5bcafe496bd\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " Jun 10 20:47:39.905082 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.904984 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90569a93-b177-4715-9bad-c5bcafe496bd-metrics-client-ca\") pod \"90569a93-b177-4715-9bad-c5bcafe496bd\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " Jun 10 20:47:39.905082 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.905062 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy\") pod \"90569a93-b177-4715-9bad-c5bcafe496bd\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " Jun 10 20:47:39.905365 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.905098 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-cluster-tls-config\") pod \"90569a93-b177-4715-9bad-c5bcafe496bd\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " Jun 10 20:47:39.905365 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.905143 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"90569a93-b177-4715-9bad-c5bcafe496bd\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " Jun 10 20:47:39.905365 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.905169 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90569a93-b177-4715-9bad-c5bcafe496bd-alertmanager-main-db\") pod \"90569a93-b177-4715-9bad-c5bcafe496bd\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " Jun 10 20:47:39.905365 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.905195 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90569a93-b177-4715-9bad-c5bcafe496bd-tls-assets\") pod \"90569a93-b177-4715-9bad-c5bcafe496bd\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " Jun 10 20:47:39.905365 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.905223 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-main-tls\") pod \"90569a93-b177-4715-9bad-c5bcafe496bd\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " Jun 10 20:47:39.905365 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.905240 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-web-config\") pod \"90569a93-b177-4715-9bad-c5bcafe496bd\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " Jun 10 20:47:39.905365 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.905268 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqwvk\" (UniqueName: \"kubernetes.io/projected/90569a93-b177-4715-9bad-c5bcafe496bd-kube-api-access-tqwvk\") pod \"90569a93-b177-4715-9bad-c5bcafe496bd\" (UID: \"90569a93-b177-4715-9bad-c5bcafe496bd\") " Jun 10 20:47:39.905700 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.905561 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90569a93-b177-4715-9bad-c5bcafe496bd-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "90569a93-b177-4715-9bad-c5bcafe496bd" (UID: "90569a93-b177-4715-9bad-c5bcafe496bd"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:47:39.905756 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.905733 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90569a93-b177-4715-9bad-c5bcafe496bd-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "90569a93-b177-4715-9bad-c5bcafe496bd" (UID: "90569a93-b177-4715-9bad-c5bcafe496bd"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:47:39.906221 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.906182 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90569a93-b177-4715-9bad-c5bcafe496bd-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "90569a93-b177-4715-9bad-c5bcafe496bd" (UID: "90569a93-b177-4715-9bad-c5bcafe496bd"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:47:39.908119 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.908065 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-config-volume" (OuterVolumeSpecName: "config-volume") pod "90569a93-b177-4715-9bad-c5bcafe496bd" (UID: "90569a93-b177-4715-9bad-c5bcafe496bd"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:39.909385 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.909345 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "90569a93-b177-4715-9bad-c5bcafe496bd" (UID: "90569a93-b177-4715-9bad-c5bcafe496bd"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:39.909517 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.909489 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "90569a93-b177-4715-9bad-c5bcafe496bd" (UID: "90569a93-b177-4715-9bad-c5bcafe496bd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:39.909682 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.909646 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90569a93-b177-4715-9bad-c5bcafe496bd-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "90569a93-b177-4715-9bad-c5bcafe496bd" (UID: "90569a93-b177-4715-9bad-c5bcafe496bd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:47:39.909791 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.909679 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "90569a93-b177-4715-9bad-c5bcafe496bd" (UID: "90569a93-b177-4715-9bad-c5bcafe496bd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:39.909791 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.909763 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90569a93-b177-4715-9bad-c5bcafe496bd-kube-api-access-tqwvk" (OuterVolumeSpecName: "kube-api-access-tqwvk") pod "90569a93-b177-4715-9bad-c5bcafe496bd" (UID: "90569a93-b177-4715-9bad-c5bcafe496bd"). InnerVolumeSpecName "kube-api-access-tqwvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:47:39.909958 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.909934 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "90569a93-b177-4715-9bad-c5bcafe496bd" (UID: "90569a93-b177-4715-9bad-c5bcafe496bd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:39.910000 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.909949 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90569a93-b177-4715-9bad-c5bcafe496bd-config-out" (OuterVolumeSpecName: "config-out") pod "90569a93-b177-4715-9bad-c5bcafe496bd" (UID: "90569a93-b177-4715-9bad-c5bcafe496bd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:47:39.914433 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.914293 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "90569a93-b177-4715-9bad-c5bcafe496bd" (UID: "90569a93-b177-4715-9bad-c5bcafe496bd"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:39.921500 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:39.921469 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-web-config" (OuterVolumeSpecName: "web-config") pod "90569a93-b177-4715-9bad-c5bcafe496bd" (UID: "90569a93-b177-4715-9bad-c5bcafe496bd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:40.006889 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.006793 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:40.006889 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.006829 2554 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90569a93-b177-4715-9bad-c5bcafe496bd-metrics-client-ca\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:40.006889 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.006839 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:40.006889 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.006849 2554 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-cluster-tls-config\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:40.006889 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.006858 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:40.006889 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.006867 2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90569a93-b177-4715-9bad-c5bcafe496bd-alertmanager-main-db\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:40.006889 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.006876 2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90569a93-b177-4715-9bad-c5bcafe496bd-tls-assets\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:40.006889 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.006884 2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-secret-alertmanager-main-tls\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:40.006889 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.006892 2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-web-config\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:40.006889 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.006900 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqwvk\" (UniqueName: \"kubernetes.io/projected/90569a93-b177-4715-9bad-c5bcafe496bd-kube-api-access-tqwvk\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:40.007333 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.006909 2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90569a93-b177-4715-9bad-c5bcafe496bd-config-out\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:40.007333 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.006917 2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90569a93-b177-4715-9bad-c5bcafe496bd-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:40.007333 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.006925 2554 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90569a93-b177-4715-9bad-c5bcafe496bd-config-volume\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:47:40.465957 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.465924 2554 generic.go:356] "Generic (PLEG): container finished" podID="90569a93-b177-4715-9bad-c5bcafe496bd" containerID="827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1" exitCode=0 Jun 10 20:47:40.465957 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.465952 2554 generic.go:356] "Generic (PLEG): container finished" podID="90569a93-b177-4715-9bad-c5bcafe496bd" containerID="30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e" exitCode=0 Jun 10 20:47:40.466179 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.466003 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.466179 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.466003 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90569a93-b177-4715-9bad-c5bcafe496bd","Type":"ContainerDied","Data":"827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1"} Jun 10 20:47:40.466179 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.466084 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90569a93-b177-4715-9bad-c5bcafe496bd","Type":"ContainerDied","Data":"30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e"} Jun 10 20:47:40.466179 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.466116 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90569a93-b177-4715-9bad-c5bcafe496bd","Type":"ContainerDied","Data":"916e4c9553b90ad0aeabeb0a5a3b9308423032b5f0ae86750f3071854ab3250b"} Jun 10 20:47:40.466179 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.466151 2554 scope.go:117] "RemoveContainer" containerID="5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9" Jun 10 20:47:40.480276 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.480252 2554 scope.go:117] "RemoveContainer" containerID="827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1" Jun 10 20:47:40.487900 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.487873 2554 scope.go:117] "RemoveContainer" containerID="a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed" Jun 10 20:47:40.493855 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.493829 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:47:40.497196 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.497170 2554 scope.go:117] "RemoveContainer" containerID="30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e" Jun 10 20:47:40.498690 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.498667 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:47:40.505240 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.505219 2554 scope.go:117] "RemoveContainer" containerID="ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47" Jun 10 20:47:40.514325 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.514290 2554 scope.go:117] "RemoveContainer" containerID="ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95" Jun 10 20:47:40.522383 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.522359 2554 scope.go:117] "RemoveContainer" containerID="75c71b2bb9c3725bbc1cb5be9238d6c2e61fc9dbf01fb01c6e26fed4d1911f08" Jun 10 20:47:40.523629 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.523610 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:47:40.523993 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.523975 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" containerName="registry" Jun 10 20:47:40.524109 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.523995 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" containerName="registry" Jun 10 20:47:40.524109 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524024 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="kube-rbac-proxy-metric" Jun 10 20:47:40.524109 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524033 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="kube-rbac-proxy-metric" Jun 10 20:47:40.524109 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524045 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="663b36b0-6159-4eb6-9a05-59bfc41b12a6" containerName="console" Jun 10 20:47:40.524109 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524053 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="663b36b0-6159-4eb6-9a05-59bfc41b12a6" containerName="console" Jun 10 20:47:40.524109 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524064 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="alertmanager" Jun 10 20:47:40.524109 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524073 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="alertmanager" Jun 10 20:47:40.524109 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524097 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="kube-rbac-proxy-web" Jun 10 20:47:40.524109 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524106 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="kube-rbac-proxy-web" Jun 10 20:47:40.524528 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524120 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="init-config-reloader" Jun 10 20:47:40.524528 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524128 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="init-config-reloader" Jun 10 20:47:40.524528 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524142 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="config-reloader" Jun 10 20:47:40.524528 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524152 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="config-reloader" Jun 10 20:47:40.524528 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524163 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="kube-rbac-proxy" Jun 10 20:47:40.524528 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524171 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="kube-rbac-proxy" Jun 10 20:47:40.524528 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524182 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="prom-label-proxy" Jun 10 20:47:40.524528 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524190 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="prom-label-proxy" Jun 10 20:47:40.524528 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524345 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="49d8d16e-b992-4c11-b1f1-daf9ec7c3f41" containerName="registry" Jun 10 20:47:40.524528 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524392 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="kube-rbac-proxy-metric" Jun 10 20:47:40.524528 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524404 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="alertmanager" Jun 10 20:47:40.524528 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524414 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="prom-label-proxy" Jun 10 20:47:40.524528 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524426 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="kube-rbac-proxy-web" Jun 10 20:47:40.524528 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524435 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="kube-rbac-proxy" Jun 10 20:47:40.524528 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524452 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="663b36b0-6159-4eb6-9a05-59bfc41b12a6" containerName="console" Jun 10 20:47:40.524528 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.524461 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" containerName="config-reloader" Jun 10 20:47:40.529879 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.529858 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.530474 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.530451 2554 scope.go:117] "RemoveContainer" containerID="5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9" Jun 10 20:47:40.530787 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:47:40.530768 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9\": container with ID starting with 5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9 not found: ID does not exist" containerID="5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9" Jun 10 20:47:40.530838 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.530797 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9"} err="failed to get container status \"5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9\": rpc error: code = NotFound desc = could not find container \"5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9\": container with ID starting with 5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9 not found: ID does not exist" Jun 10 20:47:40.530838 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.530814 2554 scope.go:117] "RemoveContainer" containerID="827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1" Jun 10 20:47:40.531111 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:47:40.531090 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1\": container with ID starting with 827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1 not found: ID does not exist" containerID="827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1" Jun 10 20:47:40.531179 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.531116 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1"} err="failed to get container status \"827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1\": rpc error: code = NotFound desc = could not find container \"827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1\": container with ID starting with 827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1 not found: ID does not exist" Jun 10 20:47:40.531179 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.531137 2554 scope.go:117] "RemoveContainer" containerID="a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed" Jun 10 20:47:40.531391 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:47:40.531373 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed\": container with ID starting with a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed not found: ID does not exist" containerID="a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed" Jun 10 20:47:40.531436 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.531399 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed"} err="failed to get container status \"a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed\": rpc error: code = NotFound desc = could not find container \"a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed\": container with ID starting with a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed not found: ID does not exist" Jun 10 20:47:40.531436 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.531414 2554 scope.go:117] "RemoveContainer" containerID="30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e" Jun 10 20:47:40.531669 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:47:40.531653 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e\": container with ID starting with 30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e not found: ID does not exist" containerID="30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e" Jun 10 20:47:40.531779 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.531670 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e"} err="failed to get container status \"30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e\": rpc error: code = NotFound desc = could not find container \"30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e\": container with ID starting with 30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e not found: ID does not exist" Jun 10 20:47:40.531779 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.531682 2554 scope.go:117] "RemoveContainer" containerID="ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47" Jun 10 20:47:40.531932 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:47:40.531917 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47\": container with ID starting with ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47 not found: ID does not exist" containerID="ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47" Jun 10 20:47:40.531973 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.531935 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47"} err="failed to get container status \"ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47\": rpc error: code = NotFound desc = could not find container \"ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47\": container with ID starting with ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47 not found: ID does not exist" Jun 10 20:47:40.531973 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.531946 2554 scope.go:117] "RemoveContainer" containerID="ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95" Jun 10 20:47:40.532168 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:47:40.532154 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95\": container with ID starting with ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95 not found: ID does not exist" containerID="ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95" Jun 10 20:47:40.532209 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.532172 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95"} err="failed to get container status \"ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95\": rpc error: code = NotFound desc = could not find container \"ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95\": container with ID starting with ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95 not found: ID does not exist" Jun 10 20:47:40.532209 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.532183 2554 scope.go:117] "RemoveContainer" containerID="75c71b2bb9c3725bbc1cb5be9238d6c2e61fc9dbf01fb01c6e26fed4d1911f08" Jun 10 20:47:40.532412 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:47:40.532395 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75c71b2bb9c3725bbc1cb5be9238d6c2e61fc9dbf01fb01c6e26fed4d1911f08\": container with ID starting with 75c71b2bb9c3725bbc1cb5be9238d6c2e61fc9dbf01fb01c6e26fed4d1911f08 not found: ID does not exist" containerID="75c71b2bb9c3725bbc1cb5be9238d6c2e61fc9dbf01fb01c6e26fed4d1911f08" Jun 10 20:47:40.532447 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.532416 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75c71b2bb9c3725bbc1cb5be9238d6c2e61fc9dbf01fb01c6e26fed4d1911f08"} err="failed to get container status \"75c71b2bb9c3725bbc1cb5be9238d6c2e61fc9dbf01fb01c6e26fed4d1911f08\": rpc error: code = NotFound desc = could not find container \"75c71b2bb9c3725bbc1cb5be9238d6c2e61fc9dbf01fb01c6e26fed4d1911f08\": container with ID starting with 75c71b2bb9c3725bbc1cb5be9238d6c2e61fc9dbf01fb01c6e26fed4d1911f08 not found: ID does not exist" Jun 10 20:47:40.532447 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.532429 2554 scope.go:117] "RemoveContainer" containerID="5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9" Jun 10 20:47:40.532655 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.532633 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9"} err="failed to get container status \"5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9\": rpc error: code = NotFound desc = could not find container \"5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9\": container with ID starting with 5b7e1530061605c1b5e9e181fb429b4953593abe69bcb1e48f4c519a0932d1a9 not found: ID does not exist" Jun 10 20:47:40.532655 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.532652 2554 scope.go:117] "RemoveContainer" containerID="827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1" Jun 10 20:47:40.532916 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.532896 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1"} err="failed to get container status \"827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1\": rpc error: code = NotFound desc = could not find container \"827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1\": container with ID starting with 827e12d159edb1e5fbd371818492aea4ca1a05d424e5defaec4bcec23fb942d1 not found: ID does not exist" Jun 10 20:47:40.532991 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.532917 2554 scope.go:117] "RemoveContainer" containerID="a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed" Jun 10 20:47:40.533074 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.532987 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 20:47:40.533074 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.532994 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 20:47:40.533184 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.532992 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 20:47:40.533184 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.533144 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 20:47:40.533282 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.533171 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed"} err="failed to get container status \"a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed\": rpc error: code = NotFound desc = could not find container \"a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed\": container with ID starting with a4c14ea4b5fe063e1b7fa19acbaee67b731a427d8512fc2fa1d8c50fadbea1ed not found: ID does not exist" Jun 10 20:47:40.533282 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.533193 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ncj5r\"" Jun 10 20:47:40.533282 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.533196 2554 scope.go:117] "RemoveContainer" containerID="30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e" Jun 10 20:47:40.533539 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.533503 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e"} err="failed to get container status \"30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e\": rpc error: code = NotFound desc = could not find container \"30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e\": container with ID starting with 30a16117487ac8854b35f4f352b2c0b03b37553b4b2712ee44e5a6cdfa74247e not found: ID does not exist" Jun 10 20:47:40.533539 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.533533 2554 scope.go:117] "RemoveContainer" containerID="ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47" Jun 10 20:47:40.533676 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.533614 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 20:47:40.533676 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.533638 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 20:47:40.533766 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.533673 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 20:47:40.533766 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.533739 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 20:47:40.533849 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.533768 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47"} err="failed to get container status \"ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47\": rpc error: code = NotFound desc = could not find container \"ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47\": container with ID starting with ddcd2d1c599a57e3f3df94521a57751c1078ba472e8b9d785e32e628699e7b47 not found: ID does not exist" Jun 10 20:47:40.533849 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.533791 2554 scope.go:117] "RemoveContainer" containerID="ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95" Jun 10 20:47:40.534058 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.534038 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95"} err="failed to get container status \"ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95\": rpc error: code = NotFound desc = could not find container \"ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95\": container with ID starting with ef50dee96ebdfba7d0407797e9cd7968190ec2b1c1557b0c609691ef42359b95 not found: ID does not exist" Jun 10 20:47:40.534127 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.534059 2554 scope.go:117] "RemoveContainer" containerID="75c71b2bb9c3725bbc1cb5be9238d6c2e61fc9dbf01fb01c6e26fed4d1911f08" Jun 10 20:47:40.534285 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.534265 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75c71b2bb9c3725bbc1cb5be9238d6c2e61fc9dbf01fb01c6e26fed4d1911f08"} err="failed to get container status \"75c71b2bb9c3725bbc1cb5be9238d6c2e61fc9dbf01fb01c6e26fed4d1911f08\": rpc error: code = NotFound desc = could not find container \"75c71b2bb9c3725bbc1cb5be9238d6c2e61fc9dbf01fb01c6e26fed4d1911f08\": container with ID starting with 75c71b2bb9c3725bbc1cb5be9238d6c2e61fc9dbf01fb01c6e26fed4d1911f08 not found: ID does not exist" Jun 10 20:47:40.539501 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.539327 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 20:47:40.540338 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.540318 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:47:40.612844 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.612798 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.612844 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.612844 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73eec1eb-cb97-42bc-a53d-96feae752a06-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.613114 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.612895 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.613114 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.612945 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73eec1eb-cb97-42bc-a53d-96feae752a06-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.613114 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.612981 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.613114 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.613004 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73eec1eb-cb97-42bc-a53d-96feae752a06-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.613114 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.613059 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73eec1eb-cb97-42bc-a53d-96feae752a06-config-out\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.613114 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.613115 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.613396 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.613133 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-web-config\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.613396 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.613153 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.613396 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.613206 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-config-volume\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.613396 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.613245 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73eec1eb-cb97-42bc-a53d-96feae752a06-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.613396 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.613269 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz6gd\" (UniqueName: \"kubernetes.io/projected/73eec1eb-cb97-42bc-a53d-96feae752a06-kube-api-access-gz6gd\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.713730 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.713685 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73eec1eb-cb97-42bc-a53d-96feae752a06-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.713915 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.713737 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73eec1eb-cb97-42bc-a53d-96feae752a06-config-out\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.713915 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.713778 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.713915 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.713806 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-web-config\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.713915 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.713834 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.713915 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.713863 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-config-volume\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.714196 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.713910 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73eec1eb-cb97-42bc-a53d-96feae752a06-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.714196 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.713948 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz6gd\" (UniqueName: \"kubernetes.io/projected/73eec1eb-cb97-42bc-a53d-96feae752a06-kube-api-access-gz6gd\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.714196 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.714139 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.714196 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.714174 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73eec1eb-cb97-42bc-a53d-96feae752a06-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.714405 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.714208 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.714405 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.714257 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73eec1eb-cb97-42bc-a53d-96feae752a06-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.714405 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.714299 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.714889 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.714838 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/73eec1eb-cb97-42bc-a53d-96feae752a06-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.716095 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.715993 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73eec1eb-cb97-42bc-a53d-96feae752a06-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.716725 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.716623 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73eec1eb-cb97-42bc-a53d-96feae752a06-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.716725 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.716675 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73eec1eb-cb97-42bc-a53d-96feae752a06-config-out\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.717445 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.717258 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.717445 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.717390 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-web-config\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.717445 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.717398 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73eec1eb-cb97-42bc-a53d-96feae752a06-tls-assets\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.717445 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.717397 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.717696 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.717562 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.718364 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.718343 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.718555 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.718536 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.718751 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.718734 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/73eec1eb-cb97-42bc-a53d-96feae752a06-config-volume\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.722073 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.722049 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz6gd\" (UniqueName: \"kubernetes.io/projected/73eec1eb-cb97-42bc-a53d-96feae752a06-kube-api-access-gz6gd\") pod \"alertmanager-main-0\" (UID: \"73eec1eb-cb97-42bc-a53d-96feae752a06\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.842426 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.842385 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 20:47:40.982769 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:40.982745 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 20:47:40.985368 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:47:40.985329 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73eec1eb_cb97_42bc_a53d_96feae752a06.slice/crio-cc0282ad5e5edd37aac08fbb718c54d135dc4b089259f1d0d11053ef08bb9b07 WatchSource:0}: Error finding container cc0282ad5e5edd37aac08fbb718c54d135dc4b089259f1d0d11053ef08bb9b07: Status 404 returned error can't find the container with id cc0282ad5e5edd37aac08fbb718c54d135dc4b089259f1d0d11053ef08bb9b07 Jun 10 20:47:41.253375 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:41.253289 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90569a93-b177-4715-9bad-c5bcafe496bd" path="/var/lib/kubelet/pods/90569a93-b177-4715-9bad-c5bcafe496bd/volumes" Jun 10 20:47:41.472361 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:41.472324 2554 generic.go:356] "Generic (PLEG): container finished" podID="73eec1eb-cb97-42bc-a53d-96feae752a06" containerID="df34d5201cff0240ae08bdb9d4f232b68994e525badf18ab50d6079a6f387e35" exitCode=0 Jun 10 20:47:41.472530 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:41.472402 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73eec1eb-cb97-42bc-a53d-96feae752a06","Type":"ContainerDied","Data":"df34d5201cff0240ae08bdb9d4f232b68994e525badf18ab50d6079a6f387e35"} Jun 10 20:47:41.472530 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:41.472469 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73eec1eb-cb97-42bc-a53d-96feae752a06","Type":"ContainerStarted","Data":"cc0282ad5e5edd37aac08fbb718c54d135dc4b089259f1d0d11053ef08bb9b07"} Jun 10 20:47:42.480237 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:42.480199 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73eec1eb-cb97-42bc-a53d-96feae752a06","Type":"ContainerStarted","Data":"354f8df53b9695a5c30081323a1d5e7c84ddf7b423ba51f0e4a927871bda20d8"} Jun 10 20:47:42.480725 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:42.480269 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73eec1eb-cb97-42bc-a53d-96feae752a06","Type":"ContainerStarted","Data":"5d46878be4a6921df9b416a6637dd6fe06a17242835bbfc5d132f548e6db49dd"} Jun 10 20:47:42.480725 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:42.480314 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73eec1eb-cb97-42bc-a53d-96feae752a06","Type":"ContainerStarted","Data":"68b53c981cf205dc76a43e4e4ad912f225c2a19a1577d3bbd83a3dc719d21399"} Jun 10 20:47:42.480725 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:42.480341 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73eec1eb-cb97-42bc-a53d-96feae752a06","Type":"ContainerStarted","Data":"bc105790c0c70dfe7decc957bd1b2c9ff773e0e766b400c4be8942f683013410"} Jun 10 20:47:42.480725 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:42.480369 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73eec1eb-cb97-42bc-a53d-96feae752a06","Type":"ContainerStarted","Data":"bc2a325e8876d12c75b110d1cfdf518d95fda0d269380cd2286800b1cbf9431c"} Jun 10 20:47:42.480725 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:42.480398 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"73eec1eb-cb97-42bc-a53d-96feae752a06","Type":"ContainerStarted","Data":"c36469a20e0525c511fc01c8f258515248be00ab57182a9e5a86c5f1bcc7ea9a"} Jun 10 20:47:42.510299 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:47:42.510241 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.4937122560000002 podStartE2EDuration="2.510224928s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.512672ms" isStatefulPod=false podCreationTimestamp="2026-06-10 20:47:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:47:42.507628475 +0000 UTC m=+349.675667203" watchObservedRunningTime="2026-06-10 20:47:42.510224928 +0000 UTC m=+349.678263654" Jun 10 20:48:01.508680 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.508637 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-784c948489-b54nb"] Jun 10 20:48:01.513716 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.513675 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.526544 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.526515 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784c948489-b54nb"] Jun 10 20:48:01.600275 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.600238 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-console-config\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.600451 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.600297 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-trusted-ca-bundle\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.600451 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.600342 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57m9h\" (UniqueName: \"kubernetes.io/projected/7c713261-fcda-4363-b218-e134b129deb3-kube-api-access-57m9h\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.600451 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.600372 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-oauth-serving-cert\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.600451 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.600421 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c713261-fcda-4363-b218-e134b129deb3-console-serving-cert\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.600451 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.600437 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-service-ca\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.600610 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.600463 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c713261-fcda-4363-b218-e134b129deb3-console-oauth-config\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.701904 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.701863 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-console-config\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.702117 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.701922 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-trusted-ca-bundle\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.702171 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.702131 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57m9h\" (UniqueName: \"kubernetes.io/projected/7c713261-fcda-4363-b218-e134b129deb3-kube-api-access-57m9h\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.702208 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.702187 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-oauth-serving-cert\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.702256 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.702245 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c713261-fcda-4363-b218-e134b129deb3-console-serving-cert\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.702292 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.702270 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-service-ca\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.702341 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.702303 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c713261-fcda-4363-b218-e134b129deb3-console-oauth-config\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.702687 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.702658 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-console-config\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.702788 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.702747 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-oauth-serving-cert\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.702851 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.702834 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-trusted-ca-bundle\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.702965 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.702946 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-service-ca\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.704738 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.704714 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c713261-fcda-4363-b218-e134b129deb3-console-serving-cert\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.704864 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.704845 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c713261-fcda-4363-b218-e134b129deb3-console-oauth-config\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.711682 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.711657 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57m9h\" (UniqueName: \"kubernetes.io/projected/7c713261-fcda-4363-b218-e134b129deb3-kube-api-access-57m9h\") pod \"console-784c948489-b54nb\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.824685 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.824589 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:01.963902 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:01.963875 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784c948489-b54nb"] Jun 10 20:48:01.966343 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:48:01.966307 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c713261_fcda_4363_b218_e134b129deb3.slice/crio-ec9fc4ea031c01aed326e5ccee0fda1001f8186c78d4d56b74dd06b6c3411106 WatchSource:0}: Error finding container ec9fc4ea031c01aed326e5ccee0fda1001f8186c78d4d56b74dd06b6c3411106: Status 404 returned error can't find the container with id ec9fc4ea031c01aed326e5ccee0fda1001f8186c78d4d56b74dd06b6c3411106 Jun 10 20:48:02.561336 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:02.561294 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784c948489-b54nb" event={"ID":"7c713261-fcda-4363-b218-e134b129deb3","Type":"ContainerStarted","Data":"18c99e43f2046fdbf25967c3d7a2522dcfb0d3f19f9d9142f87ae0ee05d31934"} Jun 10 20:48:02.561784 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:02.561346 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784c948489-b54nb" event={"ID":"7c713261-fcda-4363-b218-e134b129deb3","Type":"ContainerStarted","Data":"ec9fc4ea031c01aed326e5ccee0fda1001f8186c78d4d56b74dd06b6c3411106"} Jun 10 20:48:02.582369 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:02.582313 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-784c948489-b54nb" podStartSLOduration=1.582297426 podStartE2EDuration="1.582297426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:48:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:48:02.580811997 +0000 UTC m=+369.748850728" watchObservedRunningTime="2026-06-10 20:48:02.582297426 +0000 UTC m=+369.750336155" Jun 10 20:48:11.825274 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:11.825229 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:11.825700 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:11.825304 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:11.830399 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:11.830373 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:12.606721 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:12.606690 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-784c948489-b54nb" Jun 10 20:48:12.661277 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:12.661240 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69bdbf68bc-8nzc9"] Jun 10 20:48:37.686709 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:37.686668 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-69bdbf68bc-8nzc9" podUID="e9db2f61-e800-4ed1-97ad-14c098dff051" containerName="console" containerID="cri-o://c8b38f1ec479cfd8947ae0150482f8b0598ceb7e5be3295549aec95c6bf6528f" gracePeriod=15 Jun 10 20:48:37.939749 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:37.939679 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:48:38.020999 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.020970 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9db2f61-e800-4ed1-97ad-14c098dff051-console-serving-cert\") pod \"e9db2f61-e800-4ed1-97ad-14c098dff051\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " Jun 10 20:48:38.021183 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.021049 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-console-config\") pod \"e9db2f61-e800-4ed1-97ad-14c098dff051\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " Jun 10 20:48:38.021183 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.021080 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-service-ca\") pod \"e9db2f61-e800-4ed1-97ad-14c098dff051\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " Jun 10 20:48:38.021183 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.021132 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm6bz\" (UniqueName: \"kubernetes.io/projected/e9db2f61-e800-4ed1-97ad-14c098dff051-kube-api-access-nm6bz\") pod \"e9db2f61-e800-4ed1-97ad-14c098dff051\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " Jun 10 20:48:38.021329 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.021191 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9db2f61-e800-4ed1-97ad-14c098dff051-console-oauth-config\") pod \"e9db2f61-e800-4ed1-97ad-14c098dff051\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " Jun 10 20:48:38.021329 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.021219 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-trusted-ca-bundle\") pod \"e9db2f61-e800-4ed1-97ad-14c098dff051\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " Jun 10 20:48:38.021329 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.021255 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-oauth-serving-cert\") pod \"e9db2f61-e800-4ed1-97ad-14c098dff051\" (UID: \"e9db2f61-e800-4ed1-97ad-14c098dff051\") " Jun 10 20:48:38.021562 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.021524 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-service-ca" (OuterVolumeSpecName: "service-ca") pod "e9db2f61-e800-4ed1-97ad-14c098dff051" (UID: "e9db2f61-e800-4ed1-97ad-14c098dff051"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:48:38.021562 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.021532 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-console-config" (OuterVolumeSpecName: "console-config") pod "e9db2f61-e800-4ed1-97ad-14c098dff051" (UID: "e9db2f61-e800-4ed1-97ad-14c098dff051"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:48:38.021720 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.021667 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e9db2f61-e800-4ed1-97ad-14c098dff051" (UID: "e9db2f61-e800-4ed1-97ad-14c098dff051"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:48:38.021820 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.021798 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e9db2f61-e800-4ed1-97ad-14c098dff051" (UID: "e9db2f61-e800-4ed1-97ad-14c098dff051"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:48:38.023293 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.023271 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9db2f61-e800-4ed1-97ad-14c098dff051-kube-api-access-nm6bz" (OuterVolumeSpecName: "kube-api-access-nm6bz") pod "e9db2f61-e800-4ed1-97ad-14c098dff051" (UID: "e9db2f61-e800-4ed1-97ad-14c098dff051"). InnerVolumeSpecName "kube-api-access-nm6bz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:48:38.023385 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.023313 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9db2f61-e800-4ed1-97ad-14c098dff051-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e9db2f61-e800-4ed1-97ad-14c098dff051" (UID: "e9db2f61-e800-4ed1-97ad-14c098dff051"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:48:38.023433 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.023412 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9db2f61-e800-4ed1-97ad-14c098dff051-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e9db2f61-e800-4ed1-97ad-14c098dff051" (UID: "e9db2f61-e800-4ed1-97ad-14c098dff051"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:48:38.122182 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.122143 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm6bz\" (UniqueName: \"kubernetes.io/projected/e9db2f61-e800-4ed1-97ad-14c098dff051-kube-api-access-nm6bz\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:48:38.122182 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.122175 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9db2f61-e800-4ed1-97ad-14c098dff051-console-oauth-config\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:48:38.122182 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.122185 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-trusted-ca-bundle\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:48:38.122402 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.122194 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-oauth-serving-cert\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:48:38.122402 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.122205 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9db2f61-e800-4ed1-97ad-14c098dff051-console-serving-cert\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:48:38.122402 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.122217 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-console-config\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:48:38.122402 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.122226 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9db2f61-e800-4ed1-97ad-14c098dff051-service-ca\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:48:38.709189 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.709156 2554 generic.go:356] "Generic (PLEG): container finished" podID="e9db2f61-e800-4ed1-97ad-14c098dff051" containerID="c8b38f1ec479cfd8947ae0150482f8b0598ceb7e5be3295549aec95c6bf6528f" exitCode=0 Jun 10 20:48:38.709644 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.709223 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69bdbf68bc-8nzc9" Jun 10 20:48:38.709644 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.709237 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69bdbf68bc-8nzc9" event={"ID":"e9db2f61-e800-4ed1-97ad-14c098dff051","Type":"ContainerDied","Data":"c8b38f1ec479cfd8947ae0150482f8b0598ceb7e5be3295549aec95c6bf6528f"} Jun 10 20:48:38.709644 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.709296 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69bdbf68bc-8nzc9" event={"ID":"e9db2f61-e800-4ed1-97ad-14c098dff051","Type":"ContainerDied","Data":"2507a86e7e8aa682f820938438fa7e67a4396fb63ed56e1e618b4c69c53c66ec"} Jun 10 20:48:38.709644 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.709316 2554 scope.go:117] "RemoveContainer" containerID="c8b38f1ec479cfd8947ae0150482f8b0598ceb7e5be3295549aec95c6bf6528f" Jun 10 20:48:38.718402 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.718381 2554 scope.go:117] "RemoveContainer" containerID="c8b38f1ec479cfd8947ae0150482f8b0598ceb7e5be3295549aec95c6bf6528f" Jun 10 20:48:38.718648 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:48:38.718631 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8b38f1ec479cfd8947ae0150482f8b0598ceb7e5be3295549aec95c6bf6528f\": container with ID starting with c8b38f1ec479cfd8947ae0150482f8b0598ceb7e5be3295549aec95c6bf6528f not found: ID does not exist" containerID="c8b38f1ec479cfd8947ae0150482f8b0598ceb7e5be3295549aec95c6bf6528f" Jun 10 20:48:38.718690 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.718655 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8b38f1ec479cfd8947ae0150482f8b0598ceb7e5be3295549aec95c6bf6528f"} err="failed to get container status \"c8b38f1ec479cfd8947ae0150482f8b0598ceb7e5be3295549aec95c6bf6528f\": rpc error: code = NotFound desc = could not find container \"c8b38f1ec479cfd8947ae0150482f8b0598ceb7e5be3295549aec95c6bf6528f\": container with ID starting with c8b38f1ec479cfd8947ae0150482f8b0598ceb7e5be3295549aec95c6bf6528f not found: ID does not exist" Jun 10 20:48:38.730739 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.730705 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69bdbf68bc-8nzc9"] Jun 10 20:48:38.733086 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:38.733061 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69bdbf68bc-8nzc9"] Jun 10 20:48:39.252867 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:48:39.252837 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9db2f61-e800-4ed1-97ad-14c098dff051" path="/var/lib/kubelet/pods/e9db2f61-e800-4ed1-97ad-14c098dff051/volumes" Jun 10 20:49:13.414303 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.414226 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g"] Jun 10 20:49:13.414837 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.414739 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9db2f61-e800-4ed1-97ad-14c098dff051" containerName="console" Jun 10 20:49:13.414837 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.414760 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9db2f61-e800-4ed1-97ad-14c098dff051" containerName="console" Jun 10 20:49:13.414961 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.414877 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9db2f61-e800-4ed1-97ad-14c098dff051" containerName="console" Jun 10 20:49:13.417735 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.417713 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" Jun 10 20:49:13.420854 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.420833 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 20:49:13.420854 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.420852 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 20:49:13.422265 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.422249 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gfz4k\"" Jun 10 20:49:13.426411 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.426389 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g"] Jun 10 20:49:13.526029 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.525969 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9wg4\" (UniqueName: \"kubernetes.io/projected/31589017-6fd9-41cd-a6c1-5a209c44cb7b-kube-api-access-r9wg4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g\" (UID: \"31589017-6fd9-41cd-a6c1-5a209c44cb7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" Jun 10 20:49:13.526215 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.526045 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31589017-6fd9-41cd-a6c1-5a209c44cb7b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g\" (UID: \"31589017-6fd9-41cd-a6c1-5a209c44cb7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" Jun 10 20:49:13.526215 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.526065 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31589017-6fd9-41cd-a6c1-5a209c44cb7b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g\" (UID: \"31589017-6fd9-41cd-a6c1-5a209c44cb7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" Jun 10 20:49:13.627439 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.627399 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9wg4\" (UniqueName: \"kubernetes.io/projected/31589017-6fd9-41cd-a6c1-5a209c44cb7b-kube-api-access-r9wg4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g\" (UID: \"31589017-6fd9-41cd-a6c1-5a209c44cb7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" Jun 10 20:49:13.627624 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.627453 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31589017-6fd9-41cd-a6c1-5a209c44cb7b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g\" (UID: \"31589017-6fd9-41cd-a6c1-5a209c44cb7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" Jun 10 20:49:13.627624 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.627471 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31589017-6fd9-41cd-a6c1-5a209c44cb7b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g\" (UID: \"31589017-6fd9-41cd-a6c1-5a209c44cb7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" Jun 10 20:49:13.627869 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.627853 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31589017-6fd9-41cd-a6c1-5a209c44cb7b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g\" (UID: \"31589017-6fd9-41cd-a6c1-5a209c44cb7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" Jun 10 20:49:13.627936 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.627917 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31589017-6fd9-41cd-a6c1-5a209c44cb7b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g\" (UID: \"31589017-6fd9-41cd-a6c1-5a209c44cb7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" Jun 10 20:49:13.636949 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.636923 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9wg4\" (UniqueName: \"kubernetes.io/projected/31589017-6fd9-41cd-a6c1-5a209c44cb7b-kube-api-access-r9wg4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g\" (UID: \"31589017-6fd9-41cd-a6c1-5a209c44cb7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" Jun 10 20:49:13.685422 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.685341 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-lsxwk"] Jun 10 20:49:13.688638 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.688617 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lsxwk" Jun 10 20:49:13.691488 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.691464 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xdbgh\"" Jun 10 20:49:13.691601 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.691510 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 20:49:13.692256 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.692226 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 20:49:13.699848 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.699825 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-lsxwk"] Jun 10 20:49:13.727828 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.727798 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" Jun 10 20:49:13.728074 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.728049 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff1b795d-a7ff-4a3f-80af-7ab7c2996e4f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-lsxwk\" (UID: \"ff1b795d-a7ff-4a3f-80af-7ab7c2996e4f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lsxwk" Jun 10 20:49:13.728117 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.728092 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kslg6\" (UniqueName: \"kubernetes.io/projected/ff1b795d-a7ff-4a3f-80af-7ab7c2996e4f-kube-api-access-kslg6\") pod \"cert-manager-webhook-7dc76cbb94-lsxwk\" (UID: \"ff1b795d-a7ff-4a3f-80af-7ab7c2996e4f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lsxwk" Jun 10 20:49:13.829709 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.829672 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff1b795d-a7ff-4a3f-80af-7ab7c2996e4f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-lsxwk\" (UID: \"ff1b795d-a7ff-4a3f-80af-7ab7c2996e4f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lsxwk" Jun 10 20:49:13.829872 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.829733 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kslg6\" (UniqueName: \"kubernetes.io/projected/ff1b795d-a7ff-4a3f-80af-7ab7c2996e4f-kube-api-access-kslg6\") pod \"cert-manager-webhook-7dc76cbb94-lsxwk\" (UID: \"ff1b795d-a7ff-4a3f-80af-7ab7c2996e4f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lsxwk" Jun 10 20:49:13.838126 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.838093 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff1b795d-a7ff-4a3f-80af-7ab7c2996e4f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-lsxwk\" (UID: \"ff1b795d-a7ff-4a3f-80af-7ab7c2996e4f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lsxwk" Jun 10 20:49:13.838288 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.838205 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kslg6\" (UniqueName: \"kubernetes.io/projected/ff1b795d-a7ff-4a3f-80af-7ab7c2996e4f-kube-api-access-kslg6\") pod \"cert-manager-webhook-7dc76cbb94-lsxwk\" (UID: \"ff1b795d-a7ff-4a3f-80af-7ab7c2996e4f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lsxwk" Jun 10 20:49:13.860342 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.860318 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g"] Jun 10 20:49:13.862299 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:49:13.862274 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31589017_6fd9_41cd_a6c1_5a209c44cb7b.slice/crio-96b373a5e742b608d5f1aba69422a6a54e7fa316010e347638803a955a71d056 WatchSource:0}: Error finding container 96b373a5e742b608d5f1aba69422a6a54e7fa316010e347638803a955a71d056: Status 404 returned error can't find the container with id 96b373a5e742b608d5f1aba69422a6a54e7fa316010e347638803a955a71d056 Jun 10 20:49:13.864110 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:13.864094 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 20:49:14.018981 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:14.018946 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lsxwk" Jun 10 20:49:14.155597 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:14.155565 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-lsxwk"] Jun 10 20:49:14.158558 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:49:14.158530 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff1b795d_a7ff_4a3f_80af_7ab7c2996e4f.slice/crio-36024066e7a965cefd3ef83c75b170020839e4fc3c0e38d78778a43b87ba3819 WatchSource:0}: Error finding container 36024066e7a965cefd3ef83c75b170020839e4fc3c0e38d78778a43b87ba3819: Status 404 returned error can't find the container with id 36024066e7a965cefd3ef83c75b170020839e4fc3c0e38d78778a43b87ba3819 Jun 10 20:49:14.859886 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:14.859843 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" event={"ID":"31589017-6fd9-41cd-a6c1-5a209c44cb7b","Type":"ContainerStarted","Data":"96b373a5e742b608d5f1aba69422a6a54e7fa316010e347638803a955a71d056"} Jun 10 20:49:14.861242 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:14.861213 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lsxwk" event={"ID":"ff1b795d-a7ff-4a3f-80af-7ab7c2996e4f","Type":"ContainerStarted","Data":"36024066e7a965cefd3ef83c75b170020839e4fc3c0e38d78778a43b87ba3819"} Jun 10 20:49:18.882857 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:18.882813 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lsxwk" event={"ID":"ff1b795d-a7ff-4a3f-80af-7ab7c2996e4f","Type":"ContainerStarted","Data":"172cf1294f6a114931f29558d94c9abe60fe9590b45cf5637b5488804874f2a1"} Jun 10 20:49:18.883366 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:18.882890 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lsxwk" Jun 10 20:49:18.903939 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:18.903885 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lsxwk" podStartSLOduration=2.158549448 podStartE2EDuration="5.903863122s" totalImagesPullingTime="3.745313674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:49:18.902329954 +0000 UTC m=+446.070368682" watchObservedRunningTime="2026-06-10 20:49:18.903863122 +0000 UTC m=+446.071901853" Jun 10 20:49:20.892652 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:20.892565 2554 generic.go:356] "Generic (PLEG): container finished" podID="31589017-6fd9-41cd-a6c1-5a209c44cb7b" containerID="66ae2f7c89f0f2fac4f0c81144f7ab9093d589d0924bbf02d9da22506622e68d" exitCode=0 Jun 10 20:49:20.892980 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:20.892650 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" event={"ID":"31589017-6fd9-41cd-a6c1-5a209c44cb7b","Type":"ContainerDied","Data":"66ae2f7c89f0f2fac4f0c81144f7ab9093d589d0924bbf02d9da22506622e68d"} Jun 10 20:49:23.909847 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:23.909815 2554 generic.go:356] "Generic (PLEG): container finished" podID="31589017-6fd9-41cd-a6c1-5a209c44cb7b" containerID="a78acb499b5af3586c4827ddbfcf22de1dd252efb261bedf33d8741626b30f28" exitCode=0 Jun 10 20:49:23.910237 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:23.909870 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" event={"ID":"31589017-6fd9-41cd-a6c1-5a209c44cb7b","Type":"ContainerDied","Data":"a78acb499b5af3586c4827ddbfcf22de1dd252efb261bedf33d8741626b30f28"} Jun 10 20:49:23.945521 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:23.945477 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-ddj54"] Jun 10 20:49:23.950117 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:23.950091 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-ddj54" Jun 10 20:49:23.953420 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:23.953393 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-l5mxw\"" Jun 10 20:49:23.954675 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:23.954653 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-ddj54"] Jun 10 20:49:24.021394 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:24.021352 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b4ffe900-f850-41d6-89ef-c48b59ca6d1d-bound-sa-token\") pod \"cert-manager-59c77684cc-ddj54\" (UID: \"b4ffe900-f850-41d6-89ef-c48b59ca6d1d\") " pod="cert-manager/cert-manager-59c77684cc-ddj54" Jun 10 20:49:24.021594 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:24.021470 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lvm8\" (UniqueName: \"kubernetes.io/projected/b4ffe900-f850-41d6-89ef-c48b59ca6d1d-kube-api-access-5lvm8\") pod \"cert-manager-59c77684cc-ddj54\" (UID: \"b4ffe900-f850-41d6-89ef-c48b59ca6d1d\") " pod="cert-manager/cert-manager-59c77684cc-ddj54" Jun 10 20:49:24.122569 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:24.122532 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lvm8\" (UniqueName: \"kubernetes.io/projected/b4ffe900-f850-41d6-89ef-c48b59ca6d1d-kube-api-access-5lvm8\") pod \"cert-manager-59c77684cc-ddj54\" (UID: \"b4ffe900-f850-41d6-89ef-c48b59ca6d1d\") " pod="cert-manager/cert-manager-59c77684cc-ddj54" Jun 10 20:49:24.122744 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:24.122591 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b4ffe900-f850-41d6-89ef-c48b59ca6d1d-bound-sa-token\") pod \"cert-manager-59c77684cc-ddj54\" (UID: \"b4ffe900-f850-41d6-89ef-c48b59ca6d1d\") " pod="cert-manager/cert-manager-59c77684cc-ddj54" Jun 10 20:49:24.133894 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:24.133863 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b4ffe900-f850-41d6-89ef-c48b59ca6d1d-bound-sa-token\") pod \"cert-manager-59c77684cc-ddj54\" (UID: \"b4ffe900-f850-41d6-89ef-c48b59ca6d1d\") " pod="cert-manager/cert-manager-59c77684cc-ddj54" Jun 10 20:49:24.134030 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:24.133926 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lvm8\" (UniqueName: \"kubernetes.io/projected/b4ffe900-f850-41d6-89ef-c48b59ca6d1d-kube-api-access-5lvm8\") pod \"cert-manager-59c77684cc-ddj54\" (UID: \"b4ffe900-f850-41d6-89ef-c48b59ca6d1d\") " pod="cert-manager/cert-manager-59c77684cc-ddj54" Jun 10 20:49:24.260354 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:24.260314 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-ddj54" Jun 10 20:49:24.396416 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:24.396397 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-ddj54"] Jun 10 20:49:24.398509 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:49:24.398483 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4ffe900_f850_41d6_89ef_c48b59ca6d1d.slice/crio-764e98fd5735a77c4887ea624c1e33e9d21eb87ca9c7b98ac620a03ed780d04d WatchSource:0}: Error finding container 764e98fd5735a77c4887ea624c1e33e9d21eb87ca9c7b98ac620a03ed780d04d: Status 404 returned error can't find the container with id 764e98fd5735a77c4887ea624c1e33e9d21eb87ca9c7b98ac620a03ed780d04d Jun 10 20:49:24.890520 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:24.890488 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lsxwk" Jun 10 20:49:24.917552 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:24.917493 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-ddj54" event={"ID":"b4ffe900-f850-41d6-89ef-c48b59ca6d1d","Type":"ContainerStarted","Data":"0bee293e459e4de2d82861ca0ca708de2fce6b3558a6b660e1c2c4bfb2c45f76"} Jun 10 20:49:24.917552 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:24.917544 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-ddj54" event={"ID":"b4ffe900-f850-41d6-89ef-c48b59ca6d1d","Type":"ContainerStarted","Data":"764e98fd5735a77c4887ea624c1e33e9d21eb87ca9c7b98ac620a03ed780d04d"} Jun 10 20:49:24.933575 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:24.933515 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-ddj54" podStartSLOduration=1.933495149 podStartE2EDuration="1.933495149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:49:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:49:24.932816269 +0000 UTC m=+452.100855000" watchObservedRunningTime="2026-06-10 20:49:24.933495149 +0000 UTC m=+452.101533878" Jun 10 20:49:32.955963 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:32.955926 2554 generic.go:356] "Generic (PLEG): container finished" podID="31589017-6fd9-41cd-a6c1-5a209c44cb7b" containerID="be1d512d5c2b23545781448b12047c931cfaecb653567ec29b91e1ac56e48bf0" exitCode=0 Jun 10 20:49:32.956355 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:32.956028 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" event={"ID":"31589017-6fd9-41cd-a6c1-5a209c44cb7b","Type":"ContainerDied","Data":"be1d512d5c2b23545781448b12047c931cfaecb653567ec29b91e1ac56e48bf0"} Jun 10 20:49:34.088729 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:34.088701 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" Jun 10 20:49:34.216699 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:34.216598 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9wg4\" (UniqueName: \"kubernetes.io/projected/31589017-6fd9-41cd-a6c1-5a209c44cb7b-kube-api-access-r9wg4\") pod \"31589017-6fd9-41cd-a6c1-5a209c44cb7b\" (UID: \"31589017-6fd9-41cd-a6c1-5a209c44cb7b\") " Jun 10 20:49:34.216699 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:34.216670 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31589017-6fd9-41cd-a6c1-5a209c44cb7b-bundle\") pod \"31589017-6fd9-41cd-a6c1-5a209c44cb7b\" (UID: \"31589017-6fd9-41cd-a6c1-5a209c44cb7b\") " Jun 10 20:49:34.216941 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:34.216750 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31589017-6fd9-41cd-a6c1-5a209c44cb7b-util\") pod \"31589017-6fd9-41cd-a6c1-5a209c44cb7b\" (UID: \"31589017-6fd9-41cd-a6c1-5a209c44cb7b\") " Jun 10 20:49:34.217182 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:34.217156 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31589017-6fd9-41cd-a6c1-5a209c44cb7b-bundle" (OuterVolumeSpecName: "bundle") pod "31589017-6fd9-41cd-a6c1-5a209c44cb7b" (UID: "31589017-6fd9-41cd-a6c1-5a209c44cb7b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:49:34.219050 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:34.219027 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31589017-6fd9-41cd-a6c1-5a209c44cb7b-kube-api-access-r9wg4" (OuterVolumeSpecName: "kube-api-access-r9wg4") pod "31589017-6fd9-41cd-a6c1-5a209c44cb7b" (UID: "31589017-6fd9-41cd-a6c1-5a209c44cb7b"). InnerVolumeSpecName "kube-api-access-r9wg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:49:34.220970 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:34.220945 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31589017-6fd9-41cd-a6c1-5a209c44cb7b-util" (OuterVolumeSpecName: "util") pod "31589017-6fd9-41cd-a6c1-5a209c44cb7b" (UID: "31589017-6fd9-41cd-a6c1-5a209c44cb7b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:49:34.317873 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:34.317827 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31589017-6fd9-41cd-a6c1-5a209c44cb7b-util\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:49:34.317873 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:34.317870 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9wg4\" (UniqueName: \"kubernetes.io/projected/31589017-6fd9-41cd-a6c1-5a209c44cb7b-kube-api-access-r9wg4\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:49:34.318146 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:34.317885 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31589017-6fd9-41cd-a6c1-5a209c44cb7b-bundle\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:49:34.965461 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:34.965422 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" event={"ID":"31589017-6fd9-41cd-a6c1-5a209c44cb7b","Type":"ContainerDied","Data":"96b373a5e742b608d5f1aba69422a6a54e7fa316010e347638803a955a71d056"} Jun 10 20:49:34.965626 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:34.965468 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6pz8g" Jun 10 20:49:34.965626 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:34.965481 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96b373a5e742b608d5f1aba69422a6a54e7fa316010e347638803a955a71d056" Jun 10 20:49:42.598613 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.598577 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gxwmx"] Jun 10 20:49:42.599084 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.598919 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31589017-6fd9-41cd-a6c1-5a209c44cb7b" containerName="pull" Jun 10 20:49:42.599084 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.598934 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="31589017-6fd9-41cd-a6c1-5a209c44cb7b" containerName="pull" Jun 10 20:49:42.599084 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.598954 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31589017-6fd9-41cd-a6c1-5a209c44cb7b" containerName="util" Jun 10 20:49:42.599084 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.598961 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="31589017-6fd9-41cd-a6c1-5a209c44cb7b" containerName="util" Jun 10 20:49:42.599084 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.598972 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31589017-6fd9-41cd-a6c1-5a209c44cb7b" containerName="extract" Jun 10 20:49:42.599084 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.598978 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="31589017-6fd9-41cd-a6c1-5a209c44cb7b" containerName="extract" Jun 10 20:49:42.599084 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.599060 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="31589017-6fd9-41cd-a6c1-5a209c44cb7b" containerName="extract" Jun 10 20:49:42.604398 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.604379 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gxwmx" Jun 10 20:49:42.607218 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.607195 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:49:42.607358 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.607248 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gh558\"" Jun 10 20:49:42.608717 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.608695 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 20:49:42.610681 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.610654 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gxwmx"] Jun 10 20:49:42.791691 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.791649 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee82ce11-c7dd-43c3-9a8b-096c2dcdee98-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gxwmx\" (UID: \"ee82ce11-c7dd-43c3-9a8b-096c2dcdee98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gxwmx" Jun 10 20:49:42.791887 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.791707 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fh7t\" (UniqueName: \"kubernetes.io/projected/ee82ce11-c7dd-43c3-9a8b-096c2dcdee98-kube-api-access-2fh7t\") pod \"openshift-lws-operator-fd8ccff4c-gxwmx\" (UID: \"ee82ce11-c7dd-43c3-9a8b-096c2dcdee98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gxwmx" Jun 10 20:49:42.892448 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.892345 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee82ce11-c7dd-43c3-9a8b-096c2dcdee98-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gxwmx\" (UID: \"ee82ce11-c7dd-43c3-9a8b-096c2dcdee98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gxwmx" Jun 10 20:49:42.892448 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.892401 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fh7t\" (UniqueName: \"kubernetes.io/projected/ee82ce11-c7dd-43c3-9a8b-096c2dcdee98-kube-api-access-2fh7t\") pod \"openshift-lws-operator-fd8ccff4c-gxwmx\" (UID: \"ee82ce11-c7dd-43c3-9a8b-096c2dcdee98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gxwmx" Jun 10 20:49:42.892775 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.892749 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee82ce11-c7dd-43c3-9a8b-096c2dcdee98-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gxwmx\" (UID: \"ee82ce11-c7dd-43c3-9a8b-096c2dcdee98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gxwmx" Jun 10 20:49:42.901730 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.901706 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fh7t\" (UniqueName: \"kubernetes.io/projected/ee82ce11-c7dd-43c3-9a8b-096c2dcdee98-kube-api-access-2fh7t\") pod \"openshift-lws-operator-fd8ccff4c-gxwmx\" (UID: \"ee82ce11-c7dd-43c3-9a8b-096c2dcdee98\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gxwmx" Jun 10 20:49:42.914706 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:42.914678 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gxwmx" Jun 10 20:49:43.050555 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:43.050528 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gxwmx"] Jun 10 20:49:43.052578 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:49:43.052540 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee82ce11_c7dd_43c3_9a8b_096c2dcdee98.slice/crio-5d5606907bce8f2f8d93b4fe4e921333737f70aafae275043189f0d954bb9831 WatchSource:0}: Error finding container 5d5606907bce8f2f8d93b4fe4e921333737f70aafae275043189f0d954bb9831: Status 404 returned error can't find the container with id 5d5606907bce8f2f8d93b4fe4e921333737f70aafae275043189f0d954bb9831 Jun 10 20:49:44.007747 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:44.007706 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gxwmx" event={"ID":"ee82ce11-c7dd-43c3-9a8b-096c2dcdee98","Type":"ContainerStarted","Data":"5d5606907bce8f2f8d93b4fe4e921333737f70aafae275043189f0d954bb9831"} Jun 10 20:49:46.018673 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:46.018626 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gxwmx" event={"ID":"ee82ce11-c7dd-43c3-9a8b-096c2dcdee98","Type":"ContainerStarted","Data":"c27957420c899cc329fd4251f7e18f56c9c235d7d3d95f19e6e27fff31899af4"} Jun 10 20:49:46.036935 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:46.036878 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gxwmx" podStartSLOduration=1.9126358319999999 podStartE2EDuration="4.036861808s" totalImagesPullingTime="2.124225976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:49:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:49:46.035576038 +0000 UTC m=+473.203614793" watchObservedRunningTime="2026-06-10 20:49:46.036861808 +0000 UTC m=+473.204900537" Jun 10 20:49:52.853396 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.853357 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx"] Jun 10 20:49:52.855837 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.855799 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" Jun 10 20:49:52.861001 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.860977 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gwtbh\"" Jun 10 20:49:52.862485 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.862297 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 20:49:52.862485 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.862306 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 20:49:52.862485 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.862380 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 20:49:52.869713 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.869690 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3230dcf5-d76e-4b98-b06b-71d6e29553ae-cert\") pod \"lws-controller-manager-678cf7c548-jsnfx\" (UID: \"3230dcf5-d76e-4b98-b06b-71d6e29553ae\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" Jun 10 20:49:52.869817 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.869797 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zspbk\" (UniqueName: \"kubernetes.io/projected/3230dcf5-d76e-4b98-b06b-71d6e29553ae-kube-api-access-zspbk\") pod \"lws-controller-manager-678cf7c548-jsnfx\" (UID: \"3230dcf5-d76e-4b98-b06b-71d6e29553ae\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" Jun 10 20:49:52.869863 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.869829 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3230dcf5-d76e-4b98-b06b-71d6e29553ae-metrics-cert\") pod \"lws-controller-manager-678cf7c548-jsnfx\" (UID: \"3230dcf5-d76e-4b98-b06b-71d6e29553ae\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" Jun 10 20:49:52.869863 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.869860 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3230dcf5-d76e-4b98-b06b-71d6e29553ae-manager-config\") pod \"lws-controller-manager-678cf7c548-jsnfx\" (UID: \"3230dcf5-d76e-4b98-b06b-71d6e29553ae\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" Jun 10 20:49:52.874617 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.874593 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx"] Jun 10 20:49:52.970665 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.970614 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zspbk\" (UniqueName: \"kubernetes.io/projected/3230dcf5-d76e-4b98-b06b-71d6e29553ae-kube-api-access-zspbk\") pod \"lws-controller-manager-678cf7c548-jsnfx\" (UID: \"3230dcf5-d76e-4b98-b06b-71d6e29553ae\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" Jun 10 20:49:52.970871 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.970675 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3230dcf5-d76e-4b98-b06b-71d6e29553ae-metrics-cert\") pod \"lws-controller-manager-678cf7c548-jsnfx\" (UID: \"3230dcf5-d76e-4b98-b06b-71d6e29553ae\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" Jun 10 20:49:52.970871 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.970707 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3230dcf5-d76e-4b98-b06b-71d6e29553ae-manager-config\") pod \"lws-controller-manager-678cf7c548-jsnfx\" (UID: \"3230dcf5-d76e-4b98-b06b-71d6e29553ae\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" Jun 10 20:49:52.970871 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.970740 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3230dcf5-d76e-4b98-b06b-71d6e29553ae-cert\") pod \"lws-controller-manager-678cf7c548-jsnfx\" (UID: \"3230dcf5-d76e-4b98-b06b-71d6e29553ae\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" Jun 10 20:49:52.974314 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.971996 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3230dcf5-d76e-4b98-b06b-71d6e29553ae-manager-config\") pod \"lws-controller-manager-678cf7c548-jsnfx\" (UID: \"3230dcf5-d76e-4b98-b06b-71d6e29553ae\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" Jun 10 20:49:52.974314 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.974307 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3230dcf5-d76e-4b98-b06b-71d6e29553ae-metrics-cert\") pod \"lws-controller-manager-678cf7c548-jsnfx\" (UID: \"3230dcf5-d76e-4b98-b06b-71d6e29553ae\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" Jun 10 20:49:52.975055 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.975033 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3230dcf5-d76e-4b98-b06b-71d6e29553ae-cert\") pod \"lws-controller-manager-678cf7c548-jsnfx\" (UID: \"3230dcf5-d76e-4b98-b06b-71d6e29553ae\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" Jun 10 20:49:52.979839 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:52.979814 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zspbk\" (UniqueName: \"kubernetes.io/projected/3230dcf5-d76e-4b98-b06b-71d6e29553ae-kube-api-access-zspbk\") pod \"lws-controller-manager-678cf7c548-jsnfx\" (UID: \"3230dcf5-d76e-4b98-b06b-71d6e29553ae\") " pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" Jun 10 20:49:53.168768 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:53.168682 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gwtbh\"" Jun 10 20:49:53.176108 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:53.176078 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" Jun 10 20:49:53.314232 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:53.314208 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx"] Jun 10 20:49:53.316770 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:49:53.316737 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3230dcf5_d76e_4b98_b06b_71d6e29553ae.slice/crio-9efa3784bb7453fae91d015ebe20b5b3fd3c0a56cf830d0b116745e064ad952b WatchSource:0}: Error finding container 9efa3784bb7453fae91d015ebe20b5b3fd3c0a56cf830d0b116745e064ad952b: Status 404 returned error can't find the container with id 9efa3784bb7453fae91d015ebe20b5b3fd3c0a56cf830d0b116745e064ad952b Jun 10 20:49:54.057024 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:54.056973 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" event={"ID":"3230dcf5-d76e-4b98-b06b-71d6e29553ae","Type":"ContainerStarted","Data":"9efa3784bb7453fae91d015ebe20b5b3fd3c0a56cf830d0b116745e064ad952b"} Jun 10 20:49:59.082759 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:59.082723 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" event={"ID":"3230dcf5-d76e-4b98-b06b-71d6e29553ae","Type":"ContainerStarted","Data":"5b41159bbd16e2839bbb015d45b83e710c1410e3cbdd6bdf99bfc50a40d1af3b"} Jun 10 20:49:59.083209 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:59.082967 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" Jun 10 20:49:59.119279 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:49:59.119225 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" podStartSLOduration=2.157607926 podStartE2EDuration="7.11920827s" totalImagesPullingTime="4.961600344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:49:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:49:59.117897428 +0000 UTC m=+486.285936182" watchObservedRunningTime="2026-06-10 20:49:59.11920827 +0000 UTC m=+486.287247000" Jun 10 20:50:02.112076 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.112033 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b"] Jun 10 20:50:02.128200 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.128171 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:02.131194 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.131168 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m4qdw\"" Jun 10 20:50:02.131406 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.131382 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 20:50:02.131511 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.131306 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 20:50:02.131594 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.131351 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 20:50:02.131594 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.131168 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 20:50:02.131728 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.131611 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b"] Jun 10 20:50:02.159094 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.159002 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f10dcba-5046-4b08-ba70-61aa9c05ee24-tmp\") pod \"opendatahub-operator-controller-manager-546b599574-8pl2b\" (UID: \"0f10dcba-5046-4b08-ba70-61aa9c05ee24\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:02.159278 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.159146 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0f10dcba-5046-4b08-ba70-61aa9c05ee24-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546b599574-8pl2b\" (UID: \"0f10dcba-5046-4b08-ba70-61aa9c05ee24\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:02.159278 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.159217 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f10dcba-5046-4b08-ba70-61aa9c05ee24-webhook-cert\") pod \"opendatahub-operator-controller-manager-546b599574-8pl2b\" (UID: \"0f10dcba-5046-4b08-ba70-61aa9c05ee24\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:02.159394 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.159278 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0f10dcba-5046-4b08-ba70-61aa9c05ee24-manifests\") pod \"opendatahub-operator-controller-manager-546b599574-8pl2b\" (UID: \"0f10dcba-5046-4b08-ba70-61aa9c05ee24\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:02.159394 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.159380 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh4n4\" (UniqueName: \"kubernetes.io/projected/0f10dcba-5046-4b08-ba70-61aa9c05ee24-kube-api-access-zh4n4\") pod \"opendatahub-operator-controller-manager-546b599574-8pl2b\" (UID: \"0f10dcba-5046-4b08-ba70-61aa9c05ee24\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:02.260220 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.260174 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f10dcba-5046-4b08-ba70-61aa9c05ee24-tmp\") pod \"opendatahub-operator-controller-manager-546b599574-8pl2b\" (UID: \"0f10dcba-5046-4b08-ba70-61aa9c05ee24\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:02.260398 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.260237 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0f10dcba-5046-4b08-ba70-61aa9c05ee24-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546b599574-8pl2b\" (UID: \"0f10dcba-5046-4b08-ba70-61aa9c05ee24\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:02.260398 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.260282 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f10dcba-5046-4b08-ba70-61aa9c05ee24-webhook-cert\") pod \"opendatahub-operator-controller-manager-546b599574-8pl2b\" (UID: \"0f10dcba-5046-4b08-ba70-61aa9c05ee24\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:02.260398 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.260360 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0f10dcba-5046-4b08-ba70-61aa9c05ee24-manifests\") pod \"opendatahub-operator-controller-manager-546b599574-8pl2b\" (UID: \"0f10dcba-5046-4b08-ba70-61aa9c05ee24\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:02.260528 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.260402 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh4n4\" (UniqueName: \"kubernetes.io/projected/0f10dcba-5046-4b08-ba70-61aa9c05ee24-kube-api-access-zh4n4\") pod \"opendatahub-operator-controller-manager-546b599574-8pl2b\" (UID: \"0f10dcba-5046-4b08-ba70-61aa9c05ee24\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:02.260810 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.260780 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0f10dcba-5046-4b08-ba70-61aa9c05ee24-manifests\") pod \"opendatahub-operator-controller-manager-546b599574-8pl2b\" (UID: \"0f10dcba-5046-4b08-ba70-61aa9c05ee24\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:02.262744 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.262712 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f10dcba-5046-4b08-ba70-61aa9c05ee24-tmp\") pod \"opendatahub-operator-controller-manager-546b599574-8pl2b\" (UID: \"0f10dcba-5046-4b08-ba70-61aa9c05ee24\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:02.262875 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.262765 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0f10dcba-5046-4b08-ba70-61aa9c05ee24-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546b599574-8pl2b\" (UID: \"0f10dcba-5046-4b08-ba70-61aa9c05ee24\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:02.262875 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.262807 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f10dcba-5046-4b08-ba70-61aa9c05ee24-webhook-cert\") pod \"opendatahub-operator-controller-manager-546b599574-8pl2b\" (UID: \"0f10dcba-5046-4b08-ba70-61aa9c05ee24\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:02.272396 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.272369 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh4n4\" (UniqueName: \"kubernetes.io/projected/0f10dcba-5046-4b08-ba70-61aa9c05ee24-kube-api-access-zh4n4\") pod \"opendatahub-operator-controller-manager-546b599574-8pl2b\" (UID: \"0f10dcba-5046-4b08-ba70-61aa9c05ee24\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:02.441593 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.441500 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:02.607945 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:02.607917 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b"] Jun 10 20:50:02.609890 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:50:02.609865 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f10dcba_5046_4b08_ba70_61aa9c05ee24.slice/crio-72af57c80696d8ed44b4b935da850df6e87c7952aa181c42262ca9900f6dd9d2 WatchSource:0}: Error finding container 72af57c80696d8ed44b4b935da850df6e87c7952aa181c42262ca9900f6dd9d2: Status 404 returned error can't find the container with id 72af57c80696d8ed44b4b935da850df6e87c7952aa181c42262ca9900f6dd9d2 Jun 10 20:50:03.102792 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:03.102756 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" event={"ID":"0f10dcba-5046-4b08-ba70-61aa9c05ee24","Type":"ContainerStarted","Data":"72af57c80696d8ed44b4b935da850df6e87c7952aa181c42262ca9900f6dd9d2"} Jun 10 20:50:06.121384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:06.121346 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" event={"ID":"0f10dcba-5046-4b08-ba70-61aa9c05ee24","Type":"ContainerStarted","Data":"101e9590bf6d98129cc0f2b2c5d68bf6e32e76f70f9b42a45cefdb4aaa50e49e"} Jun 10 20:50:07.127025 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:07.126978 2554 generic.go:356] "Generic (PLEG): container finished" podID="0f10dcba-5046-4b08-ba70-61aa9c05ee24" containerID="101e9590bf6d98129cc0f2b2c5d68bf6e32e76f70f9b42a45cefdb4aaa50e49e" exitCode=0 Jun 10 20:50:07.127411 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:07.127072 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" event={"ID":"0f10dcba-5046-4b08-ba70-61aa9c05ee24","Type":"ContainerDied","Data":"101e9590bf6d98129cc0f2b2c5d68bf6e32e76f70f9b42a45cefdb4aaa50e49e"} Jun 10 20:50:08.133643 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:08.133608 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" event={"ID":"0f10dcba-5046-4b08-ba70-61aa9c05ee24","Type":"ContainerStarted","Data":"ad068490d35cee94890b3bca3659d17b54fe861efa40597952c2832c82785f8e"} Jun 10 20:50:08.134076 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:08.133717 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:08.159429 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:08.159375 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" podStartSLOduration=1.923284644 podStartE2EDuration="6.159353912s" totalImagesPullingTime="3.224131821s" totalInitContainerRuntime="1.011937447s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:50:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:50:08.15630449 +0000 UTC m=+495.324343234" watchObservedRunningTime="2026-06-10 20:50:08.159353912 +0000 UTC m=+495.327392640" Jun 10 20:50:10.089560 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:10.089529 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-678cf7c548-jsnfx" Jun 10 20:50:19.140879 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:19.140850 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-8pl2b" Jun 10 20:50:23.911546 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:23.911510 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg"] Jun 10 20:50:23.918030 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:23.917993 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" Jun 10 20:50:23.921617 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:23.921593 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 20:50:23.921875 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:23.921616 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 20:50:23.922049 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:23.921739 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gfz4k\"" Jun 10 20:50:23.922717 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:23.922693 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg"] Jun 10 20:50:24.065264 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:24.065225 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/698b05d3-3083-4754-a28e-c2c5eaf00b34-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg\" (UID: \"698b05d3-3083-4754-a28e-c2c5eaf00b34\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" Jun 10 20:50:24.065440 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:24.065391 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/698b05d3-3083-4754-a28e-c2c5eaf00b34-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg\" (UID: \"698b05d3-3083-4754-a28e-c2c5eaf00b34\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" Jun 10 20:50:24.065487 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:24.065462 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztsbt\" (UniqueName: \"kubernetes.io/projected/698b05d3-3083-4754-a28e-c2c5eaf00b34-kube-api-access-ztsbt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg\" (UID: \"698b05d3-3083-4754-a28e-c2c5eaf00b34\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" Jun 10 20:50:24.166398 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:24.166316 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/698b05d3-3083-4754-a28e-c2c5eaf00b34-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg\" (UID: \"698b05d3-3083-4754-a28e-c2c5eaf00b34\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" Jun 10 20:50:24.166398 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:24.166371 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztsbt\" (UniqueName: \"kubernetes.io/projected/698b05d3-3083-4754-a28e-c2c5eaf00b34-kube-api-access-ztsbt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg\" (UID: \"698b05d3-3083-4754-a28e-c2c5eaf00b34\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" Jun 10 20:50:24.166588 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:24.166411 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/698b05d3-3083-4754-a28e-c2c5eaf00b34-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg\" (UID: \"698b05d3-3083-4754-a28e-c2c5eaf00b34\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" Jun 10 20:50:24.166836 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:24.166817 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/698b05d3-3083-4754-a28e-c2c5eaf00b34-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg\" (UID: \"698b05d3-3083-4754-a28e-c2c5eaf00b34\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" Jun 10 20:50:24.166883 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:24.166864 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/698b05d3-3083-4754-a28e-c2c5eaf00b34-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg\" (UID: \"698b05d3-3083-4754-a28e-c2c5eaf00b34\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" Jun 10 20:50:24.174690 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:24.174660 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztsbt\" (UniqueName: \"kubernetes.io/projected/698b05d3-3083-4754-a28e-c2c5eaf00b34-kube-api-access-ztsbt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg\" (UID: \"698b05d3-3083-4754-a28e-c2c5eaf00b34\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" Jun 10 20:50:24.228781 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:24.228748 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" Jun 10 20:50:24.393954 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:24.393926 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg"] Jun 10 20:50:24.396251 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:50:24.396215 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod698b05d3_3083_4754_a28e_c2c5eaf00b34.slice/crio-5e6b276e85723616eb7d933d89d34ffaa00cb2c5c4d3477164918b0e750fd548 WatchSource:0}: Error finding container 5e6b276e85723616eb7d933d89d34ffaa00cb2c5c4d3477164918b0e750fd548: Status 404 returned error can't find the container with id 5e6b276e85723616eb7d933d89d34ffaa00cb2c5c4d3477164918b0e750fd548 Jun 10 20:50:25.221126 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:25.221090 2554 generic.go:356] "Generic (PLEG): container finished" podID="698b05d3-3083-4754-a28e-c2c5eaf00b34" containerID="d0c42511914923611191b03e87205a29f494e45062bf17acda3047eac4c7b43f" exitCode=0 Jun 10 20:50:25.221499 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:25.221173 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" event={"ID":"698b05d3-3083-4754-a28e-c2c5eaf00b34","Type":"ContainerDied","Data":"d0c42511914923611191b03e87205a29f494e45062bf17acda3047eac4c7b43f"} Jun 10 20:50:25.221499 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:25.221223 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" event={"ID":"698b05d3-3083-4754-a28e-c2c5eaf00b34","Type":"ContainerStarted","Data":"5e6b276e85723616eb7d933d89d34ffaa00cb2c5c4d3477164918b0e750fd548"} Jun 10 20:50:26.228277 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:26.228241 2554 generic.go:356] "Generic (PLEG): container finished" podID="698b05d3-3083-4754-a28e-c2c5eaf00b34" containerID="5f6d149ff091958a7875bb4df34737425303ba98898ec53f700ca2552f43ce88" exitCode=0 Jun 10 20:50:26.228682 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:26.228336 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" event={"ID":"698b05d3-3083-4754-a28e-c2c5eaf00b34","Type":"ContainerDied","Data":"5f6d149ff091958a7875bb4df34737425303ba98898ec53f700ca2552f43ce88"} Jun 10 20:50:27.234888 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:27.234857 2554 generic.go:356] "Generic (PLEG): container finished" podID="698b05d3-3083-4754-a28e-c2c5eaf00b34" containerID="f92a66cf46ac40da0e67c46c97f3eade127daec7a9c7a4e3517814ac87da8421" exitCode=0 Jun 10 20:50:27.235317 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:27.234926 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" event={"ID":"698b05d3-3083-4754-a28e-c2c5eaf00b34","Type":"ContainerDied","Data":"f92a66cf46ac40da0e67c46c97f3eade127daec7a9c7a4e3517814ac87da8421"} Jun 10 20:50:28.388840 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:28.388804 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" Jun 10 20:50:28.513659 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:28.513572 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/698b05d3-3083-4754-a28e-c2c5eaf00b34-bundle\") pod \"698b05d3-3083-4754-a28e-c2c5eaf00b34\" (UID: \"698b05d3-3083-4754-a28e-c2c5eaf00b34\") " Jun 10 20:50:28.513659 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:28.513614 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztsbt\" (UniqueName: \"kubernetes.io/projected/698b05d3-3083-4754-a28e-c2c5eaf00b34-kube-api-access-ztsbt\") pod \"698b05d3-3083-4754-a28e-c2c5eaf00b34\" (UID: \"698b05d3-3083-4754-a28e-c2c5eaf00b34\") " Jun 10 20:50:28.513874 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:28.513683 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/698b05d3-3083-4754-a28e-c2c5eaf00b34-util\") pod \"698b05d3-3083-4754-a28e-c2c5eaf00b34\" (UID: \"698b05d3-3083-4754-a28e-c2c5eaf00b34\") " Jun 10 20:50:28.514579 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:28.514551 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698b05d3-3083-4754-a28e-c2c5eaf00b34-bundle" (OuterVolumeSpecName: "bundle") pod "698b05d3-3083-4754-a28e-c2c5eaf00b34" (UID: "698b05d3-3083-4754-a28e-c2c5eaf00b34"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:50:28.515869 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:28.515838 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/698b05d3-3083-4754-a28e-c2c5eaf00b34-kube-api-access-ztsbt" (OuterVolumeSpecName: "kube-api-access-ztsbt") pod "698b05d3-3083-4754-a28e-c2c5eaf00b34" (UID: "698b05d3-3083-4754-a28e-c2c5eaf00b34"). InnerVolumeSpecName "kube-api-access-ztsbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:50:28.518980 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:28.518950 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698b05d3-3083-4754-a28e-c2c5eaf00b34-util" (OuterVolumeSpecName: "util") pod "698b05d3-3083-4754-a28e-c2c5eaf00b34" (UID: "698b05d3-3083-4754-a28e-c2c5eaf00b34"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:50:28.615304 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:28.615267 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/698b05d3-3083-4754-a28e-c2c5eaf00b34-util\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:50:28.615304 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:28.615298 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/698b05d3-3083-4754-a28e-c2c5eaf00b34-bundle\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:50:28.615304 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:28.615308 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztsbt\" (UniqueName: \"kubernetes.io/projected/698b05d3-3083-4754-a28e-c2c5eaf00b34-kube-api-access-ztsbt\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:50:29.247490 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:29.247459 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" Jun 10 20:50:29.252476 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:29.252442 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hdlbg" event={"ID":"698b05d3-3083-4754-a28e-c2c5eaf00b34","Type":"ContainerDied","Data":"5e6b276e85723616eb7d933d89d34ffaa00cb2c5c4d3477164918b0e750fd548"} Jun 10 20:50:29.252665 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:29.252488 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e6b276e85723616eb7d933d89d34ffaa00cb2c5c4d3477164918b0e750fd548" Jun 10 20:50:33.724236 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.724203 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll"] Jun 10 20:50:33.724596 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.724533 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698b05d3-3083-4754-a28e-c2c5eaf00b34" containerName="extract" Jun 10 20:50:33.724596 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.724545 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="698b05d3-3083-4754-a28e-c2c5eaf00b34" containerName="extract" Jun 10 20:50:33.724596 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.724562 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698b05d3-3083-4754-a28e-c2c5eaf00b34" containerName="util" Jun 10 20:50:33.724596 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.724568 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="698b05d3-3083-4754-a28e-c2c5eaf00b34" containerName="util" Jun 10 20:50:33.724596 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.724581 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698b05d3-3083-4754-a28e-c2c5eaf00b34" containerName="pull" Jun 10 20:50:33.724596 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.724587 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="698b05d3-3083-4754-a28e-c2c5eaf00b34" containerName="pull" Jun 10 20:50:33.724794 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.724646 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="698b05d3-3083-4754-a28e-c2c5eaf00b34" containerName="extract" Jun 10 20:50:33.730669 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.730643 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" Jun 10 20:50:33.737162 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.737131 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 20:50:33.737384 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.737171 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gfz4k\"" Jun 10 20:50:33.738035 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.737250 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 20:50:33.763166 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.763130 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll"] Jun 10 20:50:33.859632 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.859596 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f737484-7326-4b1f-b6d6-1e71eda8a346-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll\" (UID: \"5f737484-7326-4b1f-b6d6-1e71eda8a346\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" Jun 10 20:50:33.859827 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.859651 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mz8v\" (UniqueName: \"kubernetes.io/projected/5f737484-7326-4b1f-b6d6-1e71eda8a346-kube-api-access-5mz8v\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll\" (UID: \"5f737484-7326-4b1f-b6d6-1e71eda8a346\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" Jun 10 20:50:33.859827 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.859735 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f737484-7326-4b1f-b6d6-1e71eda8a346-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll\" (UID: \"5f737484-7326-4b1f-b6d6-1e71eda8a346\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" Jun 10 20:50:33.960832 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.960780 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f737484-7326-4b1f-b6d6-1e71eda8a346-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll\" (UID: \"5f737484-7326-4b1f-b6d6-1e71eda8a346\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" Jun 10 20:50:33.961053 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.960859 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mz8v\" (UniqueName: \"kubernetes.io/projected/5f737484-7326-4b1f-b6d6-1e71eda8a346-kube-api-access-5mz8v\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll\" (UID: \"5f737484-7326-4b1f-b6d6-1e71eda8a346\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" Jun 10 20:50:33.961053 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.960910 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f737484-7326-4b1f-b6d6-1e71eda8a346-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll\" (UID: \"5f737484-7326-4b1f-b6d6-1e71eda8a346\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" Jun 10 20:50:33.961362 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.961335 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f737484-7326-4b1f-b6d6-1e71eda8a346-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll\" (UID: \"5f737484-7326-4b1f-b6d6-1e71eda8a346\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" Jun 10 20:50:33.961452 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.961359 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f737484-7326-4b1f-b6d6-1e71eda8a346-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll\" (UID: \"5f737484-7326-4b1f-b6d6-1e71eda8a346\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" Jun 10 20:50:33.991914 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:33.991839 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mz8v\" (UniqueName: \"kubernetes.io/projected/5f737484-7326-4b1f-b6d6-1e71eda8a346-kube-api-access-5mz8v\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll\" (UID: \"5f737484-7326-4b1f-b6d6-1e71eda8a346\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" Jun 10 20:50:34.041185 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:34.041149 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" Jun 10 20:50:34.198838 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:34.198793 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll"] Jun 10 20:50:34.199996 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:50:34.199958 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f737484_7326_4b1f_b6d6_1e71eda8a346.slice/crio-ffe38157fcbf12bace613fd098b5f8051f015355b98d05c2ab88338f4787646f WatchSource:0}: Error finding container ffe38157fcbf12bace613fd098b5f8051f015355b98d05c2ab88338f4787646f: Status 404 returned error can't find the container with id ffe38157fcbf12bace613fd098b5f8051f015355b98d05c2ab88338f4787646f Jun 10 20:50:34.272465 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:34.272427 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" event={"ID":"5f737484-7326-4b1f-b6d6-1e71eda8a346","Type":"ContainerStarted","Data":"ffe38157fcbf12bace613fd098b5f8051f015355b98d05c2ab88338f4787646f"} Jun 10 20:50:35.280261 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:35.280166 2554 generic.go:356] "Generic (PLEG): container finished" podID="5f737484-7326-4b1f-b6d6-1e71eda8a346" containerID="e600649a8caa22af7a7cb4a99974a7950d10c17a97dfa26d8b25382f7a6e1073" exitCode=0 Jun 10 20:50:35.280628 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:35.280255 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" event={"ID":"5f737484-7326-4b1f-b6d6-1e71eda8a346","Type":"ContainerDied","Data":"e600649a8caa22af7a7cb4a99974a7950d10c17a97dfa26d8b25382f7a6e1073"} Jun 10 20:50:37.291872 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:37.291835 2554 generic.go:356] "Generic (PLEG): container finished" podID="5f737484-7326-4b1f-b6d6-1e71eda8a346" containerID="f8f6ce9d591ac8ee5781c76501359502a55ad8e8c9ddab06e220a54284779caa" exitCode=0 Jun 10 20:50:37.292299 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:37.291900 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" event={"ID":"5f737484-7326-4b1f-b6d6-1e71eda8a346","Type":"ContainerDied","Data":"f8f6ce9d591ac8ee5781c76501359502a55ad8e8c9ddab06e220a54284779caa"} Jun 10 20:50:37.470182 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:37.470149 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-ccf667d6f-vs29k"] Jun 10 20:50:37.472687 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:37.472664 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-ccf667d6f-vs29k" Jun 10 20:50:37.477926 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:37.477893 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 20:50:37.478073 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:37.477959 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-24dwx\"" Jun 10 20:50:37.485523 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:37.485499 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-ccf667d6f-vs29k"] Jun 10 20:50:37.492025 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:37.491987 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kxgq\" (UniqueName: \"kubernetes.io/projected/f1919adb-ef84-47c8-b0e6-43980de76b1b-kube-api-access-5kxgq\") pod \"dashboard-redirect-ccf667d6f-vs29k\" (UID: \"f1919adb-ef84-47c8-b0e6-43980de76b1b\") " pod="opendatahub/dashboard-redirect-ccf667d6f-vs29k" Jun 10 20:50:37.492126 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:37.492075 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f1919adb-ef84-47c8-b0e6-43980de76b1b-redirect-config\") pod \"dashboard-redirect-ccf667d6f-vs29k\" (UID: \"f1919adb-ef84-47c8-b0e6-43980de76b1b\") " pod="opendatahub/dashboard-redirect-ccf667d6f-vs29k" Jun 10 20:50:37.592627 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:37.592537 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kxgq\" (UniqueName: \"kubernetes.io/projected/f1919adb-ef84-47c8-b0e6-43980de76b1b-kube-api-access-5kxgq\") pod \"dashboard-redirect-ccf667d6f-vs29k\" (UID: \"f1919adb-ef84-47c8-b0e6-43980de76b1b\") " pod="opendatahub/dashboard-redirect-ccf667d6f-vs29k" Jun 10 20:50:37.592627 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:37.592586 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f1919adb-ef84-47c8-b0e6-43980de76b1b-redirect-config\") pod \"dashboard-redirect-ccf667d6f-vs29k\" (UID: \"f1919adb-ef84-47c8-b0e6-43980de76b1b\") " pod="opendatahub/dashboard-redirect-ccf667d6f-vs29k" Jun 10 20:50:37.593372 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:37.593346 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f1919adb-ef84-47c8-b0e6-43980de76b1b-redirect-config\") pod \"dashboard-redirect-ccf667d6f-vs29k\" (UID: \"f1919adb-ef84-47c8-b0e6-43980de76b1b\") " pod="opendatahub/dashboard-redirect-ccf667d6f-vs29k" Jun 10 20:50:37.606240 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:37.606214 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kxgq\" (UniqueName: \"kubernetes.io/projected/f1919adb-ef84-47c8-b0e6-43980de76b1b-kube-api-access-5kxgq\") pod \"dashboard-redirect-ccf667d6f-vs29k\" (UID: \"f1919adb-ef84-47c8-b0e6-43980de76b1b\") " pod="opendatahub/dashboard-redirect-ccf667d6f-vs29k" Jun 10 20:50:37.783748 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:37.783712 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-ccf667d6f-vs29k" Jun 10 20:50:37.921053 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:37.921022 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-ccf667d6f-vs29k"] Jun 10 20:50:37.921893 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:50:37.921864 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1919adb_ef84_47c8_b0e6_43980de76b1b.slice/crio-28719a7c270d76b5a27e8af790bc1295f12e14077986b003fcaf0d2224312c6c WatchSource:0}: Error finding container 28719a7c270d76b5a27e8af790bc1295f12e14077986b003fcaf0d2224312c6c: Status 404 returned error can't find the container with id 28719a7c270d76b5a27e8af790bc1295f12e14077986b003fcaf0d2224312c6c Jun 10 20:50:38.298611 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:38.298570 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-ccf667d6f-vs29k" event={"ID":"f1919adb-ef84-47c8-b0e6-43980de76b1b","Type":"ContainerStarted","Data":"28719a7c270d76b5a27e8af790bc1295f12e14077986b003fcaf0d2224312c6c"} Jun 10 20:50:38.300673 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:38.300646 2554 generic.go:356] "Generic (PLEG): container finished" podID="5f737484-7326-4b1f-b6d6-1e71eda8a346" containerID="fa2f097ecbe67e8bee78ac1d724fcf4b6617e7f5113e7a831e8a4d63c88997be" exitCode=0 Jun 10 20:50:38.300782 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:38.300703 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" event={"ID":"5f737484-7326-4b1f-b6d6-1e71eda8a346","Type":"ContainerDied","Data":"fa2f097ecbe67e8bee78ac1d724fcf4b6617e7f5113e7a831e8a4d63c88997be"} Jun 10 20:50:39.496439 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:39.496404 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" Jun 10 20:50:39.514881 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:39.514829 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f737484-7326-4b1f-b6d6-1e71eda8a346-util\") pod \"5f737484-7326-4b1f-b6d6-1e71eda8a346\" (UID: \"5f737484-7326-4b1f-b6d6-1e71eda8a346\") " Jun 10 20:50:39.514881 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:39.514882 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mz8v\" (UniqueName: \"kubernetes.io/projected/5f737484-7326-4b1f-b6d6-1e71eda8a346-kube-api-access-5mz8v\") pod \"5f737484-7326-4b1f-b6d6-1e71eda8a346\" (UID: \"5f737484-7326-4b1f-b6d6-1e71eda8a346\") " Jun 10 20:50:39.515409 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:39.514942 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f737484-7326-4b1f-b6d6-1e71eda8a346-bundle\") pod \"5f737484-7326-4b1f-b6d6-1e71eda8a346\" (UID: \"5f737484-7326-4b1f-b6d6-1e71eda8a346\") " Jun 10 20:50:39.517983 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:39.516581 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f737484-7326-4b1f-b6d6-1e71eda8a346-bundle" (OuterVolumeSpecName: "bundle") pod "5f737484-7326-4b1f-b6d6-1e71eda8a346" (UID: "5f737484-7326-4b1f-b6d6-1e71eda8a346"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:50:39.525026 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:39.524889 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f737484-7326-4b1f-b6d6-1e71eda8a346-util" (OuterVolumeSpecName: "util") pod "5f737484-7326-4b1f-b6d6-1e71eda8a346" (UID: "5f737484-7326-4b1f-b6d6-1e71eda8a346"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:50:39.525585 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:39.525553 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f737484-7326-4b1f-b6d6-1e71eda8a346-kube-api-access-5mz8v" (OuterVolumeSpecName: "kube-api-access-5mz8v") pod "5f737484-7326-4b1f-b6d6-1e71eda8a346" (UID: "5f737484-7326-4b1f-b6d6-1e71eda8a346"). InnerVolumeSpecName "kube-api-access-5mz8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:50:39.616928 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:39.616762 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f737484-7326-4b1f-b6d6-1e71eda8a346-util\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:50:39.616928 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:39.616800 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mz8v\" (UniqueName: \"kubernetes.io/projected/5f737484-7326-4b1f-b6d6-1e71eda8a346-kube-api-access-5mz8v\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:50:39.616928 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:39.616816 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f737484-7326-4b1f-b6d6-1e71eda8a346-bundle\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:50:40.314807 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:40.314758 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" Jun 10 20:50:40.314807 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:40.314770 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atmvll" event={"ID":"5f737484-7326-4b1f-b6d6-1e71eda8a346","Type":"ContainerDied","Data":"ffe38157fcbf12bace613fd098b5f8051f015355b98d05c2ab88338f4787646f"} Jun 10 20:50:40.315051 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:40.314828 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffe38157fcbf12bace613fd098b5f8051f015355b98d05c2ab88338f4787646f" Jun 10 20:50:43.332622 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:43.332587 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-ccf667d6f-vs29k" event={"ID":"f1919adb-ef84-47c8-b0e6-43980de76b1b","Type":"ContainerStarted","Data":"bb5b835735be00702613aac5eb07a4d892d2ce9fca5a638a101fa5a42accd8a8"} Jun 10 20:50:43.362478 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:43.362420 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-ccf667d6f-vs29k" podStartSLOduration=1.088106671 podStartE2EDuration="6.362400564s" totalImagesPullingTime="5.274293893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:50:43.360772396 +0000 UTC m=+530.528811156" watchObservedRunningTime="2026-06-10 20:50:43.362400564 +0000 UTC m=+530.530439295" Jun 10 20:50:44.788470 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.788423 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x"] Jun 10 20:50:44.789026 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.788991 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f737484-7326-4b1f-b6d6-1e71eda8a346" containerName="pull" Jun 10 20:50:44.789124 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.789031 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f737484-7326-4b1f-b6d6-1e71eda8a346" containerName="pull" Jun 10 20:50:44.789124 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.789062 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f737484-7326-4b1f-b6d6-1e71eda8a346" containerName="util" Jun 10 20:50:44.789124 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.789071 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f737484-7326-4b1f-b6d6-1e71eda8a346" containerName="util" Jun 10 20:50:44.789124 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.789085 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f737484-7326-4b1f-b6d6-1e71eda8a346" containerName="extract" Jun 10 20:50:44.789124 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.789094 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f737484-7326-4b1f-b6d6-1e71eda8a346" containerName="extract" Jun 10 20:50:44.789345 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.789208 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f737484-7326-4b1f-b6d6-1e71eda8a346" containerName="extract" Jun 10 20:50:44.792090 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.792067 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.795214 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.795186 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 10 20:50:44.795214 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.795207 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 20:50:44.795415 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.795241 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 10 20:50:44.795415 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.795257 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-62n89\"" Jun 10 20:50:44.795521 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.795477 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 10 20:50:44.795521 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.795496 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 20:50:44.795521 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.795500 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 20:50:44.803783 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.803755 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x"] Jun 10 20:50:44.866119 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.866075 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6d448a1-939c-47f4-afa7-3d5bc348631f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.866276 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.866128 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6d448a1-939c-47f4-afa7-3d5bc348631f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.866276 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.866198 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e6d448a1-939c-47f4-afa7-3d5bc348631f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.866276 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.866237 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e6d448a1-939c-47f4-afa7-3d5bc348631f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.866276 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.866263 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flmt5\" (UniqueName: \"kubernetes.io/projected/e6d448a1-939c-47f4-afa7-3d5bc348631f-kube-api-access-flmt5\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.866433 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.866294 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e6d448a1-939c-47f4-afa7-3d5bc348631f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.866433 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.866316 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e6d448a1-939c-47f4-afa7-3d5bc348631f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.966808 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.966764 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6d448a1-939c-47f4-afa7-3d5bc348631f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.967005 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.966820 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6d448a1-939c-47f4-afa7-3d5bc348631f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.967005 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.966851 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e6d448a1-939c-47f4-afa7-3d5bc348631f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.967005 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.966876 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e6d448a1-939c-47f4-afa7-3d5bc348631f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.967005 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.966899 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flmt5\" (UniqueName: \"kubernetes.io/projected/e6d448a1-939c-47f4-afa7-3d5bc348631f-kube-api-access-flmt5\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.967005 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.966920 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e6d448a1-939c-47f4-afa7-3d5bc348631f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.967005 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.966943 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e6d448a1-939c-47f4-afa7-3d5bc348631f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.967703 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.967677 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e6d448a1-939c-47f4-afa7-3d5bc348631f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.969442 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.969412 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e6d448a1-939c-47f4-afa7-3d5bc348631f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.969527 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.969484 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e6d448a1-939c-47f4-afa7-3d5bc348631f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.969614 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.969593 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6d448a1-939c-47f4-afa7-3d5bc348631f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.969736 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.969722 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e6d448a1-939c-47f4-afa7-3d5bc348631f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.975402 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.975381 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6d448a1-939c-47f4-afa7-3d5bc348631f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:44.975489 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:44.975465 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flmt5\" (UniqueName: \"kubernetes.io/projected/e6d448a1-939c-47f4-afa7-3d5bc348631f-kube-api-access-flmt5\") pod \"istiod-openshift-gateway-75c67f8887-p2n4x\" (UID: \"e6d448a1-939c-47f4-afa7-3d5bc348631f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:45.102914 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:45.102829 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:45.251978 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:50:45.251937 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d448a1_939c_47f4_afa7_3d5bc348631f.slice/crio-c4edcf40e2365bfd973c081dc4ffe11c2fbdb3c92ba295a8123320afdcdd6efd WatchSource:0}: Error finding container c4edcf40e2365bfd973c081dc4ffe11c2fbdb3c92ba295a8123320afdcdd6efd: Status 404 returned error can't find the container with id c4edcf40e2365bfd973c081dc4ffe11c2fbdb3c92ba295a8123320afdcdd6efd Jun 10 20:50:45.259038 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:45.257388 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x"] Jun 10 20:50:45.346706 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:45.346672 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" event={"ID":"e6d448a1-939c-47f4-afa7-3d5bc348631f","Type":"ContainerStarted","Data":"c4edcf40e2365bfd973c081dc4ffe11c2fbdb3c92ba295a8123320afdcdd6efd"} Jun 10 20:50:48.048249 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:48.047465 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 20:50:48.048249 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:48.047562 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 20:50:48.366966 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:48.366860 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" event={"ID":"e6d448a1-939c-47f4-afa7-3d5bc348631f","Type":"ContainerStarted","Data":"c4178107701b36d7f3369b0691b73f98f0ecc80cc86ae0a50e19b6b6d7d0873e"} Jun 10 20:50:48.367773 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:48.367730 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:50:48.395999 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:48.395929 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" podStartSLOduration=1.6040580169999998 podStartE2EDuration="4.395903845s" totalImagesPullingTime="2.791845828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:50:48.391845175 +0000 UTC m=+535.559883905" watchObservedRunningTime="2026-06-10 20:50:48.395903845 +0000 UTC m=+535.563942575" Jun 10 20:50:49.378491 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:50:49.378460 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-p2n4x" Jun 10 20:51:40.029780 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.029742 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v"] Jun 10 20:51:40.047935 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.047892 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v"] Jun 10 20:51:40.048139 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.047999 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" Jun 10 20:51:40.051243 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.051218 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 20:51:40.051390 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.051339 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xmmbv\"" Jun 10 20:51:40.052824 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.052804 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 20:51:40.162093 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.162038 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/412152d5-046d-4325-bbf6-0ddf3c2b46e0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v\" (UID: \"412152d5-046d-4325-bbf6-0ddf3c2b46e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" Jun 10 20:51:40.162279 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.162187 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8765b\" (UniqueName: \"kubernetes.io/projected/412152d5-046d-4325-bbf6-0ddf3c2b46e0-kube-api-access-8765b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v\" (UID: \"412152d5-046d-4325-bbf6-0ddf3c2b46e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" Jun 10 20:51:40.162279 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.162223 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/412152d5-046d-4325-bbf6-0ddf3c2b46e0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v\" (UID: \"412152d5-046d-4325-bbf6-0ddf3c2b46e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" Jun 10 20:51:40.263179 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.263137 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/412152d5-046d-4325-bbf6-0ddf3c2b46e0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v\" (UID: \"412152d5-046d-4325-bbf6-0ddf3c2b46e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" Jun 10 20:51:40.263352 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.263189 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/412152d5-046d-4325-bbf6-0ddf3c2b46e0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v\" (UID: \"412152d5-046d-4325-bbf6-0ddf3c2b46e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" Jun 10 20:51:40.263352 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.263267 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8765b\" (UniqueName: \"kubernetes.io/projected/412152d5-046d-4325-bbf6-0ddf3c2b46e0-kube-api-access-8765b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v\" (UID: \"412152d5-046d-4325-bbf6-0ddf3c2b46e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" Jun 10 20:51:40.263536 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.263515 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/412152d5-046d-4325-bbf6-0ddf3c2b46e0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v\" (UID: \"412152d5-046d-4325-bbf6-0ddf3c2b46e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" Jun 10 20:51:40.263575 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.263540 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/412152d5-046d-4325-bbf6-0ddf3c2b46e0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v\" (UID: \"412152d5-046d-4325-bbf6-0ddf3c2b46e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" Jun 10 20:51:40.273804 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.273770 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8765b\" (UniqueName: \"kubernetes.io/projected/412152d5-046d-4325-bbf6-0ddf3c2b46e0-kube-api-access-8765b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v\" (UID: \"412152d5-046d-4325-bbf6-0ddf3c2b46e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" Jun 10 20:51:40.358257 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.358161 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" Jun 10 20:51:40.503138 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.503115 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v"] Jun 10 20:51:40.505232 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:51:40.505202 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod412152d5_046d_4325_bbf6_0ddf3c2b46e0.slice/crio-d8895b76257a41461283130b734b44215c27bf1b7242dea32d9f5061d51c1772 WatchSource:0}: Error finding container d8895b76257a41461283130b734b44215c27bf1b7242dea32d9f5061d51c1772: Status 404 returned error can't find the container with id d8895b76257a41461283130b734b44215c27bf1b7242dea32d9f5061d51c1772 Jun 10 20:51:40.629618 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.629583 2554 generic.go:356] "Generic (PLEG): container finished" podID="412152d5-046d-4325-bbf6-0ddf3c2b46e0" containerID="30027f4fa5625835be1cb751e9193623f95dc84fdfcb6487003593094c0cb164" exitCode=0 Jun 10 20:51:40.629775 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.629669 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" event={"ID":"412152d5-046d-4325-bbf6-0ddf3c2b46e0","Type":"ContainerDied","Data":"30027f4fa5625835be1cb751e9193623f95dc84fdfcb6487003593094c0cb164"} Jun 10 20:51:40.629775 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:40.629730 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" event={"ID":"412152d5-046d-4325-bbf6-0ddf3c2b46e0","Type":"ContainerStarted","Data":"d8895b76257a41461283130b734b44215c27bf1b7242dea32d9f5061d51c1772"} Jun 10 20:51:41.637611 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:41.637516 2554 generic.go:356] "Generic (PLEG): container finished" podID="412152d5-046d-4325-bbf6-0ddf3c2b46e0" containerID="500539b3cb32710f9ebcacfba6639ab675fa5e0adf2658fd8af42cc36b7f5f7b" exitCode=0 Jun 10 20:51:41.638002 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:41.637603 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" event={"ID":"412152d5-046d-4325-bbf6-0ddf3c2b46e0","Type":"ContainerDied","Data":"500539b3cb32710f9ebcacfba6639ab675fa5e0adf2658fd8af42cc36b7f5f7b"} Jun 10 20:51:42.289509 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:42.289468 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-784c948489-b54nb"] Jun 10 20:51:42.645314 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:42.645217 2554 generic.go:356] "Generic (PLEG): container finished" podID="412152d5-046d-4325-bbf6-0ddf3c2b46e0" containerID="1928ad86790dbb6065cdf8d8309feffce4cb4637993af3d1ef28505c87a5a4c3" exitCode=0 Jun 10 20:51:42.645674 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:42.645303 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" event={"ID":"412152d5-046d-4325-bbf6-0ddf3c2b46e0","Type":"ContainerDied","Data":"1928ad86790dbb6065cdf8d8309feffce4cb4637993af3d1ef28505c87a5a4c3"} Jun 10 20:51:43.782665 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:43.782635 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" Jun 10 20:51:43.896095 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:43.896056 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/412152d5-046d-4325-bbf6-0ddf3c2b46e0-util\") pod \"412152d5-046d-4325-bbf6-0ddf3c2b46e0\" (UID: \"412152d5-046d-4325-bbf6-0ddf3c2b46e0\") " Jun 10 20:51:43.896244 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:43.896175 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/412152d5-046d-4325-bbf6-0ddf3c2b46e0-bundle\") pod \"412152d5-046d-4325-bbf6-0ddf3c2b46e0\" (UID: \"412152d5-046d-4325-bbf6-0ddf3c2b46e0\") " Jun 10 20:51:43.896244 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:43.896200 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8765b\" (UniqueName: \"kubernetes.io/projected/412152d5-046d-4325-bbf6-0ddf3c2b46e0-kube-api-access-8765b\") pod \"412152d5-046d-4325-bbf6-0ddf3c2b46e0\" (UID: \"412152d5-046d-4325-bbf6-0ddf3c2b46e0\") " Jun 10 20:51:43.896673 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:43.896640 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/412152d5-046d-4325-bbf6-0ddf3c2b46e0-bundle" (OuterVolumeSpecName: "bundle") pod "412152d5-046d-4325-bbf6-0ddf3c2b46e0" (UID: "412152d5-046d-4325-bbf6-0ddf3c2b46e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:51:43.898513 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:43.898486 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/412152d5-046d-4325-bbf6-0ddf3c2b46e0-kube-api-access-8765b" (OuterVolumeSpecName: "kube-api-access-8765b") pod "412152d5-046d-4325-bbf6-0ddf3c2b46e0" (UID: "412152d5-046d-4325-bbf6-0ddf3c2b46e0"). InnerVolumeSpecName "kube-api-access-8765b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:51:43.901855 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:43.901781 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/412152d5-046d-4325-bbf6-0ddf3c2b46e0-util" (OuterVolumeSpecName: "util") pod "412152d5-046d-4325-bbf6-0ddf3c2b46e0" (UID: "412152d5-046d-4325-bbf6-0ddf3c2b46e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:51:43.997740 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:43.997702 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/412152d5-046d-4325-bbf6-0ddf3c2b46e0-bundle\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:51:43.997740 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:43.997733 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8765b\" (UniqueName: \"kubernetes.io/projected/412152d5-046d-4325-bbf6-0ddf3c2b46e0-kube-api-access-8765b\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:51:43.997740 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:43.997745 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/412152d5-046d-4325-bbf6-0ddf3c2b46e0-util\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:51:44.657576 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:44.657534 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" event={"ID":"412152d5-046d-4325-bbf6-0ddf3c2b46e0","Type":"ContainerDied","Data":"d8895b76257a41461283130b734b44215c27bf1b7242dea32d9f5061d51c1772"} Jun 10 20:51:44.657576 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:44.657555 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v" Jun 10 20:51:44.657576 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:44.657582 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8895b76257a41461283130b734b44215c27bf1b7242dea32d9f5061d51c1772" Jun 10 20:51:53.236736 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:53.236708 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 20:51:53.237328 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:53.236827 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 20:51:53.243367 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:53.243340 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 20:51:53.243620 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:51:53.243594 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 20:52:07.317225 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.317182 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-784c948489-b54nb" podUID="7c713261-fcda-4363-b218-e134b129deb3" containerName="console" containerID="cri-o://18c99e43f2046fdbf25967c3d7a2522dcfb0d3f19f9d9142f87ae0ee05d31934" gracePeriod=15 Jun 10 20:52:07.579648 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.579589 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784c948489-b54nb" Jun 10 20:52:07.626490 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.626464 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c713261-fcda-4363-b218-e134b129deb3-console-serving-cert\") pod \"7c713261-fcda-4363-b218-e134b129deb3\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " Jun 10 20:52:07.626490 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.626499 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-service-ca\") pod \"7c713261-fcda-4363-b218-e134b129deb3\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " Jun 10 20:52:07.626897 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.626521 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-trusted-ca-bundle\") pod \"7c713261-fcda-4363-b218-e134b129deb3\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " Jun 10 20:52:07.626897 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.626552 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-oauth-serving-cert\") pod \"7c713261-fcda-4363-b218-e134b129deb3\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " Jun 10 20:52:07.626897 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.626630 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-console-config\") pod \"7c713261-fcda-4363-b218-e134b129deb3\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " Jun 10 20:52:07.626897 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.626689 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c713261-fcda-4363-b218-e134b129deb3-console-oauth-config\") pod \"7c713261-fcda-4363-b218-e134b129deb3\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " Jun 10 20:52:07.626897 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.626746 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57m9h\" (UniqueName: \"kubernetes.io/projected/7c713261-fcda-4363-b218-e134b129deb3-kube-api-access-57m9h\") pod \"7c713261-fcda-4363-b218-e134b129deb3\" (UID: \"7c713261-fcda-4363-b218-e134b129deb3\") " Jun 10 20:52:07.627178 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.627054 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7c713261-fcda-4363-b218-e134b129deb3" (UID: "7c713261-fcda-4363-b218-e134b129deb3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:52:07.627178 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.627064 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7c713261-fcda-4363-b218-e134b129deb3" (UID: "7c713261-fcda-4363-b218-e134b129deb3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:52:07.627178 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.627109 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-console-config" (OuterVolumeSpecName: "console-config") pod "7c713261-fcda-4363-b218-e134b129deb3" (UID: "7c713261-fcda-4363-b218-e134b129deb3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:52:07.627341 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.627266 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-service-ca" (OuterVolumeSpecName: "service-ca") pod "7c713261-fcda-4363-b218-e134b129deb3" (UID: "7c713261-fcda-4363-b218-e134b129deb3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:52:07.628747 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.628718 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c713261-fcda-4363-b218-e134b129deb3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7c713261-fcda-4363-b218-e134b129deb3" (UID: "7c713261-fcda-4363-b218-e134b129deb3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:52:07.628857 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.628827 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c713261-fcda-4363-b218-e134b129deb3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7c713261-fcda-4363-b218-e134b129deb3" (UID: "7c713261-fcda-4363-b218-e134b129deb3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:52:07.629067 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.629045 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c713261-fcda-4363-b218-e134b129deb3-kube-api-access-57m9h" (OuterVolumeSpecName: "kube-api-access-57m9h") pod "7c713261-fcda-4363-b218-e134b129deb3" (UID: "7c713261-fcda-4363-b218-e134b129deb3"). InnerVolumeSpecName "kube-api-access-57m9h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:52:07.727636 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.727596 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c713261-fcda-4363-b218-e134b129deb3-console-oauth-config\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:52:07.727636 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.727626 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57m9h\" (UniqueName: \"kubernetes.io/projected/7c713261-fcda-4363-b218-e134b129deb3-kube-api-access-57m9h\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:52:07.727636 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.727635 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c713261-fcda-4363-b218-e134b129deb3-console-serving-cert\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:52:07.727636 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.727646 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-service-ca\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:52:07.727932 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.727655 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-trusted-ca-bundle\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:52:07.727932 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.727663 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-oauth-serving-cert\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:52:07.727932 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.727672 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c713261-fcda-4363-b218-e134b129deb3-console-config\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:52:07.780144 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.780109 2554 generic.go:356] "Generic (PLEG): container finished" podID="7c713261-fcda-4363-b218-e134b129deb3" containerID="18c99e43f2046fdbf25967c3d7a2522dcfb0d3f19f9d9142f87ae0ee05d31934" exitCode=0 Jun 10 20:52:07.780313 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.780157 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784c948489-b54nb" Jun 10 20:52:07.780313 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.780193 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784c948489-b54nb" event={"ID":"7c713261-fcda-4363-b218-e134b129deb3","Type":"ContainerDied","Data":"18c99e43f2046fdbf25967c3d7a2522dcfb0d3f19f9d9142f87ae0ee05d31934"} Jun 10 20:52:07.780313 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.780246 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784c948489-b54nb" event={"ID":"7c713261-fcda-4363-b218-e134b129deb3","Type":"ContainerDied","Data":"ec9fc4ea031c01aed326e5ccee0fda1001f8186c78d4d56b74dd06b6c3411106"} Jun 10 20:52:07.780313 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.780269 2554 scope.go:117] "RemoveContainer" containerID="18c99e43f2046fdbf25967c3d7a2522dcfb0d3f19f9d9142f87ae0ee05d31934" Jun 10 20:52:07.790313 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.790296 2554 scope.go:117] "RemoveContainer" containerID="18c99e43f2046fdbf25967c3d7a2522dcfb0d3f19f9d9142f87ae0ee05d31934" Jun 10 20:52:07.790576 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:52:07.790556 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18c99e43f2046fdbf25967c3d7a2522dcfb0d3f19f9d9142f87ae0ee05d31934\": container with ID starting with 18c99e43f2046fdbf25967c3d7a2522dcfb0d3f19f9d9142f87ae0ee05d31934 not found: ID does not exist" containerID="18c99e43f2046fdbf25967c3d7a2522dcfb0d3f19f9d9142f87ae0ee05d31934" Jun 10 20:52:07.790638 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.790584 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18c99e43f2046fdbf25967c3d7a2522dcfb0d3f19f9d9142f87ae0ee05d31934"} err="failed to get container status \"18c99e43f2046fdbf25967c3d7a2522dcfb0d3f19f9d9142f87ae0ee05d31934\": rpc error: code = NotFound desc = could not find container \"18c99e43f2046fdbf25967c3d7a2522dcfb0d3f19f9d9142f87ae0ee05d31934\": container with ID starting with 18c99e43f2046fdbf25967c3d7a2522dcfb0d3f19f9d9142f87ae0ee05d31934 not found: ID does not exist" Jun 10 20:52:07.805761 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.805729 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-784c948489-b54nb"] Jun 10 20:52:07.813732 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:07.813700 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-784c948489-b54nb"] Jun 10 20:52:09.254050 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:09.253992 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c713261-fcda-4363-b218-e134b129deb3" path="/var/lib/kubelet/pods/7c713261-fcda-4363-b218-e134b129deb3/volumes" Jun 10 20:52:28.720400 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.720308 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58"] Jun 10 20:52:28.720848 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.720670 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="412152d5-046d-4325-bbf6-0ddf3c2b46e0" containerName="extract" Jun 10 20:52:28.720848 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.720681 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="412152d5-046d-4325-bbf6-0ddf3c2b46e0" containerName="extract" Jun 10 20:52:28.720848 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.720699 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="412152d5-046d-4325-bbf6-0ddf3c2b46e0" containerName="util" Jun 10 20:52:28.720848 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.720704 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="412152d5-046d-4325-bbf6-0ddf3c2b46e0" containerName="util" Jun 10 20:52:28.720848 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.720712 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="412152d5-046d-4325-bbf6-0ddf3c2b46e0" containerName="pull" Jun 10 20:52:28.720848 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.720717 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="412152d5-046d-4325-bbf6-0ddf3c2b46e0" containerName="pull" Jun 10 20:52:28.720848 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.720725 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c713261-fcda-4363-b218-e134b129deb3" containerName="console" Jun 10 20:52:28.720848 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.720731 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c713261-fcda-4363-b218-e134b129deb3" containerName="console" Jun 10 20:52:28.720848 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.720783 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="412152d5-046d-4325-bbf6-0ddf3c2b46e0" containerName="extract" Jun 10 20:52:28.720848 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.720794 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c713261-fcda-4363-b218-e134b129deb3" containerName="console" Jun 10 20:52:28.723757 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.723740 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58" Jun 10 20:52:28.726885 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.726854 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 20:52:28.727095 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.727079 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f4ktb\"" Jun 10 20:52:28.727151 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.727079 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 20:52:28.735616 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.735587 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58"] Jun 10 20:52:28.828390 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.828348 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl9kj\" (UniqueName: \"kubernetes.io/projected/9c4b70ab-92d7-43a5-9161-64157564f8a7-kube-api-access-gl9kj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cxk58\" (UID: \"9c4b70ab-92d7-43a5-9161-64157564f8a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58" Jun 10 20:52:28.828573 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.828420 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c4b70ab-92d7-43a5-9161-64157564f8a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cxk58\" (UID: \"9c4b70ab-92d7-43a5-9161-64157564f8a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58" Jun 10 20:52:28.929655 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.929609 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl9kj\" (UniqueName: \"kubernetes.io/projected/9c4b70ab-92d7-43a5-9161-64157564f8a7-kube-api-access-gl9kj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cxk58\" (UID: \"9c4b70ab-92d7-43a5-9161-64157564f8a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58" Jun 10 20:52:28.929853 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.929675 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c4b70ab-92d7-43a5-9161-64157564f8a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cxk58\" (UID: \"9c4b70ab-92d7-43a5-9161-64157564f8a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58" Jun 10 20:52:28.930099 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.930077 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c4b70ab-92d7-43a5-9161-64157564f8a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cxk58\" (UID: \"9c4b70ab-92d7-43a5-9161-64157564f8a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58" Jun 10 20:52:28.939869 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:28.939848 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl9kj\" (UniqueName: \"kubernetes.io/projected/9c4b70ab-92d7-43a5-9161-64157564f8a7-kube-api-access-gl9kj\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cxk58\" (UID: \"9c4b70ab-92d7-43a5-9161-64157564f8a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58" Jun 10 20:52:29.034779 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:29.034686 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58" Jun 10 20:52:29.178320 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:29.178296 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58"] Jun 10 20:52:29.180480 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:52:29.180450 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4b70ab_92d7_43a5_9161_64157564f8a7.slice/crio-ac1d4558aa821255d4742624e97ee021b323d5636443134e490253d5e8957d2a WatchSource:0}: Error finding container ac1d4558aa821255d4742624e97ee021b323d5636443134e490253d5e8957d2a: Status 404 returned error can't find the container with id ac1d4558aa821255d4742624e97ee021b323d5636443134e490253d5e8957d2a Jun 10 20:52:29.595465 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:29.595431 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58"] Jun 10 20:52:29.600198 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:29.600163 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58"] Jun 10 20:52:29.624364 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:29.624335 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx"] Jun 10 20:52:29.627541 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:29.627523 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" Jun 10 20:52:29.642907 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:29.642877 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx"] Jun 10 20:52:29.736461 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:29.736394 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92762f60-94d3-4a7f-9d68-b87a2b1110fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z8wtx\" (UID: \"92762f60-94d3-4a7f-9d68-b87a2b1110fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" Jun 10 20:52:29.736824 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:29.736523 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st4sx\" (UniqueName: \"kubernetes.io/projected/92762f60-94d3-4a7f-9d68-b87a2b1110fd-kube-api-access-st4sx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z8wtx\" (UID: \"92762f60-94d3-4a7f-9d68-b87a2b1110fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" Jun 10 20:52:29.837481 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:29.837440 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st4sx\" (UniqueName: \"kubernetes.io/projected/92762f60-94d3-4a7f-9d68-b87a2b1110fd-kube-api-access-st4sx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z8wtx\" (UID: \"92762f60-94d3-4a7f-9d68-b87a2b1110fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" Jun 10 20:52:29.837651 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:29.837539 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92762f60-94d3-4a7f-9d68-b87a2b1110fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z8wtx\" (UID: \"92762f60-94d3-4a7f-9d68-b87a2b1110fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" Jun 10 20:52:29.837892 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:29.837875 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92762f60-94d3-4a7f-9d68-b87a2b1110fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z8wtx\" (UID: \"92762f60-94d3-4a7f-9d68-b87a2b1110fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" Jun 10 20:52:29.846424 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:29.846355 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st4sx\" (UniqueName: \"kubernetes.io/projected/92762f60-94d3-4a7f-9d68-b87a2b1110fd-kube-api-access-st4sx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-z8wtx\" (UID: \"92762f60-94d3-4a7f-9d68-b87a2b1110fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" Jun 10 20:52:29.941310 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:29.941273 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" Jun 10 20:52:30.323226 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:30.323192 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx"] Jun 10 20:52:30.332733 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:52:30.332698 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92762f60_94d3_4a7f_9d68_b87a2b1110fd.slice/crio-fae9e610e3b7e7a858de11a3cde683ea51eddc617546c4bed4d6f7c1e2be3e89 WatchSource:0}: Error finding container fae9e610e3b7e7a858de11a3cde683ea51eddc617546c4bed4d6f7c1e2be3e89: Status 404 returned error can't find the container with id fae9e610e3b7e7a858de11a3cde683ea51eddc617546c4bed4d6f7c1e2be3e89 Jun 10 20:52:30.907320 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:30.907279 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" event={"ID":"92762f60-94d3-4a7f-9d68-b87a2b1110fd","Type":"ContainerStarted","Data":"fae9e610e3b7e7a858de11a3cde683ea51eddc617546c4bed4d6f7c1e2be3e89"} Jun 10 20:52:33.927673 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:33.927568 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" event={"ID":"92762f60-94d3-4a7f-9d68-b87a2b1110fd","Type":"ContainerStarted","Data":"1aabf86d03ce58ec14becb7f5de5694a79843b5d49aebfea228aff2f70584ffa"} Jun 10 20:52:33.928128 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:33.927782 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" Jun 10 20:52:33.929420 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:33.929378 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58" podUID="9c4b70ab-92d7-43a5-9161-64157564f8a7" containerName="manager" containerID="cri-o://f3476aecb4813c02a72c1d377702f273acd445fdd66afd6d33132527ede41656" gracePeriod=2 Jun 10 20:52:33.949285 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:33.949235 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" podStartSLOduration=1.7867616979999998 podStartE2EDuration="4.949219252s" totalImagesPullingTime="3.162457554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:52:33.946792947 +0000 UTC m=+641.114831697" watchObservedRunningTime="2026-06-10 20:52:33.949219252 +0000 UTC m=+641.117258048" Jun 10 20:52:33.949397 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:52:33.949252 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-cxk58\" is forbidden: User \"system:node:ip-10-0-140-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-84.ec2.internal' and this object" podUID="9c4b70ab-92d7-43a5-9161-64157564f8a7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58" Jun 10 20:52:34.178337 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:34.178274 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58" Jun 10 20:52:34.181217 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:52:34.181187 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-cxk58\" is forbidden: User \"system:node:ip-10-0-140-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-84.ec2.internal' and this object" podUID="9c4b70ab-92d7-43a5-9161-64157564f8a7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58" Jun 10 20:52:34.283637 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:34.283599 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl9kj\" (UniqueName: \"kubernetes.io/projected/9c4b70ab-92d7-43a5-9161-64157564f8a7-kube-api-access-gl9kj\") pod \"9c4b70ab-92d7-43a5-9161-64157564f8a7\" (UID: \"9c4b70ab-92d7-43a5-9161-64157564f8a7\") " Jun 10 20:52:34.283827 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:34.283693 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c4b70ab-92d7-43a5-9161-64157564f8a7-extensions-socket-volume\") pod \"9c4b70ab-92d7-43a5-9161-64157564f8a7\" (UID: \"9c4b70ab-92d7-43a5-9161-64157564f8a7\") " Jun 10 20:52:34.283991 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:34.283966 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c4b70ab-92d7-43a5-9161-64157564f8a7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9c4b70ab-92d7-43a5-9161-64157564f8a7" (UID: "9c4b70ab-92d7-43a5-9161-64157564f8a7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:52:34.285746 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:34.285724 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c4b70ab-92d7-43a5-9161-64157564f8a7-kube-api-access-gl9kj" (OuterVolumeSpecName: "kube-api-access-gl9kj") pod "9c4b70ab-92d7-43a5-9161-64157564f8a7" (UID: "9c4b70ab-92d7-43a5-9161-64157564f8a7"). InnerVolumeSpecName "kube-api-access-gl9kj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:52:34.384743 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:34.384709 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl9kj\" (UniqueName: \"kubernetes.io/projected/9c4b70ab-92d7-43a5-9161-64157564f8a7-kube-api-access-gl9kj\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:52:34.384743 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:34.384736 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c4b70ab-92d7-43a5-9161-64157564f8a7-extensions-socket-volume\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:52:34.935810 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:34.935715 2554 generic.go:356] "Generic (PLEG): container finished" podID="9c4b70ab-92d7-43a5-9161-64157564f8a7" containerID="f3476aecb4813c02a72c1d377702f273acd445fdd66afd6d33132527ede41656" exitCode=2 Jun 10 20:52:34.935810 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:34.935758 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58" Jun 10 20:52:34.936332 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:34.935818 2554 scope.go:117] "RemoveContainer" containerID="f3476aecb4813c02a72c1d377702f273acd445fdd66afd6d33132527ede41656" Jun 10 20:52:34.938849 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:52:34.938819 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-cxk58\" is forbidden: User \"system:node:ip-10-0-140-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-84.ec2.internal' and this object" podUID="9c4b70ab-92d7-43a5-9161-64157564f8a7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58" Jun 10 20:52:34.945519 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:34.945500 2554 scope.go:117] "RemoveContainer" containerID="f3476aecb4813c02a72c1d377702f273acd445fdd66afd6d33132527ede41656" Jun 10 20:52:34.945825 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:52:34.945805 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3476aecb4813c02a72c1d377702f273acd445fdd66afd6d33132527ede41656\": container with ID starting with f3476aecb4813c02a72c1d377702f273acd445fdd66afd6d33132527ede41656 not found: ID does not exist" containerID="f3476aecb4813c02a72c1d377702f273acd445fdd66afd6d33132527ede41656" Jun 10 20:52:34.945873 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:34.945834 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3476aecb4813c02a72c1d377702f273acd445fdd66afd6d33132527ede41656"} err="failed to get container status \"f3476aecb4813c02a72c1d377702f273acd445fdd66afd6d33132527ede41656\": rpc error: code = NotFound desc = could not find container \"f3476aecb4813c02a72c1d377702f273acd445fdd66afd6d33132527ede41656\": container with ID starting with f3476aecb4813c02a72c1d377702f273acd445fdd66afd6d33132527ede41656 not found: ID does not exist" Jun 10 20:52:34.946571 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:52:34.946548 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-cxk58\" is forbidden: User \"system:node:ip-10-0-140-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-84.ec2.internal' and this object" podUID="9c4b70ab-92d7-43a5-9161-64157564f8a7" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cxk58" Jun 10 20:52:35.254201 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:35.254166 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c4b70ab-92d7-43a5-9161-64157564f8a7" path="/var/lib/kubelet/pods/9c4b70ab-92d7-43a5-9161-64157564f8a7/volumes" Jun 10 20:52:44.938255 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:44.938219 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" Jun 10 20:52:57.072839 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:57.072794 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx"] Jun 10 20:52:57.073277 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:57.072989 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" podUID="92762f60-94d3-4a7f-9d68-b87a2b1110fd" containerName="manager" containerID="cri-o://1aabf86d03ce58ec14becb7f5de5694a79843b5d49aebfea228aff2f70584ffa" gracePeriod=10 Jun 10 20:52:57.331565 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:57.331494 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" Jun 10 20:52:57.385792 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:57.385753 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92762f60-94d3-4a7f-9d68-b87a2b1110fd-extensions-socket-volume\") pod \"92762f60-94d3-4a7f-9d68-b87a2b1110fd\" (UID: \"92762f60-94d3-4a7f-9d68-b87a2b1110fd\") " Jun 10 20:52:57.385999 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:57.385848 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st4sx\" (UniqueName: \"kubernetes.io/projected/92762f60-94d3-4a7f-9d68-b87a2b1110fd-kube-api-access-st4sx\") pod \"92762f60-94d3-4a7f-9d68-b87a2b1110fd\" (UID: \"92762f60-94d3-4a7f-9d68-b87a2b1110fd\") " Jun 10 20:52:57.386151 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:57.386127 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92762f60-94d3-4a7f-9d68-b87a2b1110fd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "92762f60-94d3-4a7f-9d68-b87a2b1110fd" (UID: "92762f60-94d3-4a7f-9d68-b87a2b1110fd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:52:57.387957 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:57.387932 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92762f60-94d3-4a7f-9d68-b87a2b1110fd-kube-api-access-st4sx" (OuterVolumeSpecName: "kube-api-access-st4sx") pod "92762f60-94d3-4a7f-9d68-b87a2b1110fd" (UID: "92762f60-94d3-4a7f-9d68-b87a2b1110fd"). InnerVolumeSpecName "kube-api-access-st4sx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:52:57.486648 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:57.486607 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92762f60-94d3-4a7f-9d68-b87a2b1110fd-extensions-socket-volume\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:52:57.486648 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:57.486643 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st4sx\" (UniqueName: \"kubernetes.io/projected/92762f60-94d3-4a7f-9d68-b87a2b1110fd-kube-api-access-st4sx\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:52:58.060400 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:58.060362 2554 generic.go:356] "Generic (PLEG): container finished" podID="92762f60-94d3-4a7f-9d68-b87a2b1110fd" containerID="1aabf86d03ce58ec14becb7f5de5694a79843b5d49aebfea228aff2f70584ffa" exitCode=0 Jun 10 20:52:58.060586 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:58.060412 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" Jun 10 20:52:58.060586 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:58.060449 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" event={"ID":"92762f60-94d3-4a7f-9d68-b87a2b1110fd","Type":"ContainerDied","Data":"1aabf86d03ce58ec14becb7f5de5694a79843b5d49aebfea228aff2f70584ffa"} Jun 10 20:52:58.060586 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:58.060505 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx" event={"ID":"92762f60-94d3-4a7f-9d68-b87a2b1110fd","Type":"ContainerDied","Data":"fae9e610e3b7e7a858de11a3cde683ea51eddc617546c4bed4d6f7c1e2be3e89"} Jun 10 20:52:58.060586 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:58.060527 2554 scope.go:117] "RemoveContainer" containerID="1aabf86d03ce58ec14becb7f5de5694a79843b5d49aebfea228aff2f70584ffa" Jun 10 20:52:58.070596 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:58.070576 2554 scope.go:117] "RemoveContainer" containerID="1aabf86d03ce58ec14becb7f5de5694a79843b5d49aebfea228aff2f70584ffa" Jun 10 20:52:58.070884 ip-10-0-140-84 kubenswrapper[2554]: E0610 20:52:58.070865 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aabf86d03ce58ec14becb7f5de5694a79843b5d49aebfea228aff2f70584ffa\": container with ID starting with 1aabf86d03ce58ec14becb7f5de5694a79843b5d49aebfea228aff2f70584ffa not found: ID does not exist" containerID="1aabf86d03ce58ec14becb7f5de5694a79843b5d49aebfea228aff2f70584ffa" Jun 10 20:52:58.070959 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:58.070892 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aabf86d03ce58ec14becb7f5de5694a79843b5d49aebfea228aff2f70584ffa"} err="failed to get container status \"1aabf86d03ce58ec14becb7f5de5694a79843b5d49aebfea228aff2f70584ffa\": rpc error: code = NotFound desc = could not find container \"1aabf86d03ce58ec14becb7f5de5694a79843b5d49aebfea228aff2f70584ffa\": container with ID starting with 1aabf86d03ce58ec14becb7f5de5694a79843b5d49aebfea228aff2f70584ffa not found: ID does not exist" Jun 10 20:52:58.088043 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:58.087994 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx"] Jun 10 20:52:58.092270 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:58.092244 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-z8wtx"] Jun 10 20:52:59.253284 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:52:59.253252 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92762f60-94d3-4a7f-9d68-b87a2b1110fd" path="/var/lib/kubelet/pods/92762f60-94d3-4a7f-9d68-b87a2b1110fd/volumes" Jun 10 20:53:13.796029 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:13.795968 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-khjwv"] Jun 10 20:53:13.796487 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:13.796344 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c4b70ab-92d7-43a5-9161-64157564f8a7" containerName="manager" Jun 10 20:53:13.796487 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:13.796355 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c4b70ab-92d7-43a5-9161-64157564f8a7" containerName="manager" Jun 10 20:53:13.796487 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:13.796366 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92762f60-94d3-4a7f-9d68-b87a2b1110fd" containerName="manager" Jun 10 20:53:13.796487 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:13.796372 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="92762f60-94d3-4a7f-9d68-b87a2b1110fd" containerName="manager" Jun 10 20:53:13.796487 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:13.796428 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c4b70ab-92d7-43a5-9161-64157564f8a7" containerName="manager" Jun 10 20:53:13.796487 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:13.796441 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="92762f60-94d3-4a7f-9d68-b87a2b1110fd" containerName="manager" Jun 10 20:53:13.800434 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:13.800416 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" Jun 10 20:53:13.803673 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:13.803620 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 20:53:13.803841 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:13.803693 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 20:53:13.805152 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:13.805121 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 20:53:13.805250 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:13.805152 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xmmbv\"" Jun 10 20:53:13.807544 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:13.807522 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-khjwv"] Jun 10 20:53:13.890850 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:13.890811 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-khjwv"] Jun 10 20:53:13.945937 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:13.945898 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e579e42-17ec-49ec-8ba3-da6e0c8415b0-config-file\") pod \"limitador-limitador-64c94fd64f-khjwv\" (UID: \"9e579e42-17ec-49ec-8ba3-da6e0c8415b0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" Jun 10 20:53:13.946138 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:13.945957 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbw48\" (UniqueName: \"kubernetes.io/projected/9e579e42-17ec-49ec-8ba3-da6e0c8415b0-kube-api-access-sbw48\") pod \"limitador-limitador-64c94fd64f-khjwv\" (UID: \"9e579e42-17ec-49ec-8ba3-da6e0c8415b0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" Jun 10 20:53:14.047387 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:14.047307 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbw48\" (UniqueName: \"kubernetes.io/projected/9e579e42-17ec-49ec-8ba3-da6e0c8415b0-kube-api-access-sbw48\") pod \"limitador-limitador-64c94fd64f-khjwv\" (UID: \"9e579e42-17ec-49ec-8ba3-da6e0c8415b0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" Jun 10 20:53:14.047536 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:14.047417 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e579e42-17ec-49ec-8ba3-da6e0c8415b0-config-file\") pod \"limitador-limitador-64c94fd64f-khjwv\" (UID: \"9e579e42-17ec-49ec-8ba3-da6e0c8415b0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" Jun 10 20:53:14.048117 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:14.048098 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e579e42-17ec-49ec-8ba3-da6e0c8415b0-config-file\") pod \"limitador-limitador-64c94fd64f-khjwv\" (UID: \"9e579e42-17ec-49ec-8ba3-da6e0c8415b0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" Jun 10 20:53:14.060916 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:14.060884 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbw48\" (UniqueName: \"kubernetes.io/projected/9e579e42-17ec-49ec-8ba3-da6e0c8415b0-kube-api-access-sbw48\") pod \"limitador-limitador-64c94fd64f-khjwv\" (UID: \"9e579e42-17ec-49ec-8ba3-da6e0c8415b0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" Jun 10 20:53:14.111816 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:14.111775 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" Jun 10 20:53:14.245101 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:14.245075 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-khjwv"] Jun 10 20:53:14.247198 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:53:14.247172 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e579e42_17ec_49ec_8ba3_da6e0c8415b0.slice/crio-2c493e60c1649694fd7c63ec7e4ac7bb9c15782e8b341880a2ff59509f80d2ca WatchSource:0}: Error finding container 2c493e60c1649694fd7c63ec7e4ac7bb9c15782e8b341880a2ff59509f80d2ca: Status 404 returned error can't find the container with id 2c493e60c1649694fd7c63ec7e4ac7bb9c15782e8b341880a2ff59509f80d2ca Jun 10 20:53:15.156743 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:15.156702 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" event={"ID":"9e579e42-17ec-49ec-8ba3-da6e0c8415b0","Type":"ContainerStarted","Data":"2c493e60c1649694fd7c63ec7e4ac7bb9c15782e8b341880a2ff59509f80d2ca"} Jun 10 20:53:17.168383 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:17.168278 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" event={"ID":"9e579e42-17ec-49ec-8ba3-da6e0c8415b0","Type":"ContainerStarted","Data":"014388fd68d4d09d333bcd1a2b1300c8effe37a3438e8cfbdca9a922f664f509"} Jun 10 20:53:17.168383 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:17.168344 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" Jun 10 20:53:17.191948 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:17.191889 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" podStartSLOduration=1.5316180959999999 podStartE2EDuration="4.191872842s" totalImagesPullingTime="2.660254746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:53:17.18899695 +0000 UTC m=+684.357035683" watchObservedRunningTime="2026-06-10 20:53:17.191872842 +0000 UTC m=+684.359911597" Jun 10 20:53:28.181563 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:28.181530 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" Jun 10 20:53:30.731401 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:30.731358 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-khjwv"] Jun 10 20:53:30.731863 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:30.731571 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" podUID="9e579e42-17ec-49ec-8ba3-da6e0c8415b0" containerName="limitador" containerID="cri-o://014388fd68d4d09d333bcd1a2b1300c8effe37a3438e8cfbdca9a922f664f509" gracePeriod=30 Jun 10 20:53:31.246619 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:31.246585 2554 generic.go:356] "Generic (PLEG): container finished" podID="9e579e42-17ec-49ec-8ba3-da6e0c8415b0" containerID="014388fd68d4d09d333bcd1a2b1300c8effe37a3438e8cfbdca9a922f664f509" exitCode=0 Jun 10 20:53:31.246833 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:31.246659 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" event={"ID":"9e579e42-17ec-49ec-8ba3-da6e0c8415b0","Type":"ContainerDied","Data":"014388fd68d4d09d333bcd1a2b1300c8effe37a3438e8cfbdca9a922f664f509"} Jun 10 20:53:31.282302 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:31.282273 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" Jun 10 20:53:31.299939 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:31.299836 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e579e42-17ec-49ec-8ba3-da6e0c8415b0-config-file\") pod \"9e579e42-17ec-49ec-8ba3-da6e0c8415b0\" (UID: \"9e579e42-17ec-49ec-8ba3-da6e0c8415b0\") " Jun 10 20:53:31.299939 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:31.299885 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbw48\" (UniqueName: \"kubernetes.io/projected/9e579e42-17ec-49ec-8ba3-da6e0c8415b0-kube-api-access-sbw48\") pod \"9e579e42-17ec-49ec-8ba3-da6e0c8415b0\" (UID: \"9e579e42-17ec-49ec-8ba3-da6e0c8415b0\") " Jun 10 20:53:31.300341 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:31.300301 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e579e42-17ec-49ec-8ba3-da6e0c8415b0-config-file" (OuterVolumeSpecName: "config-file") pod "9e579e42-17ec-49ec-8ba3-da6e0c8415b0" (UID: "9e579e42-17ec-49ec-8ba3-da6e0c8415b0"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:53:31.302724 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:31.302695 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e579e42-17ec-49ec-8ba3-da6e0c8415b0-kube-api-access-sbw48" (OuterVolumeSpecName: "kube-api-access-sbw48") pod "9e579e42-17ec-49ec-8ba3-da6e0c8415b0" (UID: "9e579e42-17ec-49ec-8ba3-da6e0c8415b0"). InnerVolumeSpecName "kube-api-access-sbw48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:53:31.400976 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:31.400940 2554 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e579e42-17ec-49ec-8ba3-da6e0c8415b0-config-file\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:53:31.400976 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:31.400972 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbw48\" (UniqueName: \"kubernetes.io/projected/9e579e42-17ec-49ec-8ba3-da6e0c8415b0-kube-api-access-sbw48\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:53:32.253141 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:32.253113 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" Jun 10 20:53:32.253141 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:32.253125 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-khjwv" event={"ID":"9e579e42-17ec-49ec-8ba3-da6e0c8415b0","Type":"ContainerDied","Data":"2c493e60c1649694fd7c63ec7e4ac7bb9c15782e8b341880a2ff59509f80d2ca"} Jun 10 20:53:32.253598 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:32.253184 2554 scope.go:117] "RemoveContainer" containerID="014388fd68d4d09d333bcd1a2b1300c8effe37a3438e8cfbdca9a922f664f509" Jun 10 20:53:32.276107 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:32.276076 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-khjwv"] Jun 10 20:53:32.279963 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:32.279938 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-khjwv"] Jun 10 20:53:33.253072 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:33.253040 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e579e42-17ec-49ec-8ba3-da6e0c8415b0" path="/var/lib/kubelet/pods/9e579e42-17ec-49ec-8ba3-da6e0c8415b0/volumes" Jun 10 20:53:34.522525 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:34.522491 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-rwggz"] Jun 10 20:53:34.522999 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:34.522840 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e579e42-17ec-49ec-8ba3-da6e0c8415b0" containerName="limitador" Jun 10 20:53:34.522999 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:34.522852 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e579e42-17ec-49ec-8ba3-da6e0c8415b0" containerName="limitador" Jun 10 20:53:34.522999 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:34.522929 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e579e42-17ec-49ec-8ba3-da6e0c8415b0" containerName="limitador" Jun 10 20:53:34.525735 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:34.525712 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-rwggz" Jun 10 20:53:34.528491 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:34.528467 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 10 20:53:34.533088 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:34.533056 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-rwggz"] Jun 10 20:53:34.627225 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:34.627154 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vjrr\" (UniqueName: \"kubernetes.io/projected/1458bfa4-e182-4344-89d0-b486f98f3e8f-kube-api-access-8vjrr\") pod \"postgres-69fb4594cf-rwggz\" (UID: \"1458bfa4-e182-4344-89d0-b486f98f3e8f\") " pod="opendatahub/postgres-69fb4594cf-rwggz" Jun 10 20:53:34.627431 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:34.627319 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1458bfa4-e182-4344-89d0-b486f98f3e8f-data\") pod \"postgres-69fb4594cf-rwggz\" (UID: \"1458bfa4-e182-4344-89d0-b486f98f3e8f\") " pod="opendatahub/postgres-69fb4594cf-rwggz" Jun 10 20:53:34.728611 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:34.728567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1458bfa4-e182-4344-89d0-b486f98f3e8f-data\") pod \"postgres-69fb4594cf-rwggz\" (UID: \"1458bfa4-e182-4344-89d0-b486f98f3e8f\") " pod="opendatahub/postgres-69fb4594cf-rwggz" Jun 10 20:53:34.728803 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:34.728636 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vjrr\" (UniqueName: \"kubernetes.io/projected/1458bfa4-e182-4344-89d0-b486f98f3e8f-kube-api-access-8vjrr\") pod \"postgres-69fb4594cf-rwggz\" (UID: \"1458bfa4-e182-4344-89d0-b486f98f3e8f\") " pod="opendatahub/postgres-69fb4594cf-rwggz" Jun 10 20:53:34.729081 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:34.729061 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1458bfa4-e182-4344-89d0-b486f98f3e8f-data\") pod \"postgres-69fb4594cf-rwggz\" (UID: \"1458bfa4-e182-4344-89d0-b486f98f3e8f\") " pod="opendatahub/postgres-69fb4594cf-rwggz" Jun 10 20:53:34.737714 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:34.737686 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vjrr\" (UniqueName: \"kubernetes.io/projected/1458bfa4-e182-4344-89d0-b486f98f3e8f-kube-api-access-8vjrr\") pod \"postgres-69fb4594cf-rwggz\" (UID: \"1458bfa4-e182-4344-89d0-b486f98f3e8f\") " pod="opendatahub/postgres-69fb4594cf-rwggz" Jun 10 20:53:34.839164 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:34.839067 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-rwggz" Jun 10 20:53:34.973957 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:34.973925 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-rwggz"] Jun 10 20:53:34.976536 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:53:34.976500 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1458bfa4_e182_4344_89d0_b486f98f3e8f.slice/crio-1b7b1aafc63ccd63bd97710e0a3f2d38a2ad1b3bccdb6c987f693c6bdde011cf WatchSource:0}: Error finding container 1b7b1aafc63ccd63bd97710e0a3f2d38a2ad1b3bccdb6c987f693c6bdde011cf: Status 404 returned error can't find the container with id 1b7b1aafc63ccd63bd97710e0a3f2d38a2ad1b3bccdb6c987f693c6bdde011cf Jun 10 20:53:35.269028 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:35.268969 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-rwggz" event={"ID":"1458bfa4-e182-4344-89d0-b486f98f3e8f","Type":"ContainerStarted","Data":"1b7b1aafc63ccd63bd97710e0a3f2d38a2ad1b3bccdb6c987f693c6bdde011cf"} Jun 10 20:53:37.281471 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:37.281428 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-rwggz" event={"ID":"1458bfa4-e182-4344-89d0-b486f98f3e8f","Type":"ContainerStarted","Data":"ea09dd22cf76f65b9689300b1c9de18bb9c6298ac84b23172f343887bd1599da"} Jun 10 20:53:37.281871 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:37.281501 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-rwggz" Jun 10 20:53:37.299659 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:37.299605 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-rwggz" podStartSLOduration=1.434800129 podStartE2EDuration="3.299589959s" totalImagesPullingTime="1.86478983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:53:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:53:37.298374111 +0000 UTC m=+704.466412844" watchObservedRunningTime="2026-06-10 20:53:37.299589959 +0000 UTC m=+704.467628737" Jun 10 20:53:43.319352 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:43.319280 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-rwggz" Jun 10 20:53:44.612962 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:44.612925 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj"] Jun 10 20:53:44.619079 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:44.619060 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" Jun 10 20:53:44.623667 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:44.623637 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gfz4k\"" Jun 10 20:53:44.623854 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:44.623682 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 20:53:44.623854 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:44.623683 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 20:53:44.624623 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:44.624603 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj"] Jun 10 20:53:44.720178 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:44.720135 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4lzh\" (UniqueName: \"kubernetes.io/projected/425622db-0a9c-43ae-b43a-02283d86aa61-kube-api-access-r4lzh\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj\" (UID: \"425622db-0a9c-43ae-b43a-02283d86aa61\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" Jun 10 20:53:44.720371 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:44.720196 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/425622db-0a9c-43ae-b43a-02283d86aa61-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj\" (UID: \"425622db-0a9c-43ae-b43a-02283d86aa61\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" Jun 10 20:53:44.720371 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:44.720260 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/425622db-0a9c-43ae-b43a-02283d86aa61-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj\" (UID: \"425622db-0a9c-43ae-b43a-02283d86aa61\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" Jun 10 20:53:44.821478 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:44.821442 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/425622db-0a9c-43ae-b43a-02283d86aa61-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj\" (UID: \"425622db-0a9c-43ae-b43a-02283d86aa61\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" Jun 10 20:53:44.821656 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:44.821509 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/425622db-0a9c-43ae-b43a-02283d86aa61-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj\" (UID: \"425622db-0a9c-43ae-b43a-02283d86aa61\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" Jun 10 20:53:44.821656 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:44.821567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4lzh\" (UniqueName: \"kubernetes.io/projected/425622db-0a9c-43ae-b43a-02283d86aa61-kube-api-access-r4lzh\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj\" (UID: \"425622db-0a9c-43ae-b43a-02283d86aa61\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" Jun 10 20:53:44.821905 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:44.821881 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/425622db-0a9c-43ae-b43a-02283d86aa61-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj\" (UID: \"425622db-0a9c-43ae-b43a-02283d86aa61\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" Jun 10 20:53:44.821905 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:44.821896 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/425622db-0a9c-43ae-b43a-02283d86aa61-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj\" (UID: \"425622db-0a9c-43ae-b43a-02283d86aa61\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" Jun 10 20:53:44.830977 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:44.830945 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4lzh\" (UniqueName: \"kubernetes.io/projected/425622db-0a9c-43ae-b43a-02283d86aa61-kube-api-access-r4lzh\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj\" (UID: \"425622db-0a9c-43ae-b43a-02283d86aa61\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" Jun 10 20:53:44.930485 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:44.930403 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" Jun 10 20:53:45.070516 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:45.070492 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj"] Jun 10 20:53:45.073311 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:53:45.073277 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod425622db_0a9c_43ae_b43a_02283d86aa61.slice/crio-e0b90fbf8a8571b3435f06e0d0b32de93da4a55948d719e7166462cfce845d57 WatchSource:0}: Error finding container e0b90fbf8a8571b3435f06e0d0b32de93da4a55948d719e7166462cfce845d57: Status 404 returned error can't find the container with id e0b90fbf8a8571b3435f06e0d0b32de93da4a55948d719e7166462cfce845d57 Jun 10 20:53:45.323168 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:45.323132 2554 generic.go:356] "Generic (PLEG): container finished" podID="425622db-0a9c-43ae-b43a-02283d86aa61" containerID="cf2144d13e0797261659025dc5ea635cf987f66078fec0adb2841f254955d8b4" exitCode=0 Jun 10 20:53:45.323351 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:45.323181 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" event={"ID":"425622db-0a9c-43ae-b43a-02283d86aa61","Type":"ContainerDied","Data":"cf2144d13e0797261659025dc5ea635cf987f66078fec0adb2841f254955d8b4"} Jun 10 20:53:45.323351 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:45.323216 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" event={"ID":"425622db-0a9c-43ae-b43a-02283d86aa61","Type":"ContainerStarted","Data":"e0b90fbf8a8571b3435f06e0d0b32de93da4a55948d719e7166462cfce845d57"} Jun 10 20:53:46.330809 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:46.330771 2554 generic.go:356] "Generic (PLEG): container finished" podID="425622db-0a9c-43ae-b43a-02283d86aa61" containerID="c2c682b383e5395f34edd0a58fb59fa356b99912622cb79e8b15da7eacb6970a" exitCode=0 Jun 10 20:53:46.331216 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:46.330827 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" event={"ID":"425622db-0a9c-43ae-b43a-02283d86aa61","Type":"ContainerDied","Data":"c2c682b383e5395f34edd0a58fb59fa356b99912622cb79e8b15da7eacb6970a"} Jun 10 20:53:47.337604 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:47.337570 2554 generic.go:356] "Generic (PLEG): container finished" podID="425622db-0a9c-43ae-b43a-02283d86aa61" containerID="916c6244f371c3f63420724db02a4a4bf35ed3242b7dd8a8b26fc144c55c9c17" exitCode=0 Jun 10 20:53:47.337975 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:47.337624 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" event={"ID":"425622db-0a9c-43ae-b43a-02283d86aa61","Type":"ContainerDied","Data":"916c6244f371c3f63420724db02a4a4bf35ed3242b7dd8a8b26fc144c55c9c17"} Jun 10 20:53:48.475739 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:48.475713 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" Jun 10 20:53:48.556921 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:48.556887 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4lzh\" (UniqueName: \"kubernetes.io/projected/425622db-0a9c-43ae-b43a-02283d86aa61-kube-api-access-r4lzh\") pod \"425622db-0a9c-43ae-b43a-02283d86aa61\" (UID: \"425622db-0a9c-43ae-b43a-02283d86aa61\") " Jun 10 20:53:48.557134 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:48.556938 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/425622db-0a9c-43ae-b43a-02283d86aa61-bundle\") pod \"425622db-0a9c-43ae-b43a-02283d86aa61\" (UID: \"425622db-0a9c-43ae-b43a-02283d86aa61\") " Jun 10 20:53:48.557134 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:48.556988 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/425622db-0a9c-43ae-b43a-02283d86aa61-util\") pod \"425622db-0a9c-43ae-b43a-02283d86aa61\" (UID: \"425622db-0a9c-43ae-b43a-02283d86aa61\") " Jun 10 20:53:48.557539 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:48.557506 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/425622db-0a9c-43ae-b43a-02283d86aa61-bundle" (OuterVolumeSpecName: "bundle") pod "425622db-0a9c-43ae-b43a-02283d86aa61" (UID: "425622db-0a9c-43ae-b43a-02283d86aa61"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:53:48.559029 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:48.558994 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/425622db-0a9c-43ae-b43a-02283d86aa61-kube-api-access-r4lzh" (OuterVolumeSpecName: "kube-api-access-r4lzh") pod "425622db-0a9c-43ae-b43a-02283d86aa61" (UID: "425622db-0a9c-43ae-b43a-02283d86aa61"). InnerVolumeSpecName "kube-api-access-r4lzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:53:48.562523 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:48.562491 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/425622db-0a9c-43ae-b43a-02283d86aa61-util" (OuterVolumeSpecName: "util") pod "425622db-0a9c-43ae-b43a-02283d86aa61" (UID: "425622db-0a9c-43ae-b43a-02283d86aa61"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:53:48.658314 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:48.658220 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/425622db-0a9c-43ae-b43a-02283d86aa61-util\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:53:48.658314 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:48.658253 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4lzh\" (UniqueName: \"kubernetes.io/projected/425622db-0a9c-43ae-b43a-02283d86aa61-kube-api-access-r4lzh\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:53:48.658314 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:48.658264 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/425622db-0a9c-43ae-b43a-02283d86aa61-bundle\") on node \"ip-10-0-140-84.ec2.internal\" DevicePath \"\"" Jun 10 20:53:49.350021 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:49.349992 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" Jun 10 20:53:49.350207 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:49.349989 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cc9dj" event={"ID":"425622db-0a9c-43ae-b43a-02283d86aa61","Type":"ContainerDied","Data":"e0b90fbf8a8571b3435f06e0d0b32de93da4a55948d719e7166462cfce845d57"} Jun 10 20:53:49.350207 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:49.350129 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0b90fbf8a8571b3435f06e0d0b32de93da4a55948d719e7166462cfce845d57" Jun 10 20:53:51.873375 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:51.873335 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-4n7sf"] Jun 10 20:53:51.873781 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:51.873706 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="425622db-0a9c-43ae-b43a-02283d86aa61" containerName="util" Jun 10 20:53:51.873781 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:51.873717 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="425622db-0a9c-43ae-b43a-02283d86aa61" containerName="util" Jun 10 20:53:51.873781 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:51.873736 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="425622db-0a9c-43ae-b43a-02283d86aa61" containerName="pull" Jun 10 20:53:51.873781 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:51.873741 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="425622db-0a9c-43ae-b43a-02283d86aa61" containerName="pull" Jun 10 20:53:51.873781 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:51.873748 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="425622db-0a9c-43ae-b43a-02283d86aa61" containerName="extract" Jun 10 20:53:51.873781 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:51.873754 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="425622db-0a9c-43ae-b43a-02283d86aa61" containerName="extract" Jun 10 20:53:51.873988 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:51.873809 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="425622db-0a9c-43ae-b43a-02283d86aa61" containerName="extract" Jun 10 20:53:51.876969 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:51.876949 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-4n7sf" Jun 10 20:53:51.880004 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:51.879986 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 20:53:51.881426 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:51.881405 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 20:53:51.881547 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:51.881411 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-t4hkz\"" Jun 10 20:53:51.885760 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:51.885738 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-4n7sf"] Jun 10 20:53:51.990872 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:51.990831 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp96l\" (UniqueName: \"kubernetes.io/projected/b8190ae0-e2ea-4a9b-ac63-2ea0072f5ac5-kube-api-access-mp96l\") pod \"keycloak-operator-d67dbbb48-4n7sf\" (UID: \"b8190ae0-e2ea-4a9b-ac63-2ea0072f5ac5\") " pod="keycloak-system/keycloak-operator-d67dbbb48-4n7sf" Jun 10 20:53:52.092285 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:52.092243 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp96l\" (UniqueName: \"kubernetes.io/projected/b8190ae0-e2ea-4a9b-ac63-2ea0072f5ac5-kube-api-access-mp96l\") pod \"keycloak-operator-d67dbbb48-4n7sf\" (UID: \"b8190ae0-e2ea-4a9b-ac63-2ea0072f5ac5\") " pod="keycloak-system/keycloak-operator-d67dbbb48-4n7sf" Jun 10 20:53:52.100984 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:52.100949 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp96l\" (UniqueName: \"kubernetes.io/projected/b8190ae0-e2ea-4a9b-ac63-2ea0072f5ac5-kube-api-access-mp96l\") pod \"keycloak-operator-d67dbbb48-4n7sf\" (UID: \"b8190ae0-e2ea-4a9b-ac63-2ea0072f5ac5\") " pod="keycloak-system/keycloak-operator-d67dbbb48-4n7sf" Jun 10 20:53:52.188753 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:52.188650 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-4n7sf" Jun 10 20:53:52.323119 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:52.323003 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-4n7sf"] Jun 10 20:53:52.325641 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:53:52.325604 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8190ae0_e2ea_4a9b_ac63_2ea0072f5ac5.slice/crio-2e41c2be334dbeb72b5a9c3ff81d1c2b1db14cc8ac32fbde933ae9be760396d5 WatchSource:0}: Error finding container 2e41c2be334dbeb72b5a9c3ff81d1c2b1db14cc8ac32fbde933ae9be760396d5: Status 404 returned error can't find the container with id 2e41c2be334dbeb72b5a9c3ff81d1c2b1db14cc8ac32fbde933ae9be760396d5 Jun 10 20:53:52.367536 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:52.367499 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-4n7sf" event={"ID":"b8190ae0-e2ea-4a9b-ac63-2ea0072f5ac5","Type":"ContainerStarted","Data":"2e41c2be334dbeb72b5a9c3ff81d1c2b1db14cc8ac32fbde933ae9be760396d5"} Jun 10 20:53:58.407971 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:58.407875 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-4n7sf" event={"ID":"b8190ae0-e2ea-4a9b-ac63-2ea0072f5ac5","Type":"ContainerStarted","Data":"2792cfb87e1281c040a13c40cce03defddde64aa2495a9946a3dea6f2db38789"} Jun 10 20:53:58.425887 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:53:58.425825 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-4n7sf" podStartSLOduration=1.7118501 podStartE2EDuration="7.425809884s" totalImagesPullingTime="5.713959784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:53:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:53:58.423945996 +0000 UTC m=+725.591984725" watchObservedRunningTime="2026-06-10 20:53:58.425809884 +0000 UTC m=+725.593848613" Jun 10 20:56:53.272893 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:56:53.272864 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 20:56:53.274506 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:56:53.274483 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 20:56:53.279720 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:56:53.279689 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 20:56:53.281354 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:56:53.281335 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 20:59:29.106671 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.106632 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx"] Jun 10 20:59:29.110838 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.110817 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.114173 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.114146 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 20:59:29.114321 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.114149 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 20:59:29.115754 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.115731 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ljvbc\"" Jun 10 20:59:29.116004 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.115761 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 10 20:59:29.120138 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.120117 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx"] Jun 10 20:59:29.215104 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.215057 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f760f438-73fb-46b7-adea-20b655e7cb74-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.215104 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.215106 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f760f438-73fb-46b7-adea-20b655e7cb74-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.215316 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.215161 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f760f438-73fb-46b7-adea-20b655e7cb74-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.215316 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.215190 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f760f438-73fb-46b7-adea-20b655e7cb74-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.215316 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.215230 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f760f438-73fb-46b7-adea-20b655e7cb74-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.215316 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.215287 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j427s\" (UniqueName: \"kubernetes.io/projected/f760f438-73fb-46b7-adea-20b655e7cb74-kube-api-access-j427s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.316371 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.316328 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f760f438-73fb-46b7-adea-20b655e7cb74-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.316371 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.316375 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f760f438-73fb-46b7-adea-20b655e7cb74-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.316622 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.316398 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f760f438-73fb-46b7-adea-20b655e7cb74-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.316622 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.316494 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j427s\" (UniqueName: \"kubernetes.io/projected/f760f438-73fb-46b7-adea-20b655e7cb74-kube-api-access-j427s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.316622 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.316583 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f760f438-73fb-46b7-adea-20b655e7cb74-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.316622 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.316614 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f760f438-73fb-46b7-adea-20b655e7cb74-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.316866 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.316840 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f760f438-73fb-46b7-adea-20b655e7cb74-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.316950 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.316909 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f760f438-73fb-46b7-adea-20b655e7cb74-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.317133 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.317110 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f760f438-73fb-46b7-adea-20b655e7cb74-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.318732 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.318703 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f760f438-73fb-46b7-adea-20b655e7cb74-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.319037 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.318996 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f760f438-73fb-46b7-adea-20b655e7cb74-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.325982 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.325959 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j427s\" (UniqueName: \"kubernetes.io/projected/f760f438-73fb-46b7-adea-20b655e7cb74-kube-api-access-j427s\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx\" (UID: \"f760f438-73fb-46b7-adea-20b655e7cb74\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.423243 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.423142 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:29.561970 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.561938 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx"] Jun 10 20:59:29.563448 ip-10-0-140-84 kubenswrapper[2554]: W0610 20:59:29.563419 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf760f438_73fb_46b7_adea_20b655e7cb74.slice/crio-6ae48aac379e58308c9d9ca8e836d14acaedd23c1f4343f53ff6fc20fea1a4fb WatchSource:0}: Error finding container 6ae48aac379e58308c9d9ca8e836d14acaedd23c1f4343f53ff6fc20fea1a4fb: Status 404 returned error can't find the container with id 6ae48aac379e58308c9d9ca8e836d14acaedd23c1f4343f53ff6fc20fea1a4fb Jun 10 20:59:29.565353 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:29.565336 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 20:59:30.168380 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:30.168333 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" event={"ID":"f760f438-73fb-46b7-adea-20b655e7cb74","Type":"ContainerStarted","Data":"6ae48aac379e58308c9d9ca8e836d14acaedd23c1f4343f53ff6fc20fea1a4fb"} Jun 10 20:59:34.194515 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:34.194479 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" event={"ID":"f760f438-73fb-46b7-adea-20b655e7cb74","Type":"ContainerStarted","Data":"7a7860c7b208e1cf3e91885308fb3e0940fe8dff10d9aa68deef7b88416f0837"} Jun 10 20:59:35.200739 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:35.200707 2554 generic.go:356] "Generic (PLEG): container finished" podID="f760f438-73fb-46b7-adea-20b655e7cb74" containerID="7a7860c7b208e1cf3e91885308fb3e0940fe8dff10d9aa68deef7b88416f0837" exitCode=0 Jun 10 20:59:35.201218 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:35.200791 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" event={"ID":"f760f438-73fb-46b7-adea-20b655e7cb74","Type":"ContainerDied","Data":"7a7860c7b208e1cf3e91885308fb3e0940fe8dff10d9aa68deef7b88416f0837"} Jun 10 20:59:37.213878 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:37.213840 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" event={"ID":"f760f438-73fb-46b7-adea-20b655e7cb74","Type":"ContainerStarted","Data":"1e9f01fc73cb451eb77f32d362be63c1400f4b6482dfa2a888f95ebe8868600e"} Jun 10 20:59:37.235817 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:37.235755 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" podStartSLOduration=2.082396278 podStartE2EDuration="8.235739764s" totalImagesPullingTime="4.863679799s" totalInitContainerRuntime="1.289663687s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:59:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:59:37.233796001 +0000 UTC m=+1064.401834733" watchObservedRunningTime="2026-06-10 20:59:37.235739764 +0000 UTC m=+1064.403778494" Jun 10 20:59:39.423542 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:39.423482 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:39.423974 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:39.423570 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:39.436069 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:39.436033 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 20:59:40.243602 ip-10-0-140-84 kubenswrapper[2554]: I0610 20:59:40.243569 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx" Jun 10 21:01:53.311542 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:01:53.311508 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 21:01:53.314832 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:01:53.314808 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 21:01:53.319105 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:01:53.319078 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 21:01:53.322277 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:01:53.322255 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 21:02:40.034339 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:40.034299 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-777875845c-lxp4n"] Jun 10 21:02:40.038183 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:40.038156 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-777875845c-lxp4n" Jun 10 21:02:40.042713 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:40.042684 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fsq8p\"" Jun 10 21:02:40.042854 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:40.042738 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 21:02:40.042854 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:40.042771 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 21:02:40.047191 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:40.047164 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-777875845c-lxp4n"] Jun 10 21:02:40.154066 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:40.153981 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e23ee01a-3ee0-45c0-a164-b8a2b051e768-webhook-cert\") pod \"maas-controller-777875845c-lxp4n\" (UID: \"e23ee01a-3ee0-45c0-a164-b8a2b051e768\") " pod="opendatahub/maas-controller-777875845c-lxp4n" Jun 10 21:02:40.154249 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:40.154125 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p7w2\" (UniqueName: \"kubernetes.io/projected/e23ee01a-3ee0-45c0-a164-b8a2b051e768-kube-api-access-2p7w2\") pod \"maas-controller-777875845c-lxp4n\" (UID: \"e23ee01a-3ee0-45c0-a164-b8a2b051e768\") " pod="opendatahub/maas-controller-777875845c-lxp4n" Jun 10 21:02:40.255249 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:40.255209 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e23ee01a-3ee0-45c0-a164-b8a2b051e768-webhook-cert\") pod \"maas-controller-777875845c-lxp4n\" (UID: \"e23ee01a-3ee0-45c0-a164-b8a2b051e768\") " pod="opendatahub/maas-controller-777875845c-lxp4n" Jun 10 21:02:40.255419 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:40.255273 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p7w2\" (UniqueName: \"kubernetes.io/projected/e23ee01a-3ee0-45c0-a164-b8a2b051e768-kube-api-access-2p7w2\") pod \"maas-controller-777875845c-lxp4n\" (UID: \"e23ee01a-3ee0-45c0-a164-b8a2b051e768\") " pod="opendatahub/maas-controller-777875845c-lxp4n" Jun 10 21:02:40.257634 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:40.257608 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e23ee01a-3ee0-45c0-a164-b8a2b051e768-webhook-cert\") pod \"maas-controller-777875845c-lxp4n\" (UID: \"e23ee01a-3ee0-45c0-a164-b8a2b051e768\") " pod="opendatahub/maas-controller-777875845c-lxp4n" Jun 10 21:02:40.264313 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:40.264290 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p7w2\" (UniqueName: \"kubernetes.io/projected/e23ee01a-3ee0-45c0-a164-b8a2b051e768-kube-api-access-2p7w2\") pod \"maas-controller-777875845c-lxp4n\" (UID: \"e23ee01a-3ee0-45c0-a164-b8a2b051e768\") " pod="opendatahub/maas-controller-777875845c-lxp4n" Jun 10 21:02:40.350433 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:40.350341 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-777875845c-lxp4n" Jun 10 21:02:40.492441 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:40.492410 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-777875845c-lxp4n"] Jun 10 21:02:40.492937 ip-10-0-140-84 kubenswrapper[2554]: W0610 21:02:40.492915 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode23ee01a_3ee0_45c0_a164_b8a2b051e768.slice/crio-fa16377b27debf8b2c8627a18b2554da63c6c0a44cf646d207e714cc07b9a10d WatchSource:0}: Error finding container fa16377b27debf8b2c8627a18b2554da63c6c0a44cf646d207e714cc07b9a10d: Status 404 returned error can't find the container with id fa16377b27debf8b2c8627a18b2554da63c6c0a44cf646d207e714cc07b9a10d Jun 10 21:02:41.190369 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:41.190320 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-777875845c-lxp4n" event={"ID":"e23ee01a-3ee0-45c0-a164-b8a2b051e768","Type":"ContainerStarted","Data":"fa16377b27debf8b2c8627a18b2554da63c6c0a44cf646d207e714cc07b9a10d"} Jun 10 21:02:43.204064 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:43.203997 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-777875845c-lxp4n" event={"ID":"e23ee01a-3ee0-45c0-a164-b8a2b051e768","Type":"ContainerStarted","Data":"fa222dd61eed5d4cf3b3e16c9cd575874a33252df4584f77eaf330d1afb504b1"} Jun 10 21:02:43.204551 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:43.204159 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-777875845c-lxp4n" Jun 10 21:02:43.224087 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:43.224033 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-777875845c-lxp4n" podStartSLOduration=0.741378827 podStartE2EDuration="3.223991373s" totalImagesPullingTime="2.482612546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 21:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 21:02:43.221641014 +0000 UTC m=+1250.389679767" watchObservedRunningTime="2026-06-10 21:02:43.223991373 +0000 UTC m=+1250.392030103" Jun 10 21:02:54.214397 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:02:54.214363 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-777875845c-lxp4n" Jun 10 21:06:53.349315 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:06:53.349279 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 21:06:53.353811 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:06:53.353784 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 21:06:53.355814 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:06:53.355795 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 21:06:53.360549 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:06:53.360529 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 21:11:53.384414 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:11:53.384386 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 21:11:53.391272 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:11:53.391248 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 21:11:53.392346 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:11:53.392323 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 21:11:53.399381 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:11:53.399356 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 21:13:55.254378 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.254302 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qfv9j"] Jun 10 21:13:55.257678 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.257659 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qfv9j" Jun 10 21:13:55.261020 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.260975 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 21:13:55.261161 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.261020 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f4ktb\"" Jun 10 21:13:55.261161 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.261000 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 21:13:55.267542 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.267519 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qfv9j"] Jun 10 21:13:55.378694 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.378656 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f82a031d-8333-472a-8d14-c584015b0bc5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qfv9j\" (UID: \"f82a031d-8333-472a-8d14-c584015b0bc5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qfv9j" Jun 10 21:13:55.378694 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.378696 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5wpb\" (UniqueName: \"kubernetes.io/projected/f82a031d-8333-472a-8d14-c584015b0bc5-kube-api-access-w5wpb\") pod \"kuadrant-operator-controller-manager-86878c769f-qfv9j\" (UID: \"f82a031d-8333-472a-8d14-c584015b0bc5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qfv9j" Jun 10 21:13:55.479325 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.479285 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f82a031d-8333-472a-8d14-c584015b0bc5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qfv9j\" (UID: \"f82a031d-8333-472a-8d14-c584015b0bc5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qfv9j" Jun 10 21:13:55.479325 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.479321 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5wpb\" (UniqueName: \"kubernetes.io/projected/f82a031d-8333-472a-8d14-c584015b0bc5-kube-api-access-w5wpb\") pod \"kuadrant-operator-controller-manager-86878c769f-qfv9j\" (UID: \"f82a031d-8333-472a-8d14-c584015b0bc5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qfv9j" Jun 10 21:13:55.479735 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.479696 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f82a031d-8333-472a-8d14-c584015b0bc5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qfv9j\" (UID: \"f82a031d-8333-472a-8d14-c584015b0bc5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qfv9j" Jun 10 21:13:55.488618 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.488590 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5wpb\" (UniqueName: \"kubernetes.io/projected/f82a031d-8333-472a-8d14-c584015b0bc5-kube-api-access-w5wpb\") pod \"kuadrant-operator-controller-manager-86878c769f-qfv9j\" (UID: \"f82a031d-8333-472a-8d14-c584015b0bc5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qfv9j" Jun 10 21:13:55.569446 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.569349 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qfv9j" Jun 10 21:13:55.717301 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.717271 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qfv9j"] Jun 10 21:13:55.718505 ip-10-0-140-84 kubenswrapper[2554]: W0610 21:13:55.718483 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82a031d_8333_472a_8d14_c584015b0bc5.slice/crio-dfbf2ca8a8cdcb356ef52a97d1f0b4ad63ac9b29ff655fcb9d29b69bbf217135 WatchSource:0}: Error finding container dfbf2ca8a8cdcb356ef52a97d1f0b4ad63ac9b29ff655fcb9d29b69bbf217135: Status 404 returned error can't find the container with id dfbf2ca8a8cdcb356ef52a97d1f0b4ad63ac9b29ff655fcb9d29b69bbf217135 Jun 10 21:13:55.799267 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.799228 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qfv9j" event={"ID":"f82a031d-8333-472a-8d14-c584015b0bc5","Type":"ContainerStarted","Data":"c1b342bb45d6d65d32b0b06883dbee7d65f465af91ac7afd295389e4087d37b7"} Jun 10 21:13:55.799449 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.799297 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qfv9j" event={"ID":"f82a031d-8333-472a-8d14-c584015b0bc5","Type":"ContainerStarted","Data":"dfbf2ca8a8cdcb356ef52a97d1f0b4ad63ac9b29ff655fcb9d29b69bbf217135"} Jun 10 21:13:55.799449 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.799326 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qfv9j" Jun 10 21:13:55.823237 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:13:55.823128 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qfv9j" podStartSLOduration=0.823111048 podStartE2EDuration="823.111048ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 21:13:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 21:13:55.820594693 +0000 UTC m=+1922.988633425" watchObservedRunningTime="2026-06-10 21:13:55.823111048 +0000 UTC m=+1922.991149776" Jun 10 21:14:06.807935 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:14:06.807900 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qfv9j" Jun 10 21:16:53.421890 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:16:53.421859 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 21:16:53.435048 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:16:53.434995 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 21:16:53.440269 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:16:53.440241 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 21:16:53.446026 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:16:53.445981 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 21:21:53.466436 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:21:53.466406 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 21:21:53.473184 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:21:53.473161 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 21:21:53.477923 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:21:53.477906 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 21:21:53.483883 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:21:53.483868 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 21:23:58.745192 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:23:58.745162 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-ccf667d6f-vs29k_f1919adb-ef84-47c8-b0e6-43980de76b1b/nginx/0.log" Jun 10 21:23:59.421424 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:23:59.421395 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-777875845c-lxp4n_e23ee01a-3ee0-45c0-a164-b8a2b051e768/manager/0.log" Jun 10 21:23:59.762086 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:23:59.762058 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546b599574-8pl2b_0f10dcba-5046-4b08-ba70-61aa9c05ee24/copy-manifests/0.log" Jun 10 21:23:59.774043 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:23:59.774002 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546b599574-8pl2b_0f10dcba-5046-4b08-ba70-61aa9c05ee24/manager/0.log" Jun 10 21:24:00.126289 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:00.126212 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-rwggz_1458bfa4-e182-4344-89d0-b486f98f3e8f/postgres/0.log" Jun 10 21:24:00.993322 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:00.993292 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v_412152d5-046d-4325-bbf6-0ddf3c2b46e0/util/0.log" Jun 10 21:24:00.999614 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:00.999590 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v_412152d5-046d-4325-bbf6-0ddf3c2b46e0/pull/0.log" Jun 10 21:24:01.005640 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:01.005618 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v_412152d5-046d-4325-bbf6-0ddf3c2b46e0/extract/0.log" Jun 10 21:24:01.949213 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:01.949184 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qfv9j_f82a031d-8333-472a-8d14-c584015b0bc5/manager/0.log" Jun 10 21:24:02.655558 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:02.655526 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-p2n4x_e6d448a1-939c-47f4-afa7-3d5bc348631f/discovery/0.log" Jun 10 21:24:04.006491 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:04.006456 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx_f760f438-73fb-46b7-adea-20b655e7cb74/main/0.log" Jun 10 21:24:04.012901 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:04.012870 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvwvrx_f760f438-73fb-46b7-adea-20b655e7cb74/storage-initializer/0.log" Jun 10 21:24:11.903756 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:11.903716 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-888f4_a48d3544-c7a8-49d0-b6f0-720732a6f056/global-pull-secret-syncer/0.log" Jun 10 21:24:12.091933 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:12.091908 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mc66f_ce79514f-80c6-42db-b060-1823e18a9bca/konnectivity-agent/0.log" Jun 10 21:24:12.134469 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:12.134442 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-84.ec2.internal_eb606e6e49ab7c92af3bf94d0bc58e30/haproxy/0.log" Jun 10 21:24:16.755682 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:16.755645 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v_412152d5-046d-4325-bbf6-0ddf3c2b46e0/extract/0.log" Jun 10 21:24:16.777082 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:16.777060 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v_412152d5-046d-4325-bbf6-0ddf3c2b46e0/util/0.log" Jun 10 21:24:16.800239 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:16.800213 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hn69v_412152d5-046d-4325-bbf6-0ddf3c2b46e0/pull/0.log" Jun 10 21:24:17.481214 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:17.481181 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qfv9j_f82a031d-8333-472a-8d14-c584015b0bc5/manager/0.log" Jun 10 21:24:19.265592 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:19.265564 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73eec1eb-cb97-42bc-a53d-96feae752a06/alertmanager/0.log" Jun 10 21:24:19.288162 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:19.288134 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73eec1eb-cb97-42bc-a53d-96feae752a06/config-reloader/0.log" Jun 10 21:24:19.308466 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:19.308439 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73eec1eb-cb97-42bc-a53d-96feae752a06/kube-rbac-proxy-web/0.log" Jun 10 21:24:19.331276 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:19.331248 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73eec1eb-cb97-42bc-a53d-96feae752a06/kube-rbac-proxy/0.log" Jun 10 21:24:19.355991 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:19.355964 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73eec1eb-cb97-42bc-a53d-96feae752a06/kube-rbac-proxy-metric/0.log" Jun 10 21:24:19.381972 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:19.381941 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73eec1eb-cb97-42bc-a53d-96feae752a06/prom-label-proxy/0.log" Jun 10 21:24:19.406732 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:19.406688 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_73eec1eb-cb97-42bc-a53d-96feae752a06/init-config-reloader/0.log" Jun 10 21:24:19.442869 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:19.442842 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-crtkl_ad054163-9b63-4bb4-88ca-3fb640a1e913/cluster-monitoring-operator/0.log" Jun 10 21:24:19.473541 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:19.473509 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-sx86s_67e51b72-61a4-4c2a-a58c-8a34f7470ee9/kube-state-metrics/0.log" Jun 10 21:24:19.502936 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:19.502903 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-sx86s_67e51b72-61a4-4c2a-a58c-8a34f7470ee9/kube-rbac-proxy-main/0.log" Jun 10 21:24:19.523895 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:19.523817 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-sx86s_67e51b72-61a4-4c2a-a58c-8a34f7470ee9/kube-rbac-proxy-self/0.log" Jun 10 21:24:19.715975 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:19.715943 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t5xds_1a35aa25-09af-4299-be16-538f5b62359d/node-exporter/0.log" Jun 10 21:24:19.736363 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:19.736335 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t5xds_1a35aa25-09af-4299-be16-538f5b62359d/kube-rbac-proxy/0.log" Jun 10 21:24:19.759231 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:19.759202 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t5xds_1a35aa25-09af-4299-be16-538f5b62359d/init-textfile/0.log" Jun 10 21:24:19.872978 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:19.872949 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-8854x_828b2a61-2655-4337-9201-96550b142c98/kube-rbac-proxy-main/0.log" Jun 10 21:24:19.897922 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:19.897886 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-8854x_828b2a61-2655-4337-9201-96550b142c98/kube-rbac-proxy-self/0.log" Jun 10 21:24:19.920235 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:19.920207 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-8854x_828b2a61-2655-4337-9201-96550b142c98/openshift-state-metrics/0.log" Jun 10 21:24:20.295863 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:20.295825 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cd6886545-lf48h_cdfc548f-21a6-430a-8571-a4a385ee71b2/thanos-query/0.log" Jun 10 21:24:20.320179 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:20.320151 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cd6886545-lf48h_cdfc548f-21a6-430a-8571-a4a385ee71b2/kube-rbac-proxy-web/0.log" Jun 10 21:24:20.342294 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:20.342269 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cd6886545-lf48h_cdfc548f-21a6-430a-8571-a4a385ee71b2/kube-rbac-proxy/0.log" Jun 10 21:24:20.371921 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:20.371894 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cd6886545-lf48h_cdfc548f-21a6-430a-8571-a4a385ee71b2/prom-label-proxy/0.log" Jun 10 21:24:20.393798 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:20.393768 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cd6886545-lf48h_cdfc548f-21a6-430a-8571-a4a385ee71b2/kube-rbac-proxy-rules/0.log" Jun 10 21:24:20.420052 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:20.420026 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cd6886545-lf48h_cdfc548f-21a6-430a-8571-a4a385ee71b2/kube-rbac-proxy-metrics/0.log" Jun 10 21:24:21.797584 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:21.797552 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-mcsmq_613bd58e-71b8-46cc-a1ce-624d082f1bb7/networking-console-plugin/0.log" Jun 10 21:24:22.437717 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:22.437689 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/1.log" Jun 10 21:24:22.443047 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:22.443020 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-q45zb_d0cb4cf3-6f97-486a-aa96-515ce709fcc5/console-operator/2.log" Jun 10 21:24:23.670772 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.670730 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f"] Jun 10 21:24:23.674617 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.674595 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:23.678083 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.678064 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9b7t2\"/\"default-dockercfg-8z9p5\"" Jun 10 21:24:23.678187 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.678066 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9b7t2\"/\"kube-root-ca.crt\"" Jun 10 21:24:23.680152 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.679572 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9b7t2\"/\"openshift-service-ca.crt\"" Jun 10 21:24:23.683214 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.683193 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f"] Jun 10 21:24:23.826878 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.826839 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1150200b-2a5e-4667-a8ba-7d06f534afb2-lib-modules\") pod \"perf-node-gather-daemonset-r5j2f\" (UID: \"1150200b-2a5e-4667-a8ba-7d06f534afb2\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:23.826878 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.826878 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1150200b-2a5e-4667-a8ba-7d06f534afb2-podres\") pod \"perf-node-gather-daemonset-r5j2f\" (UID: \"1150200b-2a5e-4667-a8ba-7d06f534afb2\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:23.827141 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.826898 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1150200b-2a5e-4667-a8ba-7d06f534afb2-sys\") pod \"perf-node-gather-daemonset-r5j2f\" (UID: \"1150200b-2a5e-4667-a8ba-7d06f534afb2\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:23.827141 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.827034 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1150200b-2a5e-4667-a8ba-7d06f534afb2-proc\") pod \"perf-node-gather-daemonset-r5j2f\" (UID: \"1150200b-2a5e-4667-a8ba-7d06f534afb2\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:23.827222 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.827138 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9pgz\" (UniqueName: \"kubernetes.io/projected/1150200b-2a5e-4667-a8ba-7d06f534afb2-kube-api-access-k9pgz\") pod \"perf-node-gather-daemonset-r5j2f\" (UID: \"1150200b-2a5e-4667-a8ba-7d06f534afb2\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:23.928423 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.928329 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1150200b-2a5e-4667-a8ba-7d06f534afb2-podres\") pod \"perf-node-gather-daemonset-r5j2f\" (UID: \"1150200b-2a5e-4667-a8ba-7d06f534afb2\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:23.928423 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.928369 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1150200b-2a5e-4667-a8ba-7d06f534afb2-sys\") pod \"perf-node-gather-daemonset-r5j2f\" (UID: \"1150200b-2a5e-4667-a8ba-7d06f534afb2\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:23.928622 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.928428 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1150200b-2a5e-4667-a8ba-7d06f534afb2-proc\") pod \"perf-node-gather-daemonset-r5j2f\" (UID: \"1150200b-2a5e-4667-a8ba-7d06f534afb2\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:23.928622 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.928504 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1150200b-2a5e-4667-a8ba-7d06f534afb2-podres\") pod \"perf-node-gather-daemonset-r5j2f\" (UID: \"1150200b-2a5e-4667-a8ba-7d06f534afb2\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:23.928622 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.928522 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1150200b-2a5e-4667-a8ba-7d06f534afb2-sys\") pod \"perf-node-gather-daemonset-r5j2f\" (UID: \"1150200b-2a5e-4667-a8ba-7d06f534afb2\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:23.928622 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.928512 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9pgz\" (UniqueName: \"kubernetes.io/projected/1150200b-2a5e-4667-a8ba-7d06f534afb2-kube-api-access-k9pgz\") pod \"perf-node-gather-daemonset-r5j2f\" (UID: \"1150200b-2a5e-4667-a8ba-7d06f534afb2\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:23.928622 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.928572 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1150200b-2a5e-4667-a8ba-7d06f534afb2-lib-modules\") pod \"perf-node-gather-daemonset-r5j2f\" (UID: \"1150200b-2a5e-4667-a8ba-7d06f534afb2\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:23.928622 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.928583 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1150200b-2a5e-4667-a8ba-7d06f534afb2-proc\") pod \"perf-node-gather-daemonset-r5j2f\" (UID: \"1150200b-2a5e-4667-a8ba-7d06f534afb2\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:23.928815 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.928713 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1150200b-2a5e-4667-a8ba-7d06f534afb2-lib-modules\") pod \"perf-node-gather-daemonset-r5j2f\" (UID: \"1150200b-2a5e-4667-a8ba-7d06f534afb2\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:23.938346 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.938311 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9pgz\" (UniqueName: \"kubernetes.io/projected/1150200b-2a5e-4667-a8ba-7d06f534afb2-kube-api-access-k9pgz\") pod \"perf-node-gather-daemonset-r5j2f\" (UID: \"1150200b-2a5e-4667-a8ba-7d06f534afb2\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:23.986193 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:23.986153 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:24.131602 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:24.131572 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f"] Jun 10 21:24:24.137061 ip-10-0-140-84 kubenswrapper[2554]: W0610 21:24:24.137030 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1150200b_2a5e_4667_a8ba_7d06f534afb2.slice/crio-e5b7a434a63f5075c5bc0d435dc751a5137a8db225824352cdea01b4991fbb5a WatchSource:0}: Error finding container e5b7a434a63f5075c5bc0d435dc751a5137a8db225824352cdea01b4991fbb5a: Status 404 returned error can't find the container with id e5b7a434a63f5075c5bc0d435dc751a5137a8db225824352cdea01b4991fbb5a Jun 10 21:24:24.212780 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:24.212743 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" event={"ID":"1150200b-2a5e-4667-a8ba-7d06f534afb2","Type":"ContainerStarted","Data":"e5b7a434a63f5075c5bc0d435dc751a5137a8db225824352cdea01b4991fbb5a"} Jun 10 21:24:25.133167 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:25.133130 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t6qck_9964f961-20d9-4e7f-b456-76023883f432/dns/0.log" Jun 10 21:24:25.153016 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:25.152990 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t6qck_9964f961-20d9-4e7f-b456-76023883f432/kube-rbac-proxy/0.log" Jun 10 21:24:25.175475 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:25.175452 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5mnxb_8e775399-2b2b-45c1-823c-dc848145fd90/dns-node-resolver/0.log" Jun 10 21:24:25.219245 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:25.219215 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" event={"ID":"1150200b-2a5e-4667-a8ba-7d06f534afb2","Type":"ContainerStarted","Data":"7a500d171cf57109d728a2acb88944edb57f00acad05c87cfea9d3901b34b22d"} Jun 10 21:24:25.219401 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:25.219337 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:25.235893 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:25.235844 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" podStartSLOduration=2.235830877 podStartE2EDuration="2.235830877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 21:24:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 21:24:25.23516977 +0000 UTC m=+2552.403208520" watchObservedRunningTime="2026-06-10 21:24:25.235830877 +0000 UTC m=+2552.403869606" Jun 10 21:24:25.823737 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:25.823706 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zfl89_dfb762df-1072-4f6d-af60-da1fe0c98b0d/node-ca/0.log" Jun 10 21:24:26.827955 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:26.827917 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-p2n4x_e6d448a1-939c-47f4-afa7-3d5bc348631f/discovery/0.log" Jun 10 21:24:27.629512 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:27.629480 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6t6v2_1196aa7e-0de4-4288-b2ce-1d8ab82f532d/serve-healthcheck-canary/0.log" Jun 10 21:24:28.172690 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:28.172658 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-8g77m_87fb2abe-9f87-4b54-8dee-185d03cb44df/insights-operator/0.log" Jun 10 21:24:28.173969 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:28.173950 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-8g77m_87fb2abe-9f87-4b54-8dee-185d03cb44df/insights-operator/1.log" Jun 10 21:24:28.193839 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:28.193812 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8v7nj_4e969446-840b-469c-b684-a2be448cbe75/kube-rbac-proxy/0.log" Jun 10 21:24:28.214827 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:28.214796 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8v7nj_4e969446-840b-469c-b684-a2be448cbe75/exporter/0.log" Jun 10 21:24:28.234527 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:28.234501 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8v7nj_4e969446-840b-469c-b684-a2be448cbe75/extractor/0.log" Jun 10 21:24:30.578463 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:30.578438 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-ccf667d6f-vs29k_f1919adb-ef84-47c8-b0e6-43980de76b1b/nginx/0.log" Jun 10 21:24:30.832875 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:30.832780 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-777875845c-lxp4n_e23ee01a-3ee0-45c0-a164-b8a2b051e768/manager/0.log" Jun 10 21:24:30.995568 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:30.995534 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546b599574-8pl2b_0f10dcba-5046-4b08-ba70-61aa9c05ee24/manager/0.log" Jun 10 21:24:31.011838 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:31.011814 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546b599574-8pl2b_0f10dcba-5046-4b08-ba70-61aa9c05ee24/copy-manifests/0.log" Jun 10 21:24:31.132574 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:31.132487 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-rwggz_1458bfa4-e182-4344-89d0-b486f98f3e8f/postgres/0.log" Jun 10 21:24:31.234376 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:31.234350 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-r5j2f" Jun 10 21:24:32.569601 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:32.569572 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-678cf7c548-jsnfx_3230dcf5-d76e-4b98-b06b-71d6e29553ae/manager/0.log" Jun 10 21:24:32.626356 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:32.626330 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-gxwmx_ee82ce11-c7dd-43c3-9a8b-096c2dcdee98/openshift-lws-operator/0.log" Jun 10 21:24:37.402879 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:37.402837 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-p2n4x_e6d448a1-939c-47f4-afa7-3d5bc348631f/discovery/0.log" Jun 10 21:24:38.348308 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:38.348281 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-rv7mm_6f713b5f-df73-49f4-8418-8a5cee09ed4a/migrator/0.log" Jun 10 21:24:38.368644 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:38.368614 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-rv7mm_6f713b5f-df73-49f4-8418-8a5cee09ed4a/graceful-termination/0.log" Jun 10 21:24:38.691420 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:38.691333 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-p2n4x_e6d448a1-939c-47f4-afa7-3d5bc348631f/discovery/0.log" Jun 10 21:24:38.783365 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:38.783338 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-gpxxn_58bb00d7-2d5c-4874-9325-2064a631a4cd/kube-storage-version-migrator-operator/1.log" Jun 10 21:24:38.784261 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:38.784243 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-gpxxn_58bb00d7-2d5c-4874-9325-2064a631a4cd/kube-storage-version-migrator-operator/0.log" Jun 10 21:24:40.266566 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:40.266538 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wkzj6_2f817cd6-446c-4995-b2d5-ebf8f614d598/kube-multus-additional-cni-plugins/0.log" Jun 10 21:24:40.305291 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:40.305261 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wkzj6_2f817cd6-446c-4995-b2d5-ebf8f614d598/egress-router-binary-copy/0.log" Jun 10 21:24:40.342560 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:40.342519 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wkzj6_2f817cd6-446c-4995-b2d5-ebf8f614d598/cni-plugins/0.log" Jun 10 21:24:40.381278 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:40.381251 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wkzj6_2f817cd6-446c-4995-b2d5-ebf8f614d598/bond-cni-plugin/0.log" Jun 10 21:24:40.418293 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:40.418268 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wkzj6_2f817cd6-446c-4995-b2d5-ebf8f614d598/routeoverride-cni/0.log" Jun 10 21:24:40.460359 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:40.460333 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wkzj6_2f817cd6-446c-4995-b2d5-ebf8f614d598/whereabouts-cni-bincopy/0.log" Jun 10 21:24:40.494226 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:40.494188 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wkzj6_2f817cd6-446c-4995-b2d5-ebf8f614d598/whereabouts-cni/0.log" Jun 10 21:24:40.532637 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:40.532553 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-p2n4x_e6d448a1-939c-47f4-afa7-3d5bc348631f/discovery/0.log" Jun 10 21:24:40.544926 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:40.544896 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kgsz7_ce4e2367-1145-42ee-be5f-2c17bd0d13ff/kube-multus/0.log" Jun 10 21:24:40.712729 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:40.712697 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5wvlk_7e9deb0d-98eb-49cf-8fe2-e863232c7d47/network-metrics-daemon/0.log" Jun 10 21:24:40.747705 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:40.747674 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5wvlk_7e9deb0d-98eb-49cf-8fe2-e863232c7d47/kube-rbac-proxy/0.log" Jun 10 21:24:42.064219 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:42.064189 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-controller/0.log" Jun 10 21:24:42.080620 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:42.080597 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/0.log" Jun 10 21:24:42.080620 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:42.080607 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovn-acl-logging/1.log" Jun 10 21:24:42.099257 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:42.099229 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/kube-rbac-proxy-node/0.log" Jun 10 21:24:42.121410 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:42.121375 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/kube-rbac-proxy-ovn-metrics/0.log" Jun 10 21:24:42.136550 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:42.136527 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/northd/0.log" Jun 10 21:24:42.155750 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:42.155717 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/nbdb/0.log" Jun 10 21:24:42.175854 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:42.175759 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/sbdb/0.log" Jun 10 21:24:42.218843 ip-10-0-140-84 kubenswrapper[2554]: I0610 21:24:42.218810 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5dd9_d056ae52-f669-4b21-abb9-1223de0b748e/ovnkube-controller/0.log"