Jun 04 23:54:21.545927 ip-10-0-140-8 systemd[1]: Starting Kubernetes Kubelet... Jun 04 23:54:21.876177 ip-10-0-140-8 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 04 23:54:21.876177 ip-10-0-140-8 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 04 23:54:21.876177 ip-10-0-140-8 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 04 23:54:21.876177 ip-10-0-140-8 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 04 23:54:21.876177 ip-10-0-140-8 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 04 23:54:21.878570 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.878494 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 04 23:54:21.883530 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883515 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 04 23:54:21.883530 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883530 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883533 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883538 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883541 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883544 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883547 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883550 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883552 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883556 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883558 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883561 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883564 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883566 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883568 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883571 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883574 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883576 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883579 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883584 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883587 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 04 23:54:21.883597 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883590 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883593 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883595 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883598 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883600 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883603 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883606 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883609 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883611 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883614 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883617 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883620 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883622 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883627 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883631 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883634 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883637 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883640 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883642 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883645 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 04 23:54:21.884096 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883648 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883650 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883653 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883655 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883658 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883660 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883663 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883665 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883668 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883685 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883687 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883692 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883695 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883698 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883702 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883705 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883709 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883712 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883714 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883717 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 04 23:54:21.884611 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883719 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883722 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883724 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883727 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883730 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883732 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883735 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883738 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883742 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883745 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883748 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883750 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883753 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883756 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883758 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883761 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883763 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883765 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 04 23:54:21.885257 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883768 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883770 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883773 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883775 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883777 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883780 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883783 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883786 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883789 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883792 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883794 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883797 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883800 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883802 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883805 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883808 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883810 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883812 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883815 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.883817 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 04 23:54:21.886017 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884528 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884535 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884538 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884541 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884544 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884547 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884550 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884552 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884555 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884557 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884560 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884563 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884565 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884568 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884572 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884576 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884579 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884582 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884585 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884588 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 04 23:54:21.886608 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884592 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884595 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884597 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884600 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884602 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884605 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884608 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884611 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884613 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884616 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884618 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884621 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884624 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884627 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884629 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884632 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884634 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884637 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884639 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884642 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 04 23:54:21.887130 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884644 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884647 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884650 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884652 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884655 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884658 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884660 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884663 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884665 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884668 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884684 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884687 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884690 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884693 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884696 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884699 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884701 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884704 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884707 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884709 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 04 23:54:21.887625 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884712 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884715 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884718 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884720 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884723 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884726 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884728 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884731 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884733 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884736 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884738 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884741 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884744 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884746 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884749 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884752 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884754 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884757 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884760 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884763 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 04 23:54:21.888137 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884765 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884770 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884774 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884777 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884780 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884783 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884785 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884788 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884790 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884793 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884796 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884798 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884801 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884803 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884806 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884808 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884811 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884815 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.884818 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 04 23:54:21.888631 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886699 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886711 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886714 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886717 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886721 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886724 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886727 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886730 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886732 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886735 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886738 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886741 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886743 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886746 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886748 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886751 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886754 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886756 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886759 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886765 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886768 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 04 23:54:21.889126 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886771 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886773 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886776 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886778 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886781 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886784 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886786 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886789 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886792 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886795 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886797 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886800 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886803 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886806 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886809 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886813 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886815 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886818 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886821 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 04 23:54:21.889640 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886823 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886826 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886828 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886831 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886833 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886836 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886839 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886841 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886844 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886846 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886850 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886852 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886855 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886857 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886860 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886862 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886865 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886867 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886870 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886872 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 04 23:54:21.890108 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886876 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886880 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886882 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886885 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886887 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886890 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886894 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886896 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886899 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886901 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886904 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886907 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886909 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886912 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886914 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886917 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886920 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886922 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886925 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 04 23:54:21.890585 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886928 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886930 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886934 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886936 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886939 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886942 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886944 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886947 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886949 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886952 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886956 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886960 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886963 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886966 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886969 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886972 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886974 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886977 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886984 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 04 23:54:21.891103 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.886987 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887051 2564 flags.go:64] FLAG: --address="0.0.0.0" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887058 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887067 2564 flags.go:64] FLAG: --anonymous-auth="true" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887074 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887080 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887084 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887088 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887092 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887095 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887098 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887101 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887104 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887107 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887110 2564 flags.go:64] FLAG: --cgroup-root="" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887113 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887116 2564 flags.go:64] FLAG: --client-ca-file="" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887119 2564 flags.go:64] FLAG: --cloud-provider="external" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887123 2564 flags.go:64] FLAG: --cluster-dns="[]" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887127 2564 flags.go:64] FLAG: --cluster-domain="" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887130 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887133 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887136 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887140 2564 flags.go:64] FLAG: --container-log-max-files="5" Jun 04 23:54:21.891567 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887143 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887146 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887150 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887153 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887156 2564 flags.go:64] FLAG: --contention-profiling="false" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887158 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887161 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887167 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887170 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887173 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887176 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887179 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887182 2564 flags.go:64] FLAG: --enable-load-reader="false" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887185 2564 flags.go:64] FLAG: --enable-server="true" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887188 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887192 2564 flags.go:64] FLAG: --event-burst="100" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887195 2564 flags.go:64] FLAG: --event-qps="50" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887198 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887201 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887204 2564 flags.go:64] FLAG: --eviction-hard="" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887207 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887210 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887213 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887216 2564 flags.go:64] FLAG: --eviction-soft="" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887219 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 04 23:54:21.892162 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887221 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887224 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887228 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887230 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887233 2564 flags.go:64] FLAG: --fail-swap-on="true" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887236 2564 flags.go:64] FLAG: --feature-gates="" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887239 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887242 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887245 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887248 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887251 2564 flags.go:64] FLAG: --healthz-port="10248" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887254 2564 flags.go:64] FLAG: --help="false" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887257 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-140-8.ec2.internal" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887260 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887265 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887268 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887271 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887274 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887277 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887280 2564 flags.go:64] FLAG: --image-service-endpoint="" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887283 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887286 2564 flags.go:64] FLAG: --kube-api-burst="100" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887289 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887292 2564 flags.go:64] FLAG: --kube-api-qps="50" Jun 04 23:54:21.892808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887295 2564 flags.go:64] FLAG: --kube-reserved="" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887297 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887300 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887303 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887306 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887308 2564 flags.go:64] FLAG: --lock-file="" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887311 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887314 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887317 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887322 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887325 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887328 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887332 2564 flags.go:64] FLAG: --logging-format="text" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887334 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887338 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887341 2564 flags.go:64] FLAG: --manifest-url="" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887343 2564 flags.go:64] FLAG: --manifest-url-header="" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887347 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887350 2564 flags.go:64] FLAG: --max-open-files="1000000" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887355 2564 flags.go:64] FLAG: --max-pods="110" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887357 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887360 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887366 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887369 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887372 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 04 23:54:21.893407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887375 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887378 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887385 2564 flags.go:64] FLAG: --node-status-max-images="50" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887388 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887391 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887394 2564 flags.go:64] FLAG: --pod-cidr="" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887397 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887402 2564 flags.go:64] FLAG: --pod-manifest-path="" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887405 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887408 2564 flags.go:64] FLAG: --pods-per-core="0" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887411 2564 flags.go:64] FLAG: --port="10250" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887414 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887416 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a706ec91bfcc28cd" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887419 2564 flags.go:64] FLAG: --qos-reserved="" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887422 2564 flags.go:64] FLAG: --read-only-port="10255" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887425 2564 flags.go:64] FLAG: --register-node="true" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887428 2564 flags.go:64] FLAG: --register-with-taints="" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887431 2564 flags.go:64] FLAG: --registry-burst="10" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887434 2564 flags.go:64] FLAG: --registry-qps="5" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887437 2564 flags.go:64] FLAG: --reserved-cpus="" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887440 2564 flags.go:64] FLAG: --reserved-memory="" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887447 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887450 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887453 2564 flags.go:64] FLAG: --rotate-certificates="false" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887456 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 04 23:54:21.894252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887459 2564 flags.go:64] FLAG: --runonce="false" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887461 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887464 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887467 2564 flags.go:64] FLAG: --seccomp-default="false" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887471 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887477 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887480 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887482 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887485 2564 flags.go:64] FLAG: --storage-driver-password="root" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887488 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887491 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887494 2564 flags.go:64] FLAG: --storage-driver-user="root" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887497 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887499 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887503 2564 flags.go:64] FLAG: --system-cgroups="" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887505 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887511 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887514 2564 flags.go:64] FLAG: --tls-cert-file="" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887517 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887521 2564 flags.go:64] FLAG: --tls-min-version="" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887524 2564 flags.go:64] FLAG: --tls-private-key-file="" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887527 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887529 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887532 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887535 2564 flags.go:64] FLAG: --v="2" Jun 04 23:54:21.895378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887539 2564 flags.go:64] FLAG: --version="false" Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887543 2564 flags.go:64] FLAG: --vmodule="" Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887547 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.887550 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887653 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887656 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887660 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887662 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887666 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887668 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887684 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887689 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887693 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887696 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887698 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887701 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887703 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887706 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887708 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887711 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887713 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 04 23:54:21.896458 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887716 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887718 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887721 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887723 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887726 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887729 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887731 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887734 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887736 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887739 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887741 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887744 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887746 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887749 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887752 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887754 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887757 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887759 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887762 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887764 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 04 23:54:21.897385 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887767 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887769 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887773 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887776 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887780 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887783 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887786 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887789 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887792 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887795 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887797 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887800 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887802 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887805 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887807 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887810 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887812 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887815 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887817 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 04 23:54:21.897951 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887820 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887822 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887824 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887827 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887829 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887832 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887835 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887837 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887840 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887843 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887847 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887850 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887853 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887855 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887858 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887862 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887865 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887868 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887871 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 04 23:54:21.898655 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887873 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887876 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887878 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887881 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887883 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887886 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887888 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887891 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887893 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887896 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887900 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887903 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887906 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887908 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887911 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887914 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887917 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887920 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887922 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887925 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 04 23:54:21.899479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887927 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 04 23:54:21.900298 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887930 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 04 23:54:21.900298 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887933 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 04 23:54:21.900298 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.887936 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 04 23:54:21.900298 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.888515 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 04 23:54:21.900298 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.895976 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 04 23:54:21.900298 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.895995 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 04 23:54:21.900298 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.896022 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 04 23:54:21.900298 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.896035 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 04 23:54:21.900298 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896116 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 04 23:54:21.900298 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896123 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 04 23:54:21.900298 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896129 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 04 23:54:21.900298 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896134 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 04 23:54:21.900298 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896141 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 04 23:54:21.900298 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896147 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896152 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896157 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896162 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896167 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896171 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896176 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896180 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896185 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896189 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896193 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896197 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896203 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896209 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896213 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896218 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896222 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896227 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896231 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 04 23:54:21.900653 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896236 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896240 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896244 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896248 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896252 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896259 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896263 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896268 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896272 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896276 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896281 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896285 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896289 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896293 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896297 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896302 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896306 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896310 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896314 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896318 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 04 23:54:21.901156 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896322 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896326 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896331 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896335 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896340 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896344 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896348 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896352 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896357 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896361 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896365 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896369 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896373 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896378 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896390 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896394 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896399 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896404 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896410 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896414 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 04 23:54:21.901706 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896418 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896422 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896426 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896431 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896435 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896439 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896443 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896447 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896451 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896455 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896459 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896463 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896467 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896471 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896475 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896479 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896483 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896487 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896493 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896499 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 04 23:54:21.902264 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896504 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 04 23:54:21.902799 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896509 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 04 23:54:21.902799 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896514 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 04 23:54:21.902799 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896519 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 04 23:54:21.902799 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896523 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 04 23:54:21.902799 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896528 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 04 23:54:21.902799 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896532 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 04 23:54:21.902799 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896536 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 04 23:54:21.902799 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896541 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 04 23:54:21.902799 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896546 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 04 23:54:21.902799 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896551 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 04 23:54:21.902799 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896557 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 04 23:54:21.902799 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896561 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 04 23:54:21.902799 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896566 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 04 23:54:21.902799 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896570 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 04 23:54:21.903141 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.896578 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 04 23:54:21.903141 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896769 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 04 23:54:21.903141 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896777 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 04 23:54:21.903141 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896782 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 04 23:54:21.903141 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896786 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 04 23:54:21.903141 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896790 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 04 23:54:21.903141 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896794 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 04 23:54:21.903141 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896799 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 04 23:54:21.903141 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896804 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 04 23:54:21.903141 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896808 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 04 23:54:21.903141 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896812 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 04 23:54:21.903141 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896816 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 04 23:54:21.903141 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896820 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 04 23:54:21.903141 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896825 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 04 23:54:21.903141 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896829 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896833 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896837 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896842 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896846 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896852 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896859 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896865 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896869 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896874 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896879 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896883 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896888 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896892 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896896 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896901 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896906 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896910 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896914 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 04 23:54:21.903654 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896918 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896922 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896926 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896930 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896934 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896938 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896942 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896946 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896951 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896955 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896960 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896964 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896968 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896972 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896976 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896980 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896984 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896988 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896993 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.896997 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 04 23:54:21.904227 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897001 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897006 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897010 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897014 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897018 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897022 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897027 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897031 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897035 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897040 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897045 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897049 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897053 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897057 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897061 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897067 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897072 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897078 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897082 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897086 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 04 23:54:21.904736 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897090 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897094 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897098 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897102 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897106 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897110 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897118 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897123 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897128 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897133 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897138 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897142 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897147 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897151 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897155 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897159 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897164 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897168 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897172 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 04 23:54:21.905211 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897176 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 04 23:54:21.905696 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897180 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 04 23:54:21.905696 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897184 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 04 23:54:21.905696 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897189 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 04 23:54:21.905696 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897193 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 04 23:54:21.905696 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897197 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 04 23:54:21.905696 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897201 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 04 23:54:21.905696 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:21.897205 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 04 23:54:21.905696 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.897213 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 04 23:54:21.905696 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.897368 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jun 04 23:54:21.905696 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.900043 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 04 23:54:21.905696 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.901384 2564 server.go:1019] "Starting client certificate rotation" Jun 04 23:54:21.905696 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.901487 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 04 23:54:21.905696 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.901520 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 04 23:54:21.906015 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.904351 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 04 23:54:21.906015 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.905441 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 04 23:54:21.915009 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.914992 2564 log.go:25] "Validated CRI v1 runtime API" Jun 04 23:54:21.917304 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.917288 2564 log.go:25] "Validated CRI v1 image API" Jun 04 23:54:21.918876 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.918850 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 04 23:54:21.923905 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.923791 2564 fs.go:135] Filesystem UUIDs: map[40d5b8cc-cf6e-4cd7-8c1d-02935b7c6255:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 962b0d34-5f71-4a08-9f06-2063c781a9a7:/dev/nvme0n1p4] Jun 04 23:54:21.923980 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.923904 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 04 23:54:21.927483 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.927464 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 04 23:54:21.928539 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.928437 2564 manager.go:216] Machine: {Timestamp:2026-06-04 23:54:21.927503868 +0000 UTC m=+0.285072021 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093279 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a6034d8376377856f9d81656a6eb5 SystemUUID:ec2a6034-d837-6377-856f-9d81656a6eb5 BootID:3e8a7365-7071-4eb8-850c-10a050c78db2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3f:2e:a1:2c:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3f:2e:a1:2c:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:e1:4f:a8:af:0a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 04 23:54:21.928539 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.928535 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 04 23:54:21.928661 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.928606 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 04 23:54:21.929464 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.929435 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 04 23:54:21.929643 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.929465 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-8.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 04 23:54:21.930709 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.930696 2564 topology_manager.go:138] "Creating topology manager with none policy" Jun 04 23:54:21.930775 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.930715 2564 container_manager_linux.go:309] "Creating device plugin manager" Jun 04 23:54:21.930775 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.930726 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 04 23:54:21.931393 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.931381 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 04 23:54:21.932471 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.932459 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 04 23:54:21.935540 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.935526 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 04 23:54:21.935668 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.935657 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 04 23:54:21.935752 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.935709 2564 kubelet.go:486] "Attempting to sync node with API server" Jun 04 23:54:21.935752 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.935723 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 04 23:54:21.935752 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.935742 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 04 23:54:21.935876 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.935756 2564 kubelet.go:398] "Adding apiserver pod source" Jun 04 23:54:21.935876 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.935774 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 04 23:54:21.936128 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.936098 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 04 23:54:21.936128 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.936120 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 04 23:54:21.939889 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.939869 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 04 23:54:21.941947 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.941932 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 04 23:54:21.942025 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.941962 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 04 23:54:21.943036 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.943026 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 04 23:54:21.943070 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.943040 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 04 23:54:21.943070 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.943046 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 04 23:54:21.943070 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.943051 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 04 23:54:21.943070 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.943060 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 04 23:54:21.943070 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.943066 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 04 23:54:21.943203 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.943075 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 04 23:54:21.943203 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.943081 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 04 23:54:21.943203 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.943088 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 04 23:54:21.943203 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.943093 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 04 23:54:21.943203 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.943103 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 04 23:54:21.943203 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.943109 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 04 23:54:21.943883 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.943868 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 04 23:54:21.943940 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.943887 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 04 23:54:21.945865 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:21.945842 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 04 23:54:21.945931 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.945898 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-8.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 04 23:54:21.945963 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:21.945925 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 04 23:54:21.947053 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.947040 2564 server.go:1268] "Started kubelet" Jun 04 23:54:21.947144 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.947114 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 04 23:54:21.947268 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.947235 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 04 23:54:21.947372 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.947282 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 04 23:54:21.947967 ip-10-0-140-8 systemd[1]: Started Kubernetes Kubelet. Jun 04 23:54:21.949006 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.948992 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 04 23:54:21.949219 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.949208 2564 server.go:310] "Adding debug handlers to kubelet server" Jun 04 23:54:21.955565 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:21.955548 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 04 23:54:21.956088 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.956070 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 04 23:54:21.956088 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.956082 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 04 23:54:21.956216 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:21.956152 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 04 23:54:21.956763 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.956744 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 04 23:54:21.956859 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.956767 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 04 23:54:21.956859 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.956744 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 04 23:54:21.956957 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.956869 2564 reconstruct.go:97] "Volume reconstruction finished" Jun 04 23:54:21.956957 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.956877 2564 reconciler.go:29] "Reconciler: start to sync state" Jun 04 23:54:21.958332 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.958312 2564 factory.go:55] Registering systemd factory Jun 04 23:54:21.958332 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.958333 2564 factory.go:223] Registration of the systemd container factory successfully Jun 04 23:54:21.959221 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.959204 2564 factory.go:153] Registering CRI-O factory Jun 04 23:54:21.959221 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.959223 2564 factory.go:223] Registration of the crio container factory successfully Jun 04 23:54:21.959379 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.959351 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 04 23:54:21.959505 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.959492 2564 factory.go:103] Registering Raw factory Jun 04 23:54:21.959566 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.959527 2564 manager.go:1196] Started watching for new ooms in manager Jun 04 23:54:21.960012 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.959999 2564 manager.go:349] Starting recovery of all containers Jun 04 23:54:21.967181 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:21.967144 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 04 23:54:21.967181 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:21.963796 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-8.ec2.internal.18b605f73347d4d3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-8.ec2.internal,UID:ip-10-0-140-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-8.ec2.internal,},FirstTimestamp:2026-06-04 23:54:21.947016403 +0000 UTC m=+0.304584537,LastTimestamp:2026-06-04 23:54:21.947016403 +0000 UTC m=+0.304584537,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-8.ec2.internal,}" Jun 04 23:54:21.967574 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:21.967541 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 04 23:54:21.970991 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.970970 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gc8mb" Jun 04 23:54:21.974698 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.974667 2564 manager.go:354] Recovery completed Jun 04 23:54:21.978072 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.978057 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gc8mb" Jun 04 23:54:21.978706 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.978694 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 04 23:54:21.980622 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.980608 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Jun 04 23:54:21.980704 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.980634 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 04 23:54:21.980704 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.980646 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Jun 04 23:54:21.981153 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.981139 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 04 23:54:21.981153 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.981151 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 04 23:54:21.981248 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.981153 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 04 23:54:21.981248 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.981234 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 04 23:54:21.981826 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.981809 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Jun 04 23:54:21.981887 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.981836 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 04 23:54:21.981887 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.981847 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Jun 04 23:54:21.982221 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.982209 2564 policy_none.go:49] "None policy: Start" Jun 04 23:54:21.982274 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.982226 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 04 23:54:21.982274 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.982240 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 04 23:54:21.982450 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:21.982377 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-8.ec2.internal.18b605f735489a92 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-8.ec2.internal,UID:ip-10-0-140-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-8.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-8.ec2.internal,},FirstTimestamp:2026-06-04 23:54:21.980621458 +0000 UTC m=+0.338189594,LastTimestamp:2026-06-04 23:54:21.980621458 +0000 UTC m=+0.338189594,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-8.ec2.internal,}" Jun 04 23:54:21.983142 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:21.983130 2564 policy_none.go:47] "Start" Jun 04 23:54:22.029435 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.021744 2564 manager.go:337] "Starting Device Plugin manager" Jun 04 23:54:22.029435 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:22.021801 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 04 23:54:22.029435 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.021811 2564 server.go:87] "Starting device plugin registration server" Jun 04 23:54:22.029435 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.022038 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 04 23:54:22.029435 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.022051 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 04 23:54:22.029435 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.022162 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 04 23:54:22.029435 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.022706 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 04 23:54:22.029435 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.022717 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 04 23:54:22.029435 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:22.022754 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 04 23:54:22.029435 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:22.022794 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-8.ec2.internal\" not found" Jun 04 23:54:22.029435 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.027954 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 04 23:54:22.029435 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.029028 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 04 23:54:22.029435 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.029075 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 04 23:54:22.029435 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.029101 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jun 04 23:54:22.029435 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:22.029140 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 04 23:54:22.031980 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.031962 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 04 23:54:22.122377 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.122358 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 04 23:54:22.123225 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.123210 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Jun 04 23:54:22.123312 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.123242 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 04 23:54:22.123312 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.123256 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Jun 04 23:54:22.123312 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.123283 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-8.ec2.internal" Jun 04 23:54:22.130262 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.130219 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal"] Jun 04 23:54:22.130323 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.130277 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 04 23:54:22.131655 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.131635 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Jun 04 23:54:22.131730 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.131662 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 04 23:54:22.131730 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.131689 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Jun 04 23:54:22.131802 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.131753 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-8.ec2.internal" Jun 04 23:54:22.131802 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:22.131771 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-8.ec2.internal\": node \"ip-10-0-140-8.ec2.internal\" not found" Jun 04 23:54:22.132863 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.132851 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 04 23:54:22.132991 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.132968 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 04 23:54:22.133026 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.133006 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 04 23:54:22.133463 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.133445 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Jun 04 23:54:22.133541 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.133472 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 04 23:54:22.133541 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.133487 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Jun 04 23:54:22.133541 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.133445 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Jun 04 23:54:22.133541 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.133540 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 04 23:54:22.133692 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.133549 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Jun 04 23:54:22.134824 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.134808 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Jun 04 23:54:22.134908 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.134838 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 04 23:54:22.135475 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.135457 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Jun 04 23:54:22.135539 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.135489 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 04 23:54:22.135539 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.135505 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Jun 04 23:54:22.154107 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:22.154084 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 04 23:54:22.157277 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.157253 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/05c829215119f6b730755cdeec6d1f30-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"05c829215119f6b730755cdeec6d1f30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 04 23:54:22.157352 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.157287 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05c829215119f6b730755cdeec6d1f30-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"05c829215119f6b730755cdeec6d1f30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 04 23:54:22.157352 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.157304 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98bac051df6d1eb92d9dcd6f09edbb90-config\") pod \"kube-apiserver-proxy-ip-10-0-140-8.ec2.internal\" (UID: \"98bac051df6d1eb92d9dcd6f09edbb90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Jun 04 23:54:22.160216 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:22.160202 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-8.ec2.internal\" not found" node="ip-10-0-140-8.ec2.internal" Jun 04 23:54:22.164876 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:22.164861 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-8.ec2.internal\" not found" node="ip-10-0-140-8.ec2.internal" Jun 04 23:54:22.254758 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:22.254741 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 04 23:54:22.258010 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.257994 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/05c829215119f6b730755cdeec6d1f30-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"05c829215119f6b730755cdeec6d1f30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 04 23:54:22.258052 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.258020 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05c829215119f6b730755cdeec6d1f30-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"05c829215119f6b730755cdeec6d1f30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 04 23:54:22.258052 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.258035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98bac051df6d1eb92d9dcd6f09edbb90-config\") pod \"kube-apiserver-proxy-ip-10-0-140-8.ec2.internal\" (UID: \"98bac051df6d1eb92d9dcd6f09edbb90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Jun 04 23:54:22.258126 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.258076 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98bac051df6d1eb92d9dcd6f09edbb90-config\") pod \"kube-apiserver-proxy-ip-10-0-140-8.ec2.internal\" (UID: \"98bac051df6d1eb92d9dcd6f09edbb90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Jun 04 23:54:22.258126 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.258096 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/05c829215119f6b730755cdeec6d1f30-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"05c829215119f6b730755cdeec6d1f30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 04 23:54:22.258126 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.258107 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05c829215119f6b730755cdeec6d1f30-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"05c829215119f6b730755cdeec6d1f30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 04 23:54:22.355647 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:22.355627 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 04 23:54:22.456294 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:22.456250 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 04 23:54:22.465641 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.465622 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 04 23:54:22.469697 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.469659 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Jun 04 23:54:22.556306 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:22.556284 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 04 23:54:22.656436 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:22.656410 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 04 23:54:22.756880 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:22.756824 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 04 23:54:22.857227 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:22.857204 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 04 23:54:22.900557 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.900529 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 04 23:54:22.901144 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.900710 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 04 23:54:22.958202 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:22.958184 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 04 23:54:22.962409 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:22.962373 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c829215119f6b730755cdeec6d1f30.slice/crio-00baa6683b23463a213e68a8cdded9cc37de43fd5495273c85ddfacfde05c754 WatchSource:0}: Error finding container 00baa6683b23463a213e68a8cdded9cc37de43fd5495273c85ddfacfde05c754: Status 404 returned error can't find the container with id 00baa6683b23463a213e68a8cdded9cc37de43fd5495273c85ddfacfde05c754 Jun 04 23:54:22.962757 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:22.962742 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98bac051df6d1eb92d9dcd6f09edbb90.slice/crio-91170be526de2a3e98f58b8c49f04e2684be34bb25e83508e34043aac3164c9c WatchSource:0}: Error finding container 91170be526de2a3e98f58b8c49f04e2684be34bb25e83508e34043aac3164c9c: Status 404 returned error can't find the container with id 91170be526de2a3e98f58b8c49f04e2684be34bb25e83508e34043aac3164c9c Jun 04 23:54:22.968288 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.968262 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 04 23:54:22.979957 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.979930 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-03 23:49:21 +0000 UTC" deadline="2027-11-24 19:52:55.910987655 +0000 UTC" Jun 04 23:54:22.979957 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:22.979955 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12907h58m32.931035912s" Jun 04 23:54:23.020698 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.020637 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 04 23:54:23.031728 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.031685 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" event={"ID":"98bac051df6d1eb92d9dcd6f09edbb90","Type":"ContainerStarted","Data":"91170be526de2a3e98f58b8c49f04e2684be34bb25e83508e34043aac3164c9c"} Jun 04 23:54:23.032625 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.032603 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" event={"ID":"05c829215119f6b730755cdeec6d1f30","Type":"ContainerStarted","Data":"00baa6683b23463a213e68a8cdded9cc37de43fd5495273c85ddfacfde05c754"} Jun 04 23:54:23.058914 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:23.058897 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 04 23:54:23.116814 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.116795 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 04 23:54:23.156548 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.156528 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 04 23:54:23.170748 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.170732 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 04 23:54:23.172505 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.172493 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Jun 04 23:54:23.181009 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.180996 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 04 23:54:23.451991 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.451916 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 04 23:54:23.937217 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.937005 2564 apiserver.go:52] "Watching apiserver" Jun 04 23:54:23.946614 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.946591 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 04 23:54:23.948313 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.948290 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp","openshift-cluster-node-tuning-operator/tuned-lgq2v","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal","openshift-dns/node-resolver-n29wb","openshift-image-registry/node-ca-qdfkf","openshift-multus/multus-additional-cni-plugins-k62wx","openshift-multus/multus-rl4dv","openshift-multus/network-metrics-daemon-kf8nr","openshift-network-diagnostics/network-check-target-nb7vh","openshift-network-operator/iptables-alerter-c84x5","openshift-ovn-kubernetes/ovnkube-node-wjspd","kube-system/global-pull-secret-syncer-258hw","kube-system/konnectivity-agent-s5zd2","kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal"] Jun 04 23:54:23.950286 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.950264 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.951639 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.951618 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s5zd2" Jun 04 23:54:23.952591 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.952571 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:23.952703 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:23.952649 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:23.953290 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.953273 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 04 23:54:23.953373 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.953349 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gvplf\"" Jun 04 23:54:23.953493 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.953473 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 04 23:54:23.953577 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.953559 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 04 23:54:23.954111 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.953761 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 04 23:54:23.954111 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.953982 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n29wb" Jun 04 23:54:23.955413 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.954664 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 04 23:54:23.955413 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.954791 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 04 23:54:23.955413 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.954853 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rbtc5\"" Jun 04 23:54:23.955413 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.955132 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qdfkf" Jun 04 23:54:23.956378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.956345 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 04 23:54:23.957472 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.957453 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:23.957827 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.957805 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 04 23:54:23.958481 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.958381 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 04 23:54:23.958587 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.958569 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 04 23:54:23.959392 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.958891 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dn4xk\"" Jun 04 23:54:23.959392 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.958966 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p4m86\"" Jun 04 23:54:23.959392 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.959131 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 04 23:54:23.959392 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.959325 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 04 23:54:23.960666 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.960621 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 04 23:54:23.960666 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.960637 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:23.960827 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.960647 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cjz2t\"" Jun 04 23:54:23.960827 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:23.960727 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb7vh" podUID="1b31f8cd-0950-4ab0-9058-a7e32d4a3c51" Jun 04 23:54:23.961936 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.961918 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 04 23:54:23.962042 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.962025 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:23.963715 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.963694 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:23.965104 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.964868 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 04 23:54:23.965104 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.964922 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6mvx7\"" Jun 04 23:54:23.965104 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.964937 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 04 23:54:23.965296 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.965149 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 04 23:54:23.965296 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.965154 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c84x5" Jun 04 23:54:23.965853 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.965833 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c455b1df-b214-4095-9eeb-fc421b4f1ace-konnectivity-ca\") pod \"konnectivity-agent-s5zd2\" (UID: \"c455b1df-b214-4095-9eeb-fc421b4f1ace\") " pod="kube-system/konnectivity-agent-s5zd2" Jun 04 23:54:23.965943 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.965866 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54d5011b-d74d-4c1c-adef-cfd356716eb0-hosts-file\") pod \"node-resolver-n29wb\" (UID: \"54d5011b-d74d-4c1c-adef-cfd356716eb0\") " pod="openshift-dns/node-resolver-n29wb" Jun 04 23:54:23.965943 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.965891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-multus-socket-dir-parent\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.965943 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.965914 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:23.965943 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.965938 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-multus-cni-dir\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.966123 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.965961 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87545838-85a4-4044-96cd-8a369a9a95ab-multus-daemon-config\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.966123 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.965997 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-run-multus-certs\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.966123 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966029 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c455b1df-b214-4095-9eeb-fc421b4f1ace-agent-certs\") pod \"konnectivity-agent-s5zd2\" (UID: \"c455b1df-b214-4095-9eeb-fc421b4f1ace\") " pod="kube-system/konnectivity-agent-s5zd2" Jun 04 23:54:23.966123 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966053 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khp8q\" (UniqueName: \"kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q\") pod \"network-check-target-nb7vh\" (UID: \"1b31f8cd-0950-4ab0-9058-a7e32d4a3c51\") " pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:23.966123 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966072 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-system-cni-dir\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.966123 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966093 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-os-release\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.966123 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966113 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-etc-kubernetes\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.966383 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966136 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:23.966383 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966173 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgpx5\" (UniqueName: \"kubernetes.io/projected/04667814-8f0e-4653-a2a1-0b2fd6431e61-kube-api-access-lgpx5\") pod \"network-metrics-daemon-kf8nr\" (UID: \"04667814-8f0e-4653-a2a1-0b2fd6431e61\") " pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:23.966383 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54d5011b-d74d-4c1c-adef-cfd356716eb0-tmp-dir\") pod \"node-resolver-n29wb\" (UID: \"54d5011b-d74d-4c1c-adef-cfd356716eb0\") " pod="openshift-dns/node-resolver-n29wb" Jun 04 23:54:23.966383 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966230 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 04 23:54:23.966383 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966245 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-var-lib-kubelet\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.966383 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966252 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 04 23:54:23.966383 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-multus-conf-dir\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.966383 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966304 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-cni-binary-copy\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:23.966383 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966328 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:23.966383 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gpf9\" (UniqueName: \"kubernetes.io/projected/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-kube-api-access-7gpf9\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:23.966383 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-cnibin\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.966897 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966398 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq8n4\" (UniqueName: \"kubernetes.io/projected/dd7ef963-f56f-424d-9065-a736675ad48a-kube-api-access-dq8n4\") pod \"node-ca-qdfkf\" (UID: \"dd7ef963-f56f-424d-9065-a736675ad48a\") " pod="openshift-image-registry/node-ca-qdfkf" Jun 04 23:54:23.966897 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-system-cni-dir\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:23.966897 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966444 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-cnibin\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:23.966897 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966466 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87545838-85a4-4044-96cd-8a369a9a95ab-cni-binary-copy\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.966897 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966488 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-var-lib-cni-bin\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.966897 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966508 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd7ef963-f56f-424d-9065-a736675ad48a-host\") pod \"node-ca-qdfkf\" (UID: \"dd7ef963-f56f-424d-9065-a736675ad48a\") " pod="openshift-image-registry/node-ca-qdfkf" Jun 04 23:54:23.966897 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966528 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd7ef963-f56f-424d-9065-a736675ad48a-serviceca\") pod \"node-ca-qdfkf\" (UID: \"dd7ef963-f56f-424d-9065-a736675ad48a\") " pod="openshift-image-registry/node-ca-qdfkf" Jun 04 23:54:23.966897 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966548 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-llx9j\"" Jun 04 23:54:23.966897 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-os-release\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:23.966897 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966588 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk88r\" (UniqueName: \"kubernetes.io/projected/87545838-85a4-4044-96cd-8a369a9a95ab-kube-api-access-rk88r\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.966897 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966610 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs\") pod \"network-metrics-daemon-kf8nr\" (UID: \"04667814-8f0e-4653-a2a1-0b2fd6431e61\") " pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:23.966897 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966630 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-run-k8s-cni-cncf-io\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.966897 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966645 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-run-netns\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.966897 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966659 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-var-lib-cni-multus\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.966897 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966709 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2llt\" (UniqueName: \"kubernetes.io/projected/54d5011b-d74d-4c1c-adef-cfd356716eb0-kube-api-access-c2llt\") pod \"node-resolver-n29wb\" (UID: \"54d5011b-d74d-4c1c-adef-cfd356716eb0\") " pod="openshift-dns/node-resolver-n29wb" Jun 04 23:54:23.966897 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966737 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-hostroot\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:23.967540 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.966951 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:23.967760 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.967629 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 04 23:54:23.967760 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.967654 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 04 23:54:23.967930 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.967914 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 04 23:54:23.967981 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.967955 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mh8qm\"" Jun 04 23:54:23.969205 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.969183 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:23.969295 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.969209 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 04 23:54:23.969295 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:23.969241 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:23.969967 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.969949 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 04 23:54:23.970070 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.970050 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 04 23:54:23.970173 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.970085 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 04 23:54:23.971538 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.971521 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 04 23:54:23.971629 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.971519 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 04 23:54:23.971629 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.971523 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 04 23:54:23.971842 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.971827 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-99rzm\"" Jun 04 23:54:23.989657 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:23.989638 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c84pm" Jun 04 23:54:24.000269 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.000254 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c84pm" Jun 04 23:54:24.058774 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.058744 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 04 23:54:24.066965 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.066941 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-systemd\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.066965 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.066973 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-run-systemd\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.067166 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.066996 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-dbus\") pod \"global-pull-secret-syncer-258hw\" (UID: \"1b04efb1-c48b-4cde-b23e-fcf4ecee8253\") " pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:24.067166 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-cnibin\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.067166 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067045 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq8n4\" (UniqueName: \"kubernetes.io/projected/dd7ef963-f56f-424d-9065-a736675ad48a-kube-api-access-dq8n4\") pod \"node-ca-qdfkf\" (UID: \"dd7ef963-f56f-424d-9065-a736675ad48a\") " pod="openshift-image-registry/node-ca-qdfkf" Jun 04 23:54:24.067166 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-system-cni-dir\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:24.067166 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-cnibin\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:24.067166 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067107 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-slash\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.067166 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067130 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0ab52123-f827-4255-8a84-49ff8208148f-env-overrides\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.067166 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067137 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-cnibin\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.067166 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067153 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87545838-85a4-4044-96cd-8a369a9a95ab-cni-binary-copy\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.067578 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067194 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-var-lib-cni-bin\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.067578 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd7ef963-f56f-424d-9065-a736675ad48a-host\") pod \"node-ca-qdfkf\" (UID: \"dd7ef963-f56f-424d-9065-a736675ad48a\") " pod="openshift-image-registry/node-ca-qdfkf" Jun 04 23:54:24.067578 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067241 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd7ef963-f56f-424d-9065-a736675ad48a-serviceca\") pod \"node-ca-qdfkf\" (UID: \"dd7ef963-f56f-424d-9065-a736675ad48a\") " pod="openshift-image-registry/node-ca-qdfkf" Jun 04 23:54:24.067578 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067275 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-os-release\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:24.067578 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067300 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-run-ovn-kubernetes\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.067578 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067326 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-cni-bin\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.067578 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk88r\" (UniqueName: \"kubernetes.io/projected/87545838-85a4-4044-96cd-8a369a9a95ab-kube-api-access-rk88r\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.067578 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs\") pod \"network-metrics-daemon-kf8nr\" (UID: \"04667814-8f0e-4653-a2a1-0b2fd6431e61\") " pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:24.067578 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067395 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-run-k8s-cni-cncf-io\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.067578 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067416 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.067578 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067444 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqkqb\" (UniqueName: \"kubernetes.io/projected/0ab52123-f827-4255-8a84-49ff8208148f-kube-api-access-hqkqb\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.067578 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-hostroot\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.067578 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067492 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-sysctl-d\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.067578 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067513 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-sys\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.067578 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067537 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-etc-openvswitch\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.067578 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067535 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-cnibin\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:24.067578 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067560 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0ab52123-f827-4255-8a84-49ff8208148f-ovnkube-script-lib\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.068394 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067610 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c455b1df-b214-4095-9eeb-fc421b4f1ace-konnectivity-ca\") pod \"konnectivity-agent-s5zd2\" (UID: \"c455b1df-b214-4095-9eeb-fc421b4f1ace\") " pod="kube-system/konnectivity-agent-s5zd2" Jun 04 23:54:24.068394 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067610 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-system-cni-dir\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:24.068394 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067647 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-lib-modules\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.068394 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067664 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-var-lib-cni-bin\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.068394 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067692 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-systemd-units\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.068394 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067718 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-run-ovn\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.068394 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067725 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd7ef963-f56f-424d-9065-a736675ad48a-host\") pod \"node-ca-qdfkf\" (UID: \"dd7ef963-f56f-424d-9065-a736675ad48a\") " pod="openshift-image-registry/node-ca-qdfkf" Jun 04 23:54:24.068394 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067743 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87545838-85a4-4044-96cd-8a369a9a95ab-cni-binary-copy\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.068394 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067747 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.068394 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067777 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-kubelet-config\") pod \"global-pull-secret-syncer-258hw\" (UID: \"1b04efb1-c48b-4cde-b23e-fcf4ecee8253\") " pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:24.068394 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067866 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-os-release\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:24.068394 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067928 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-run-k8s-cni-cncf-io\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.068394 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.067987 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-hostroot\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.068394 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:24.068051 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:24.068394 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068133 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-multus-cni-dir\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.068394 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068154 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd7ef963-f56f-424d-9065-a736675ad48a-serviceca\") pod \"node-ca-qdfkf\" (UID: \"dd7ef963-f56f-424d-9065-a736675ad48a\") " pod="openshift-image-registry/node-ca-qdfkf" Jun 04 23:54:24.068394 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:24.068160 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs podName:04667814-8f0e-4653-a2a1-0b2fd6431e61 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:24.568126699 +0000 UTC m=+2.925694819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs") pod "network-metrics-daemon-kf8nr" (UID: "04667814-8f0e-4653-a2a1-0b2fd6431e61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:24.069167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068214 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87545838-85a4-4044-96cd-8a369a9a95ab-multus-daemon-config\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.069167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068242 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-sysctl-conf\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.069167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068217 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-multus-cni-dir\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.069167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068267 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-var-lib-openvswitch\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.069167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068310 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0ab52123-f827-4255-8a84-49ff8208148f-ovnkube-config\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.069167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068333 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-var-lib-kubelet\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.069167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068357 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-os-release\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.069167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068404 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-run\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.069167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068430 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c455b1df-b214-4095-9eeb-fc421b4f1ace-konnectivity-ca\") pod \"konnectivity-agent-s5zd2\" (UID: \"c455b1df-b214-4095-9eeb-fc421b4f1ace\") " pod="kube-system/konnectivity-agent-s5zd2" Jun 04 23:54:24.069167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068436 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-os-release\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.069167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068453 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-node-log\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.069167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068493 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ab52123-f827-4255-8a84-49ff8208148f-ovn-node-metrics-cert\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.069167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068525 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgpx5\" (UniqueName: \"kubernetes.io/projected/04667814-8f0e-4653-a2a1-0b2fd6431e61-kube-api-access-lgpx5\") pod \"network-metrics-daemon-kf8nr\" (UID: \"04667814-8f0e-4653-a2a1-0b2fd6431e61\") " pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:24.069167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068553 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54d5011b-d74d-4c1c-adef-cfd356716eb0-tmp-dir\") pod \"node-resolver-n29wb\" (UID: \"54d5011b-d74d-4c1c-adef-cfd356716eb0\") " pod="openshift-dns/node-resolver-n29wb" Jun 04 23:54:24.069167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-cni-binary-copy\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:24.069167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:24.069167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068640 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-registration-dir\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.070157 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068659 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87545838-85a4-4044-96cd-8a369a9a95ab-multus-daemon-config\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.070157 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-device-dir\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.070157 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068702 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-sys-fs\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.070157 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068729 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-sysconfig\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.070157 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068766 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-kubernetes\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.070157 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ca9e683-9c65-4e7d-8e1f-d668feb920bc-iptables-alerter-script\") pod \"iptables-alerter-c84x5\" (UID: \"6ca9e683-9c65-4e7d-8e1f-d668feb920bc\") " pod="openshift-network-operator/iptables-alerter-c84x5" Jun 04 23:54:24.070157 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068812 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-cni-netd\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.070157 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068831 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-socket-dir\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.070157 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ca9e683-9c65-4e7d-8e1f-d668feb920bc-host-slash\") pod \"iptables-alerter-c84x5\" (UID: \"6ca9e683-9c65-4e7d-8e1f-d668feb920bc\") " pod="openshift-network-operator/iptables-alerter-c84x5" Jun 04 23:54:24.070157 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068887 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-run-netns\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.070157 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068893 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54d5011b-d74d-4c1c-adef-cfd356716eb0-tmp-dir\") pod \"node-resolver-n29wb\" (UID: \"54d5011b-d74d-4c1c-adef-cfd356716eb0\") " pod="openshift-dns/node-resolver-n29wb" Jun 04 23:54:24.070157 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068907 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret\") pod \"global-pull-secret-syncer-258hw\" (UID: \"1b04efb1-c48b-4cde-b23e-fcf4ecee8253\") " pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:24.070157 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068941 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-run-netns\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.070157 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068958 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-var-lib-cni-multus\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.070157 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.068983 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-modprobe-d\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.070157 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069007 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2llt\" (UniqueName: \"kubernetes.io/projected/54d5011b-d74d-4c1c-adef-cfd356716eb0-kube-api-access-c2llt\") pod \"node-resolver-n29wb\" (UID: \"54d5011b-d74d-4c1c-adef-cfd356716eb0\") " pod="openshift-dns/node-resolver-n29wb" Jun 04 23:54:24.070157 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069013 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-run-netns\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.070828 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069029 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-host\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.070828 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069031 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-var-lib-cni-multus\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.070828 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069053 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqh87\" (UniqueName: \"kubernetes.io/projected/307b15de-f46b-41fd-a7ff-c9f455182572-kube-api-access-gqh87\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.070828 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069072 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-cni-binary-copy\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:24.070828 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069077 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-run-openvswitch\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.070828 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069130 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-log-socket\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.070828 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069139 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:24.070828 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54d5011b-d74d-4c1c-adef-cfd356716eb0-hosts-file\") pod \"node-resolver-n29wb\" (UID: \"54d5011b-d74d-4c1c-adef-cfd356716eb0\") " pod="openshift-dns/node-resolver-n29wb" Jun 04 23:54:24.070828 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-multus-socket-dir-parent\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.070828 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069224 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:24.070828 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069247 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-etc-selinux\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.070828 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069249 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54d5011b-d74d-4c1c-adef-cfd356716eb0-hosts-file\") pod \"node-resolver-n29wb\" (UID: \"54d5011b-d74d-4c1c-adef-cfd356716eb0\") " pod="openshift-dns/node-resolver-n29wb" Jun 04 23:54:24.070828 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069264 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95mcr\" (UniqueName: \"kubernetes.io/projected/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-kube-api-access-95mcr\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.070828 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-run-multus-certs\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.070828 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069399 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/307b15de-f46b-41fd-a7ff-c9f455182572-etc-tuned\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.070828 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069406 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-multus-socket-dir-parent\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.070828 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069433 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tldnf\" (UniqueName: \"kubernetes.io/projected/6ca9e683-9c65-4e7d-8e1f-d668feb920bc-kube-api-access-tldnf\") pod \"iptables-alerter-c84x5\" (UID: \"6ca9e683-9c65-4e7d-8e1f-d668feb920bc\") " pod="openshift-network-operator/iptables-alerter-c84x5" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069419 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069461 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c455b1df-b214-4095-9eeb-fc421b4f1ace-agent-certs\") pod \"konnectivity-agent-s5zd2\" (UID: \"c455b1df-b214-4095-9eeb-fc421b4f1ace\") " pod="kube-system/konnectivity-agent-s5zd2" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069464 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-run-multus-certs\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069484 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khp8q\" (UniqueName: \"kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q\") pod \"network-check-target-nb7vh\" (UID: \"1b31f8cd-0950-4ab0-9058-a7e32d4a3c51\") " pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069509 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-system-cni-dir\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-etc-kubernetes\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069558 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069592 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-system-cni-dir\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069655 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-etc-kubernetes\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069712 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/307b15de-f46b-41fd-a7ff-c9f455182572-tmp\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069737 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-kubelet\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069778 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-var-lib-kubelet\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069802 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-multus-conf-dir\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069837 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gpf9\" (UniqueName: \"kubernetes.io/projected/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-kube-api-access-7gpf9\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069817 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-host-var-lib-kubelet\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069891 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.069893 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87545838-85a4-4044-96cd-8a369a9a95ab-multus-conf-dir\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.071554 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.070009 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:24.073816 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.073773 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c455b1df-b214-4095-9eeb-fc421b4f1ace-agent-certs\") pod \"konnectivity-agent-s5zd2\" (UID: \"c455b1df-b214-4095-9eeb-fc421b4f1ace\") " pod="kube-system/konnectivity-agent-s5zd2" Jun 04 23:54:24.078818 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.078764 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgpx5\" (UniqueName: \"kubernetes.io/projected/04667814-8f0e-4653-a2a1-0b2fd6431e61-kube-api-access-lgpx5\") pod \"network-metrics-daemon-kf8nr\" (UID: \"04667814-8f0e-4653-a2a1-0b2fd6431e61\") " pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:24.081490 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:24.081473 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 04 23:54:24.081579 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:24.081496 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 04 23:54:24.081579 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:24.081508 2564 projected.go:196] Error preparing data for projected volume kube-api-access-khp8q for pod openshift-network-diagnostics/network-check-target-nb7vh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:24.081579 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:24.081557 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q podName:1b31f8cd-0950-4ab0-9058-a7e32d4a3c51 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:24.581540845 +0000 UTC m=+2.939108979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-khp8q" (UniqueName: "kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q") pod "network-check-target-nb7vh" (UID: "1b31f8cd-0950-4ab0-9058-a7e32d4a3c51") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:24.082191 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.082167 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq8n4\" (UniqueName: \"kubernetes.io/projected/dd7ef963-f56f-424d-9065-a736675ad48a-kube-api-access-dq8n4\") pod \"node-ca-qdfkf\" (UID: \"dd7ef963-f56f-424d-9065-a736675ad48a\") " pod="openshift-image-registry/node-ca-qdfkf" Jun 04 23:54:24.082279 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.082190 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk88r\" (UniqueName: \"kubernetes.io/projected/87545838-85a4-4044-96cd-8a369a9a95ab-kube-api-access-rk88r\") pod \"multus-rl4dv\" (UID: \"87545838-85a4-4044-96cd-8a369a9a95ab\") " pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.084279 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.084236 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2llt\" (UniqueName: \"kubernetes.io/projected/54d5011b-d74d-4c1c-adef-cfd356716eb0-kube-api-access-c2llt\") pod \"node-resolver-n29wb\" (UID: \"54d5011b-d74d-4c1c-adef-cfd356716eb0\") " pod="openshift-dns/node-resolver-n29wb" Jun 04 23:54:24.084566 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.084461 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gpf9\" (UniqueName: \"kubernetes.io/projected/95208ebe-68e1-43e0-9ba0-5fe7fba6d15f-kube-api-access-7gpf9\") pod \"multus-additional-cni-plugins-k62wx\" (UID: \"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f\") " pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:24.170369 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/307b15de-f46b-41fd-a7ff-c9f455182572-etc-tuned\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.170369 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170374 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tldnf\" (UniqueName: \"kubernetes.io/projected/6ca9e683-9c65-4e7d-8e1f-d668feb920bc-kube-api-access-tldnf\") pod \"iptables-alerter-c84x5\" (UID: \"6ca9e683-9c65-4e7d-8e1f-d668feb920bc\") " pod="openshift-network-operator/iptables-alerter-c84x5" Jun 04 23:54:24.170631 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170401 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/307b15de-f46b-41fd-a7ff-c9f455182572-tmp\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.170631 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170420 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-kubelet\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.170631 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170445 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-systemd\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.170631 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-run-systemd\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.170631 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-dbus\") pod \"global-pull-secret-syncer-258hw\" (UID: \"1b04efb1-c48b-4cde-b23e-fcf4ecee8253\") " pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:24.170631 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170555 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-kubelet\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.170631 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170580 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-run-systemd\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.170631 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170559 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-systemd\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.170631 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170619 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-slash\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171071 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170647 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0ab52123-f827-4255-8a84-49ff8208148f-env-overrides\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171071 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170655 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-slash\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171071 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170692 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-run-ovn-kubernetes\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171071 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170729 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-cni-bin\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171071 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170692 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-dbus\") pod \"global-pull-secret-syncer-258hw\" (UID: \"1b04efb1-c48b-4cde-b23e-fcf4ecee8253\") " pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:24.171071 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.171071 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170771 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-run-ovn-kubernetes\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171071 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170787 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-cni-bin\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171071 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170796 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqkqb\" (UniqueName: \"kubernetes.io/projected/0ab52123-f827-4255-8a84-49ff8208148f-kube-api-access-hqkqb\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171071 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-sysctl-d\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.171071 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170840 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.171071 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170852 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-sys\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.171071 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170872 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-etc-openvswitch\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171071 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170896 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0ab52123-f827-4255-8a84-49ff8208148f-ovnkube-script-lib\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171071 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170920 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-lib-modules\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.171071 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170939 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-systemd-units\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171071 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170957 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-run-ovn\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171896 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170981 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171896 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.170992 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-sysctl-d\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.171896 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-kubelet-config\") pod \"global-pull-secret-syncer-258hw\" (UID: \"1b04efb1-c48b-4cde-b23e-fcf4ecee8253\") " pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:24.171896 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-sysctl-conf\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.171896 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171040 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-systemd-units\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171896 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-var-lib-openvswitch\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171896 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171090 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0ab52123-f827-4255-8a84-49ff8208148f-ovnkube-config\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171896 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171105 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-sys\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.171896 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171118 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-lib-modules\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.171896 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-var-lib-kubelet\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.171896 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171147 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-run\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.171896 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171159 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-etc-openvswitch\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171896 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171170 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-kubelet-config\") pod \"global-pull-secret-syncer-258hw\" (UID: \"1b04efb1-c48b-4cde-b23e-fcf4ecee8253\") " pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:24.171896 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-node-log\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171896 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171206 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ab52123-f827-4255-8a84-49ff8208148f-ovn-node-metrics-cert\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171896 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171209 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-node-log\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.171896 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171209 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-run-ovn\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.172642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-registration-dir\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.172642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-device-dir\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.172642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171266 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-var-lib-kubelet\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.172642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171284 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-sys-fs\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.172642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171310 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-sysconfig\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.172642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171316 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-run\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.172642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171334 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-kubernetes\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.172642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171335 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0ab52123-f827-4255-8a84-49ff8208148f-ovnkube-script-lib\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.172642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171363 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-registration-dir\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.172642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171369 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ca9e683-9c65-4e7d-8e1f-d668feb920bc-iptables-alerter-script\") pod \"iptables-alerter-c84x5\" (UID: \"6ca9e683-9c65-4e7d-8e1f-d668feb920bc\") " pod="openshift-network-operator/iptables-alerter-c84x5" Jun 04 23:54:24.172642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171380 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-kubernetes\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.172642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171390 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-cni-netd\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.172642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171406 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-socket-dir\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.172642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171408 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.172642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ca9e683-9c65-4e7d-8e1f-d668feb920bc-host-slash\") pod \"iptables-alerter-c84x5\" (UID: \"6ca9e683-9c65-4e7d-8e1f-d668feb920bc\") " pod="openshift-network-operator/iptables-alerter-c84x5" Jun 04 23:54:24.172642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171423 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-device-dir\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.172642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171437 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-run-netns\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.173284 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171470 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret\") pod \"global-pull-secret-syncer-258hw\" (UID: \"1b04efb1-c48b-4cde-b23e-fcf4ecee8253\") " pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:24.173284 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171472 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-sys-fs\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.173284 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171498 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-modprobe-d\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.173284 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171506 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-cni-netd\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.173284 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-host\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.173284 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171546 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqh87\" (UniqueName: \"kubernetes.io/projected/307b15de-f46b-41fd-a7ff-c9f455182572-kube-api-access-gqh87\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.173284 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171569 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-run-openvswitch\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.173284 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171575 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-socket-dir\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.173284 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171602 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ca9e683-9c65-4e7d-8e1f-d668feb920bc-host-slash\") pod \"iptables-alerter-c84x5\" (UID: \"6ca9e683-9c65-4e7d-8e1f-d668feb920bc\") " pod="openshift-network-operator/iptables-alerter-c84x5" Jun 04 23:54:24.173284 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-log-socket\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.173284 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171628 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-host-run-netns\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.173284 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171636 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-etc-selinux\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.173284 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171657 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-host\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.173284 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171664 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95mcr\" (UniqueName: \"kubernetes.io/projected/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-kube-api-access-95mcr\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.173284 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171706 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-sysconfig\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.173284 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171720 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0ab52123-f827-4255-8a84-49ff8208148f-ovnkube-config\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.173284 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171766 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0ab52123-f827-4255-8a84-49ff8208148f-env-overrides\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.173917 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171811 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-modprobe-d\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.173917 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171960 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-run-openvswitch\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.173917 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171930 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-log-socket\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.173917 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.171964 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ab52123-f827-4255-8a84-49ff8208148f-var-lib-openvswitch\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.173917 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:24.172039 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:24.173917 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.172079 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/307b15de-f46b-41fd-a7ff-c9f455182572-etc-sysctl-conf\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.173917 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:24.172088 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret podName:1b04efb1-c48b-4cde-b23e-fcf4ecee8253 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:24.67207308 +0000 UTC m=+3.029641207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret") pod "global-pull-secret-syncer-258hw" (UID: "1b04efb1-c48b-4cde-b23e-fcf4ecee8253") : object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:24.173917 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.172142 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-etc-selinux\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.173917 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.172214 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ca9e683-9c65-4e7d-8e1f-d668feb920bc-iptables-alerter-script\") pod \"iptables-alerter-c84x5\" (UID: \"6ca9e683-9c65-4e7d-8e1f-d668feb920bc\") " pod="openshift-network-operator/iptables-alerter-c84x5" Jun 04 23:54:24.173917 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.173132 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/307b15de-f46b-41fd-a7ff-c9f455182572-etc-tuned\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.173917 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.173430 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/307b15de-f46b-41fd-a7ff-c9f455182572-tmp\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.173917 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.173783 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ab52123-f827-4255-8a84-49ff8208148f-ovn-node-metrics-cert\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.178202 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.178114 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tldnf\" (UniqueName: \"kubernetes.io/projected/6ca9e683-9c65-4e7d-8e1f-d668feb920bc-kube-api-access-tldnf\") pod \"iptables-alerter-c84x5\" (UID: \"6ca9e683-9c65-4e7d-8e1f-d668feb920bc\") " pod="openshift-network-operator/iptables-alerter-c84x5" Jun 04 23:54:24.178423 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.178402 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqkqb\" (UniqueName: \"kubernetes.io/projected/0ab52123-f827-4255-8a84-49ff8208148f-kube-api-access-hqkqb\") pod \"ovnkube-node-wjspd\" (UID: \"0ab52123-f827-4255-8a84-49ff8208148f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.180208 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.180155 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqh87\" (UniqueName: \"kubernetes.io/projected/307b15de-f46b-41fd-a7ff-c9f455182572-kube-api-access-gqh87\") pod \"tuned-lgq2v\" (UID: \"307b15de-f46b-41fd-a7ff-c9f455182572\") " pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.180208 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.180203 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95mcr\" (UniqueName: \"kubernetes.io/projected/24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3-kube-api-access-95mcr\") pod \"aws-ebs-csi-driver-node-m8ljp\" (UID: \"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.262834 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.262742 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rl4dv" Jun 04 23:54:24.271461 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.271440 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-s5zd2" Jun 04 23:54:24.279696 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.279665 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n29wb" Jun 04 23:54:24.282756 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.282736 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qdfkf" Jun 04 23:54:24.288822 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.288805 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k62wx" Jun 04 23:54:24.296082 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.296061 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" Jun 04 23:54:24.303269 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.303248 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" Jun 04 23:54:24.310402 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.310384 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c84x5" Jun 04 23:54:24.313923 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.313904 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 04 23:54:24.316129 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.316113 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:24.574925 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.574843 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs\") pod \"network-metrics-daemon-kf8nr\" (UID: \"04667814-8f0e-4653-a2a1-0b2fd6431e61\") " pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:24.575063 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:24.574977 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:24.575063 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:24.575044 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs podName:04667814-8f0e-4653-a2a1-0b2fd6431e61 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:25.575023618 +0000 UTC m=+3.932591742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs") pod "network-metrics-daemon-kf8nr" (UID: "04667814-8f0e-4653-a2a1-0b2fd6431e61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:24.675660 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.675626 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret\") pod \"global-pull-secret-syncer-258hw\" (UID: \"1b04efb1-c48b-4cde-b23e-fcf4ecee8253\") " pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:24.675824 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:24.675669 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khp8q\" (UniqueName: \"kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q\") pod \"network-check-target-nb7vh\" (UID: \"1b31f8cd-0950-4ab0-9058-a7e32d4a3c51\") " pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:24.675824 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:24.675789 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:24.675917 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:24.675858 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret podName:1b04efb1-c48b-4cde-b23e-fcf4ecee8253 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:25.675839587 +0000 UTC m=+4.033407713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret") pod "global-pull-secret-syncer-258hw" (UID: "1b04efb1-c48b-4cde-b23e-fcf4ecee8253") : object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:24.675917 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:24.675861 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 04 23:54:24.675917 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:24.675882 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 04 23:54:24.675917 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:24.675893 2564 projected.go:196] Error preparing data for projected volume kube-api-access-khp8q for pod openshift-network-diagnostics/network-check-target-nb7vh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:24.676105 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:24.675940 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q podName:1b31f8cd-0950-4ab0-9058-a7e32d4a3c51 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:25.675923247 +0000 UTC m=+4.033491367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-khp8q" (UniqueName: "kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q") pod "network-check-target-nb7vh" (UID: "1b31f8cd-0950-4ab0-9058-a7e32d4a3c51") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:24.786742 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:24.786714 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d5011b_d74d_4c1c_adef_cfd356716eb0.slice/crio-00ed9768e90d45cadc5c4ed738ad1b9599ff5cb47e134a2f5679e33af5dd2971 WatchSource:0}: Error finding container 00ed9768e90d45cadc5c4ed738ad1b9599ff5cb47e134a2f5679e33af5dd2971: Status 404 returned error can't find the container with id 00ed9768e90d45cadc5c4ed738ad1b9599ff5cb47e134a2f5679e33af5dd2971 Jun 04 23:54:24.788419 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:24.788389 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd7ef963_f56f_424d_9065_a736675ad48a.slice/crio-e0cfdde0ac089d9a31b777e19f821221114b1c70604692f76862fcad3432050d WatchSource:0}: Error finding container e0cfdde0ac089d9a31b777e19f821221114b1c70604692f76862fcad3432050d: Status 404 returned error can't find the container with id e0cfdde0ac089d9a31b777e19f821221114b1c70604692f76862fcad3432050d Jun 04 23:54:24.810831 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:24.810767 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87545838_85a4_4044_96cd_8a369a9a95ab.slice/crio-9616bfbdcb765124d8cb1aac9f4c75d9e83b8c67d6176fa261db1d357f2336a3 WatchSource:0}: Error finding container 9616bfbdcb765124d8cb1aac9f4c75d9e83b8c67d6176fa261db1d357f2336a3: Status 404 returned error can't find the container with id 9616bfbdcb765124d8cb1aac9f4c75d9e83b8c67d6176fa261db1d357f2336a3 Jun 04 23:54:24.815406 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:24.815382 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95208ebe_68e1_43e0_9ba0_5fe7fba6d15f.slice/crio-addd5021a238df2e04e73b2ec3544d974a8ffb74ff1effbc7e0f8e56558a9f4b WatchSource:0}: Error finding container addd5021a238df2e04e73b2ec3544d974a8ffb74ff1effbc7e0f8e56558a9f4b: Status 404 returned error can't find the container with id addd5021a238df2e04e73b2ec3544d974a8ffb74ff1effbc7e0f8e56558a9f4b Jun 04 23:54:24.815972 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:24.815955 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ca9e683_9c65_4e7d_8e1f_d668feb920bc.slice/crio-2583d4fecaae8f84cc137f9871baaf6f47b8f1b318cb139d8c54eacb2e3f17b9 WatchSource:0}: Error finding container 2583d4fecaae8f84cc137f9871baaf6f47b8f1b318cb139d8c54eacb2e3f17b9: Status 404 returned error can't find the container with id 2583d4fecaae8f84cc137f9871baaf6f47b8f1b318cb139d8c54eacb2e3f17b9 Jun 04 23:54:24.817479 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:24.817450 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc455b1df_b214_4095_9eeb_fc421b4f1ace.slice/crio-f1bd4aaacbbfc78a52244eb325a6ecbafbec0fab16083a8207d4fd4dde943692 WatchSource:0}: Error finding container f1bd4aaacbbfc78a52244eb325a6ecbafbec0fab16083a8207d4fd4dde943692: Status 404 returned error can't find the container with id f1bd4aaacbbfc78a52244eb325a6ecbafbec0fab16083a8207d4fd4dde943692 Jun 04 23:54:24.818893 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:24.818873 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod307b15de_f46b_41fd_a7ff_c9f455182572.slice/crio-a910150905bb34a59c5dba21d78c0d4948bca2153f0987df7ffc04657408b7a3 WatchSource:0}: Error finding container a910150905bb34a59c5dba21d78c0d4948bca2153f0987df7ffc04657408b7a3: Status 404 returned error can't find the container with id a910150905bb34a59c5dba21d78c0d4948bca2153f0987df7ffc04657408b7a3 Jun 04 23:54:24.820739 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:24.820660 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab52123_f827_4255_8a84_49ff8208148f.slice/crio-bb864d190d320182088f0dc04049f758c39a54da19903dd58ebfc717a3f5c7ca WatchSource:0}: Error finding container bb864d190d320182088f0dc04049f758c39a54da19903dd58ebfc717a3f5c7ca: Status 404 returned error can't find the container with id bb864d190d320182088f0dc04049f758c39a54da19903dd58ebfc717a3f5c7ca Jun 04 23:54:25.002741 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.002656 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-03 23:49:23 +0000 UTC" deadline="2028-03-01 01:43:22.534611548 +0000 UTC" Jun 04 23:54:25.002741 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.002737 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15241h48m57.531879924s" Jun 04 23:54:25.030113 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.030089 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:25.030261 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:25.030208 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb7vh" podUID="1b31f8cd-0950-4ab0-9058-a7e32d4a3c51" Jun 04 23:54:25.030261 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.030252 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:25.030380 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:25.030358 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:25.038627 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.038601 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" event={"ID":"98bac051df6d1eb92d9dcd6f09edbb90","Type":"ContainerStarted","Data":"eef145189f82273923180f3c96d17854434fc1336d93609281ad1ea4f2f202c2"} Jun 04 23:54:25.040218 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.040196 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" event={"ID":"0ab52123-f827-4255-8a84-49ff8208148f","Type":"ContainerStarted","Data":"bb864d190d320182088f0dc04049f758c39a54da19903dd58ebfc717a3f5c7ca"} Jun 04 23:54:25.041790 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.041752 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" event={"ID":"307b15de-f46b-41fd-a7ff-c9f455182572","Type":"ContainerStarted","Data":"a910150905bb34a59c5dba21d78c0d4948bca2153f0987df7ffc04657408b7a3"} Jun 04 23:54:25.043781 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.043730 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" event={"ID":"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3","Type":"ContainerStarted","Data":"bc058e4ce85d1bdd7556b11a8d8513348e63ca7c8246e05780f03ce23eef508a"} Jun 04 23:54:25.045102 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.045074 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s5zd2" event={"ID":"c455b1df-b214-4095-9eeb-fc421b4f1ace","Type":"ContainerStarted","Data":"f1bd4aaacbbfc78a52244eb325a6ecbafbec0fab16083a8207d4fd4dde943692"} Jun 04 23:54:25.047400 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.047381 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c84x5" event={"ID":"6ca9e683-9c65-4e7d-8e1f-d668feb920bc","Type":"ContainerStarted","Data":"2583d4fecaae8f84cc137f9871baaf6f47b8f1b318cb139d8c54eacb2e3f17b9"} Jun 04 23:54:25.049643 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.049625 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k62wx" event={"ID":"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f","Type":"ContainerStarted","Data":"addd5021a238df2e04e73b2ec3544d974a8ffb74ff1effbc7e0f8e56558a9f4b"} Jun 04 23:54:25.050904 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.050886 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rl4dv" event={"ID":"87545838-85a4-4044-96cd-8a369a9a95ab","Type":"ContainerStarted","Data":"9616bfbdcb765124d8cb1aac9f4c75d9e83b8c67d6176fa261db1d357f2336a3"} Jun 04 23:54:25.052240 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.052211 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qdfkf" event={"ID":"dd7ef963-f56f-424d-9065-a736675ad48a","Type":"ContainerStarted","Data":"e0cfdde0ac089d9a31b777e19f821221114b1c70604692f76862fcad3432050d"} Jun 04 23:54:25.053276 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.053241 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" podStartSLOduration=2.053230316 podStartE2EDuration="2.053230316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:25.05303017 +0000 UTC m=+3.410598309" watchObservedRunningTime="2026-06-04 23:54:25.053230316 +0000 UTC m=+3.410798452" Jun 04 23:54:25.053361 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.053274 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n29wb" event={"ID":"54d5011b-d74d-4c1c-adef-cfd356716eb0","Type":"ContainerStarted","Data":"00ed9768e90d45cadc5c4ed738ad1b9599ff5cb47e134a2f5679e33af5dd2971"} Jun 04 23:54:25.583889 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.583849 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs\") pod \"network-metrics-daemon-kf8nr\" (UID: \"04667814-8f0e-4653-a2a1-0b2fd6431e61\") " pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:25.584052 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:25.584029 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:25.584130 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:25.584091 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs podName:04667814-8f0e-4653-a2a1-0b2fd6431e61 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:27.584072784 +0000 UTC m=+5.941640905 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs") pod "network-metrics-daemon-kf8nr" (UID: "04667814-8f0e-4653-a2a1-0b2fd6431e61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:25.685093 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.685057 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret\") pod \"global-pull-secret-syncer-258hw\" (UID: \"1b04efb1-c48b-4cde-b23e-fcf4ecee8253\") " pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:25.685264 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:25.685117 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khp8q\" (UniqueName: \"kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q\") pod \"network-check-target-nb7vh\" (UID: \"1b31f8cd-0950-4ab0-9058-a7e32d4a3c51\") " pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:25.685264 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:25.685210 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:25.685264 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:25.685239 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 04 23:54:25.685264 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:25.685255 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 04 23:54:25.685458 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:25.685269 2564 projected.go:196] Error preparing data for projected volume kube-api-access-khp8q for pod openshift-network-diagnostics/network-check-target-nb7vh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:25.685458 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:25.685276 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret podName:1b04efb1-c48b-4cde-b23e-fcf4ecee8253 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:27.685257747 +0000 UTC m=+6.042825881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret") pod "global-pull-secret-syncer-258hw" (UID: "1b04efb1-c48b-4cde-b23e-fcf4ecee8253") : object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:25.685458 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:25.685315 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q podName:1b31f8cd-0950-4ab0-9058-a7e32d4a3c51 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:27.68529989 +0000 UTC m=+6.042868015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-khp8q" (UniqueName: "kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q") pod "network-check-target-nb7vh" (UID: "1b31f8cd-0950-4ab0-9058-a7e32d4a3c51") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:26.003552 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:26.003460 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-03 23:49:23 +0000 UTC" deadline="2028-03-10 11:38:14.371322474 +0000 UTC" Jun 04 23:54:26.003552 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:26.003502 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15467h43m48.367824572s" Jun 04 23:54:26.031339 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:26.031311 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:26.031491 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:26.031449 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:26.074139 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:26.073010 2564 generic.go:356] "Generic (PLEG): container finished" podID="05c829215119f6b730755cdeec6d1f30" containerID="6d71c43b39074984afd3f3655a36395e304e5fb929fc4a81f99a5cbf02092cc4" exitCode=0 Jun 04 23:54:26.074139 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:26.073900 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" event={"ID":"05c829215119f6b730755cdeec6d1f30","Type":"ContainerDied","Data":"6d71c43b39074984afd3f3655a36395e304e5fb929fc4a81f99a5cbf02092cc4"} Jun 04 23:54:27.030113 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:27.030081 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:27.030573 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:27.030199 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb7vh" podUID="1b31f8cd-0950-4ab0-9058-a7e32d4a3c51" Jun 04 23:54:27.030662 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:27.030586 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:27.030741 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:27.030712 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:27.092603 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:27.091913 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" event={"ID":"05c829215119f6b730755cdeec6d1f30","Type":"ContainerStarted","Data":"980967268cd70f38f247f162418b4d0327a03c0f26a5b6b7a27f4b8f91b42e77"} Jun 04 23:54:27.600427 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:27.600377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs\") pod \"network-metrics-daemon-kf8nr\" (UID: \"04667814-8f0e-4653-a2a1-0b2fd6431e61\") " pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:27.600622 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:27.600601 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:27.600720 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:27.600664 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs podName:04667814-8f0e-4653-a2a1-0b2fd6431e61 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:31.600646901 +0000 UTC m=+9.958215025 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs") pod "network-metrics-daemon-kf8nr" (UID: "04667814-8f0e-4653-a2a1-0b2fd6431e61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:27.700958 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:27.700924 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret\") pod \"global-pull-secret-syncer-258hw\" (UID: \"1b04efb1-c48b-4cde-b23e-fcf4ecee8253\") " pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:27.701132 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:27.700982 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khp8q\" (UniqueName: \"kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q\") pod \"network-check-target-nb7vh\" (UID: \"1b31f8cd-0950-4ab0-9058-a7e32d4a3c51\") " pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:27.701203 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:27.701155 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 04 23:54:27.701203 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:27.701174 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 04 23:54:27.701203 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:27.701187 2564 projected.go:196] Error preparing data for projected volume kube-api-access-khp8q for pod openshift-network-diagnostics/network-check-target-nb7vh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:27.701354 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:27.701242 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q podName:1b31f8cd-0950-4ab0-9058-a7e32d4a3c51 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:31.701224582 +0000 UTC m=+10.058792718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-khp8q" (UniqueName: "kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q") pod "network-check-target-nb7vh" (UID: "1b31f8cd-0950-4ab0-9058-a7e32d4a3c51") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:27.701664 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:27.701646 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:27.701777 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:27.701716 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret podName:1b04efb1-c48b-4cde-b23e-fcf4ecee8253 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:31.701700753 +0000 UTC m=+10.059268876 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret") pod "global-pull-secret-syncer-258hw" (UID: "1b04efb1-c48b-4cde-b23e-fcf4ecee8253") : object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:28.030321 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:28.030268 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:28.030789 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:28.030411 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:29.029693 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:29.029609 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:29.029693 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:29.029654 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:29.030006 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:29.029806 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:29.030244 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:29.030209 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb7vh" podUID="1b31f8cd-0950-4ab0-9058-a7e32d4a3c51" Jun 04 23:54:30.030602 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:30.030093 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:30.030602 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:30.030231 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:31.030027 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:31.029992 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:31.030187 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:31.030113 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb7vh" podUID="1b31f8cd-0950-4ab0-9058-a7e32d4a3c51" Jun 04 23:54:31.030187 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:31.030167 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:31.030307 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:31.030292 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:31.634985 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:31.634948 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs\") pod \"network-metrics-daemon-kf8nr\" (UID: \"04667814-8f0e-4653-a2a1-0b2fd6431e61\") " pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:31.635426 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:31.635093 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:31.635426 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:31.635164 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs podName:04667814-8f0e-4653-a2a1-0b2fd6431e61 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:39.635143458 +0000 UTC m=+17.992711593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs") pod "network-metrics-daemon-kf8nr" (UID: "04667814-8f0e-4653-a2a1-0b2fd6431e61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:31.735583 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:31.735538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khp8q\" (UniqueName: \"kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q\") pod \"network-check-target-nb7vh\" (UID: \"1b31f8cd-0950-4ab0-9058-a7e32d4a3c51\") " pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:31.735782 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:31.735627 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret\") pod \"global-pull-secret-syncer-258hw\" (UID: \"1b04efb1-c48b-4cde-b23e-fcf4ecee8253\") " pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:31.735840 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:31.735786 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:31.735872 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:31.735844 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret podName:1b04efb1-c48b-4cde-b23e-fcf4ecee8253 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:39.735825203 +0000 UTC m=+18.093393329 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret") pod "global-pull-secret-syncer-258hw" (UID: "1b04efb1-c48b-4cde-b23e-fcf4ecee8253") : object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:31.736323 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:31.736218 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 04 23:54:31.736323 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:31.736240 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 04 23:54:31.736323 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:31.736252 2564 projected.go:196] Error preparing data for projected volume kube-api-access-khp8q for pod openshift-network-diagnostics/network-check-target-nb7vh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:31.736323 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:31.736294 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q podName:1b31f8cd-0950-4ab0-9058-a7e32d4a3c51 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:39.736279874 +0000 UTC m=+18.093847998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-khp8q" (UniqueName: "kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q") pod "network-check-target-nb7vh" (UID: "1b31f8cd-0950-4ab0-9058-a7e32d4a3c51") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:32.033211 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:32.033125 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:32.033355 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:32.033252 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:33.029532 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:33.029306 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:33.029973 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:33.029306 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:33.029973 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:33.029649 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:33.029973 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:33.029750 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb7vh" podUID="1b31f8cd-0950-4ab0-9058-a7e32d4a3c51" Jun 04 23:54:34.029649 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:34.029614 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:34.030100 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:34.029763 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:35.029573 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:35.029542 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:35.029745 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:35.029657 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:35.029745 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:35.029699 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:35.030129 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:35.029805 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb7vh" podUID="1b31f8cd-0950-4ab0-9058-a7e32d4a3c51" Jun 04 23:54:36.029902 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:36.029868 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:36.030341 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:36.029990 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:37.029835 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:37.029805 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:37.030017 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:37.029817 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:37.030017 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:37.029911 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb7vh" podUID="1b31f8cd-0950-4ab0-9058-a7e32d4a3c51" Jun 04 23:54:37.030336 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:37.030018 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:38.029524 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:38.029488 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:38.029728 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:38.029619 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:39.029559 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:39.029522 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:39.030004 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:39.029626 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb7vh" podUID="1b31f8cd-0950-4ab0-9058-a7e32d4a3c51" Jun 04 23:54:39.030004 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:39.029692 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:39.030004 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:39.029781 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:39.700146 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:39.700113 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs\") pod \"network-metrics-daemon-kf8nr\" (UID: \"04667814-8f0e-4653-a2a1-0b2fd6431e61\") " pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:39.700339 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:39.700274 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:39.700407 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:39.700345 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs podName:04667814-8f0e-4653-a2a1-0b2fd6431e61 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:55.700325038 +0000 UTC m=+34.057893162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs") pod "network-metrics-daemon-kf8nr" (UID: "04667814-8f0e-4653-a2a1-0b2fd6431e61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:39.800893 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:39.800857 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret\") pod \"global-pull-secret-syncer-258hw\" (UID: \"1b04efb1-c48b-4cde-b23e-fcf4ecee8253\") " pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:39.801086 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:39.800920 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khp8q\" (UniqueName: \"kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q\") pod \"network-check-target-nb7vh\" (UID: \"1b31f8cd-0950-4ab0-9058-a7e32d4a3c51\") " pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:39.801086 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:39.801067 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 04 23:54:39.801086 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:39.801083 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 04 23:54:39.801231 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:39.801097 2564 projected.go:196] Error preparing data for projected volume kube-api-access-khp8q for pod openshift-network-diagnostics/network-check-target-nb7vh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:39.801231 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:39.801151 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q podName:1b31f8cd-0950-4ab0-9058-a7e32d4a3c51 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:55.801134928 +0000 UTC m=+34.158703053 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-khp8q" (UniqueName: "kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q") pod "network-check-target-nb7vh" (UID: "1b31f8cd-0950-4ab0-9058-a7e32d4a3c51") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:39.801231 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:39.801216 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:39.801356 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:39.801250 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret podName:1b04efb1-c48b-4cde-b23e-fcf4ecee8253 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:55.801240236 +0000 UTC m=+34.158808359 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret") pod "global-pull-secret-syncer-258hw" (UID: "1b04efb1-c48b-4cde-b23e-fcf4ecee8253") : object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:40.029622 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:40.029543 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:40.030094 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:40.029689 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:41.030292 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:41.030262 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:41.030729 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:41.030262 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:41.030729 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:41.030377 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb7vh" podUID="1b31f8cd-0950-4ab0-9058-a7e32d4a3c51" Jun 04 23:54:41.030729 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:41.030447 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:42.030347 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:42.030314 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:42.030819 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:42.030405 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:43.029912 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:43.029880 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:43.030167 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:43.029921 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:43.030167 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:43.029990 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb7vh" podUID="1b31f8cd-0950-4ab0-9058-a7e32d4a3c51" Jun 04 23:54:43.030167 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:43.030140 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:44.029462 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.029324 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:44.029989 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:44.029547 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:44.124999 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.124972 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" event={"ID":"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3","Type":"ContainerStarted","Data":"c55b42ceb6d91b3d43601890bdb464b5537c148996e8cd4817fb8f5185ce5afb"} Jun 04 23:54:44.126283 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.126253 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-s5zd2" event={"ID":"c455b1df-b214-4095-9eeb-fc421b4f1ace","Type":"ContainerStarted","Data":"093fc32b562d166577aa8dd66a8dfb4353a00ba65469e2a90cd827cde80501b8"} Jun 04 23:54:44.127634 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.127613 2564 generic.go:356] "Generic (PLEG): container finished" podID="95208ebe-68e1-43e0-9ba0-5fe7fba6d15f" containerID="5f199de0ebc7139224799a4e0366cb2578b324911d93b692de2a83f5507087e7" exitCode=0 Jun 04 23:54:44.127736 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.127690 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k62wx" event={"ID":"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f","Type":"ContainerDied","Data":"5f199de0ebc7139224799a4e0366cb2578b324911d93b692de2a83f5507087e7"} Jun 04 23:54:44.129274 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.129248 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rl4dv" event={"ID":"87545838-85a4-4044-96cd-8a369a9a95ab","Type":"ContainerStarted","Data":"b6a6e2080608c5f6b99cd9f78918670d59ba3638da9c5ea95adbf0cb9f672724"} Jun 04 23:54:44.130965 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.130923 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qdfkf" event={"ID":"dd7ef963-f56f-424d-9065-a736675ad48a","Type":"ContainerStarted","Data":"68a1acd784fc064ec40acc42f96a6893aa4f050df17eee8fc40a8dfd7bd5c1b4"} Jun 04 23:54:44.132501 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.132477 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n29wb" event={"ID":"54d5011b-d74d-4c1c-adef-cfd356716eb0","Type":"ContainerStarted","Data":"8e5a5acf5dcdadcad71dc91ec7bc65ad6c13bda35cb34d49861ec7b817e00c63"} Jun 04 23:54:44.135810 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.135792 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/ovn-acl-logging/0.log" Jun 04 23:54:44.136203 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.136178 2564 generic.go:356] "Generic (PLEG): container finished" podID="0ab52123-f827-4255-8a84-49ff8208148f" containerID="ce39bf44bf515826f1128159c678a4c064f0e970a6e50dce1fe09c282c15f934" exitCode=1 Jun 04 23:54:44.136289 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.136247 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" event={"ID":"0ab52123-f827-4255-8a84-49ff8208148f","Type":"ContainerStarted","Data":"6a65c7c059938d11ce5ac8e12727207da14d1c5c50858cb3184013489c709819"} Jun 04 23:54:44.136357 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.136309 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" event={"ID":"0ab52123-f827-4255-8a84-49ff8208148f","Type":"ContainerStarted","Data":"6e01921d706ceeee093fe4516fac4f3c7d7ff48000b3580ea1e712bab26d88ba"} Jun 04 23:54:44.136424 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.136361 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" event={"ID":"0ab52123-f827-4255-8a84-49ff8208148f","Type":"ContainerDied","Data":"ce39bf44bf515826f1128159c678a4c064f0e970a6e50dce1fe09c282c15f934"} Jun 04 23:54:44.136424 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.136419 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" event={"ID":"0ab52123-f827-4255-8a84-49ff8208148f","Type":"ContainerStarted","Data":"c3794e34c0460e7cd3e649fb5776d68df396788c1477d48a2582b43f7b8a1f8b"} Jun 04 23:54:44.138151 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.138128 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" event={"ID":"307b15de-f46b-41fd-a7ff-c9f455182572","Type":"ContainerStarted","Data":"1bb87ab6b5a0117e7ad66d6e5737b2441b9afd8d4302c56a92701aa37ae802d4"} Jun 04 23:54:44.145958 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.145895 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-s5zd2" podStartSLOduration=7.910064996 podStartE2EDuration="22.145879955s" totalImagesPullingTime="14.235814959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:44.145228577 +0000 UTC m=+22.502796720" watchObservedRunningTime="2026-06-04 23:54:44.145879955 +0000 UTC m=+22.503448098" Jun 04 23:54:44.146222 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.146191 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" podStartSLOduration=21.146185395 podStartE2EDuration="21.146185395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:27.112411311 +0000 UTC m=+5.469979434" watchObservedRunningTime="2026-06-04 23:54:44.146185395 +0000 UTC m=+22.503753539" Jun 04 23:54:44.181339 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.181298 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qdfkf" podStartSLOduration=3.441375032 podStartE2EDuration="22.181285319s" totalImagesPullingTime="18.739910287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:44.158643686 +0000 UTC m=+22.516211832" watchObservedRunningTime="2026-06-04 23:54:44.181285319 +0000 UTC m=+22.538853444" Jun 04 23:54:44.204070 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.204036 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rl4dv" podStartSLOduration=3.415239993 podStartE2EDuration="22.204024427s" totalImagesPullingTime="18.788784434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:44.203592975 +0000 UTC m=+22.561161135" watchObservedRunningTime="2026-06-04 23:54:44.204024427 +0000 UTC m=+22.561592568" Jun 04 23:54:44.218093 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.218050 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n29wb" podStartSLOduration=3.478130362 podStartE2EDuration="22.21803616s" totalImagesPullingTime="18.739905798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:44.217947834 +0000 UTC m=+22.575515976" watchObservedRunningTime="2026-06-04 23:54:44.21803616 +0000 UTC m=+22.575604303" Jun 04 23:54:44.239038 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:44.239001 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lgq2v" podStartSLOduration=3.511716565 podStartE2EDuration="22.238990089s" totalImagesPullingTime="18.727273524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:44.238531922 +0000 UTC m=+22.596100083" watchObservedRunningTime="2026-06-04 23:54:44.238990089 +0000 UTC m=+22.596558294" Jun 04 23:54:45.010741 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:45.010712 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 04 23:54:45.029273 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:45.029250 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:45.029399 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:45.029293 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:45.029399 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:45.029381 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:45.029519 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:45.029448 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb7vh" podUID="1b31f8cd-0950-4ab0-9058-a7e32d4a3c51" Jun 04 23:54:45.039270 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:45.039187 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-04T23:54:45.010732325Z","UUID":"a44880a2-054a-4b08-ac0a-f1a94f833a76","Handler":null,"Name":"","Endpoint":""} Jun 04 23:54:45.040731 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:45.040712 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 04 23:54:45.040841 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:45.040751 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 04 23:54:45.145646 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:45.145617 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/ovn-acl-logging/0.log" Jun 04 23:54:45.146070 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:45.146036 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" event={"ID":"0ab52123-f827-4255-8a84-49ff8208148f","Type":"ContainerStarted","Data":"24ea78a78ccdabd77400aa87547e0bb1a1d2d0a7e5c0cdbe0f6945454d95b23a"} Jun 04 23:54:45.146188 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:45.146130 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" event={"ID":"0ab52123-f827-4255-8a84-49ff8208148f","Type":"ContainerStarted","Data":"4e3f1c049f548f642611c8542822e4c7070cde711782c246a1a8806794bfe8a7"} Jun 04 23:54:45.148117 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:45.148091 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" event={"ID":"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3","Type":"ContainerStarted","Data":"cfd1f491adf5e8df699ea43aea19cbd579dccc8b22eec0e8940527757decfcc9"} Jun 04 23:54:45.149744 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:45.149717 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c84x5" event={"ID":"6ca9e683-9c65-4e7d-8e1f-d668feb920bc","Type":"ContainerStarted","Data":"99f59dad39b31dbd284f1720dd2e606879baae1b0ef494a018a806dfd8d69b4f"} Jun 04 23:54:45.168312 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:45.168268 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c84x5" podStartSLOduration=8.932291755 podStartE2EDuration="23.16825536s" totalImagesPullingTime="14.235963605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:45.167846267 +0000 UTC m=+23.525414578" watchObservedRunningTime="2026-06-04 23:54:45.16825536 +0000 UTC m=+23.525823501" Jun 04 23:54:46.030002 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:46.029970 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:46.030509 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:46.030092 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:47.030090 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:47.030047 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:47.030591 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:47.030160 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb7vh" podUID="1b31f8cd-0950-4ab0-9058-a7e32d4a3c51" Jun 04 23:54:47.030591 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:47.030215 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:47.030591 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:47.030325 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:47.157512 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:47.157480 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/ovn-acl-logging/0.log" Jun 04 23:54:47.157915 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:47.157893 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" event={"ID":"0ab52123-f827-4255-8a84-49ff8208148f","Type":"ContainerStarted","Data":"b7bc799c83be7b4fb94ff921d108d3164db2d84c10fa3fa1eb76e2b8f2319724"} Jun 04 23:54:47.160066 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:47.160038 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" event={"ID":"24b524fa-e5b6-4dc4-85a6-b8ebf1222ff3","Type":"ContainerStarted","Data":"a1e0a6cc35a367135bb2ba3aa6dfbcac3139a385356ba8867e5bd1da597ecb20"} Jun 04 23:54:47.180700 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:47.180647 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8ljp" podStartSLOduration=4.291142213 podStartE2EDuration="25.180633428s" totalImagesPullingTime="20.889491215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:47.179987166 +0000 UTC m=+25.537555311" watchObservedRunningTime="2026-06-04 23:54:47.180633428 +0000 UTC m=+25.538201570" Jun 04 23:54:48.029265 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:48.029234 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:48.029426 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:48.029391 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:49.001196 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:49.000913 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-s5zd2" Jun 04 23:54:49.001748 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:49.001505 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-s5zd2" Jun 04 23:54:49.030007 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:49.029982 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:49.030109 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:49.030069 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb7vh" podUID="1b31f8cd-0950-4ab0-9058-a7e32d4a3c51" Jun 04 23:54:49.030161 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:49.030137 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:49.030287 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:49.030268 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:49.167083 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:49.167059 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/ovn-acl-logging/0.log" Jun 04 23:54:49.167465 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:49.167440 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" event={"ID":"0ab52123-f827-4255-8a84-49ff8208148f","Type":"ContainerStarted","Data":"fcf2d8e04b81459d1c0fc5f01b37b5a827fa1bd95b4b198b4504a730e38b440d"} Jun 04 23:54:49.167705 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:49.167667 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:49.167880 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:49.167863 2564 scope.go:117] "RemoveContainer" containerID="ce39bf44bf515826f1128159c678a4c064f0e970a6e50dce1fe09c282c15f934" Jun 04 23:54:49.169399 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:49.169380 2564 generic.go:356] "Generic (PLEG): container finished" podID="95208ebe-68e1-43e0-9ba0-5fe7fba6d15f" containerID="719bbbd8bb0184602a21602e38b2f94484f1e071662a0f2d19b289ee4d18b265" exitCode=0 Jun 04 23:54:49.169492 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:49.169469 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k62wx" event={"ID":"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f","Type":"ContainerDied","Data":"719bbbd8bb0184602a21602e38b2f94484f1e071662a0f2d19b289ee4d18b265"} Jun 04 23:54:49.169652 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:49.169637 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-s5zd2" Jun 04 23:54:49.170074 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:49.170065 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-s5zd2" Jun 04 23:54:49.185097 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:49.185079 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:50.029494 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:50.029462 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:50.029988 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:50.029587 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:50.176802 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:50.176778 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/ovn-acl-logging/0.log" Jun 04 23:54:50.177242 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:50.177209 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" event={"ID":"0ab52123-f827-4255-8a84-49ff8208148f","Type":"ContainerStarted","Data":"840290c3bd064b2a3f4891b216daad93a40ad1416fcb3b80774f22ed00b7859a"} Jun 04 23:54:50.177357 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:50.177329 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:50.177408 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:50.177393 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:50.193705 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:50.193655 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:54:50.206871 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:50.206833 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" podStartSLOduration=9.414474098 podStartE2EDuration="28.206809653s" totalImagesPullingTime="18.792335555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:54:50.206739101 +0000 UTC m=+28.564307243" watchObservedRunningTime="2026-06-04 23:54:50.206809653 +0000 UTC m=+28.564377788" Jun 04 23:54:50.624785 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:50.624758 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nb7vh"] Jun 04 23:54:50.624913 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:50.624882 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:50.625013 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:50.624988 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb7vh" podUID="1b31f8cd-0950-4ab0-9058-a7e32d4a3c51" Jun 04 23:54:50.626571 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:50.626554 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kf8nr"] Jun 04 23:54:50.626694 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:50.626644 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:50.626792 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:50.626772 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:50.637183 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:50.637163 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-258hw"] Jun 04 23:54:50.637272 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:50.637234 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:50.637318 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:50.637306 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:51.181823 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:51.181782 2564 generic.go:356] "Generic (PLEG): container finished" podID="95208ebe-68e1-43e0-9ba0-5fe7fba6d15f" containerID="657b0b35dd4e49259fb2420e9689e0110b1d4d0d464ecc9a68604c41b717b6b8" exitCode=0 Jun 04 23:54:51.182378 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:51.181858 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k62wx" event={"ID":"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f","Type":"ContainerDied","Data":"657b0b35dd4e49259fb2420e9689e0110b1d4d0d464ecc9a68604c41b717b6b8"} Jun 04 23:54:52.032215 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:52.032189 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:52.032409 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:52.032274 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:52.032409 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:52.032289 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:52.032507 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:52.032426 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:53.029436 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:53.029370 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:53.029832 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:53.029465 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb7vh" podUID="1b31f8cd-0950-4ab0-9058-a7e32d4a3c51" Jun 04 23:54:53.190258 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:53.190223 2564 generic.go:356] "Generic (PLEG): container finished" podID="95208ebe-68e1-43e0-9ba0-5fe7fba6d15f" containerID="41170d430a0e9a0b5f714a05ae7bf1b91195cedf4165517283d651554eb77200" exitCode=0 Jun 04 23:54:53.190401 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:53.190296 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k62wx" event={"ID":"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f","Type":"ContainerDied","Data":"41170d430a0e9a0b5f714a05ae7bf1b91195cedf4165517283d651554eb77200"} Jun 04 23:54:54.033511 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:54.033484 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:54.034234 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:54.033589 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:54.034234 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:54.033644 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:54.034234 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:54.033770 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:55.030043 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:55.029969 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:55.030188 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:55.030076 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb7vh" podUID="1b31f8cd-0950-4ab0-9058-a7e32d4a3c51" Jun 04 23:54:55.717575 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:55.717541 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs\") pod \"network-metrics-daemon-kf8nr\" (UID: \"04667814-8f0e-4653-a2a1-0b2fd6431e61\") " pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:55.718036 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:55.717666 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:55.718036 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:55.717751 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs podName:04667814-8f0e-4653-a2a1-0b2fd6431e61 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:27.717730152 +0000 UTC m=+66.075298276 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs") pod "network-metrics-daemon-kf8nr" (UID: "04667814-8f0e-4653-a2a1-0b2fd6431e61") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 04 23:54:55.817986 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:55.817950 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret\") pod \"global-pull-secret-syncer-258hw\" (UID: \"1b04efb1-c48b-4cde-b23e-fcf4ecee8253\") " pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:55.818178 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:55.818006 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khp8q\" (UniqueName: \"kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q\") pod \"network-check-target-nb7vh\" (UID: \"1b31f8cd-0950-4ab0-9058-a7e32d4a3c51\") " pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:55.818178 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:55.818116 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:55.818178 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:55.818133 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 04 23:54:55.818178 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:55.818151 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 04 23:54:55.818178 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:55.818163 2564 projected.go:196] Error preparing data for projected volume kube-api-access-khp8q for pod openshift-network-diagnostics/network-check-target-nb7vh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:55.818430 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:55.818193 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret podName:1b04efb1-c48b-4cde-b23e-fcf4ecee8253 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:27.818172637 +0000 UTC m=+66.175740771 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret") pod "global-pull-secret-syncer-258hw" (UID: "1b04efb1-c48b-4cde-b23e-fcf4ecee8253") : object "kube-system"/"original-pull-secret" not registered Jun 04 23:54:55.818430 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:55.818211 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q podName:1b31f8cd-0950-4ab0-9058-a7e32d4a3c51 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:27.818204091 +0000 UTC m=+66.175772211 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-khp8q" (UniqueName: "kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q") pod "network-check-target-nb7vh" (UID: "1b31f8cd-0950-4ab0-9058-a7e32d4a3c51") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 04 23:54:56.029914 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.029840 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:56.030068 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.029843 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:56.030068 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:56.029975 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:54:56.030068 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:56.030053 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-258hw" podUID="1b04efb1-c48b-4cde-b23e-fcf4ecee8253" Jun 04 23:54:56.498337 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.498306 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeReady" Jun 04 23:54:56.498506 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.498433 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 04 23:54:56.535919 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.535888 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-fd78b68c6-6scbt"] Jun 04 23:54:56.538128 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.538109 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.540964 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.540757 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r5892\"" Jun 04 23:54:56.541084 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.540964 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 04 23:54:56.541084 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.540885 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 04 23:54:56.541084 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.540925 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 04 23:54:56.549400 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.549374 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b4hcm"] Jun 04 23:54:56.550557 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.550532 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 04 23:54:56.553526 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.553503 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fd78b68c6-6scbt"] Jun 04 23:54:56.553643 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.553613 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b4hcm" Jun 04 23:54:56.555660 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.555638 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lhmvj"] Jun 04 23:54:56.556177 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.556156 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 04 23:54:56.556336 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.556267 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 04 23:54:56.556707 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.556659 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zgf9w\"" Jun 04 23:54:56.557495 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.557463 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lhmvj" Jun 04 23:54:56.560597 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.560221 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n65nv\"" Jun 04 23:54:56.560597 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.560362 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 04 23:54:56.560597 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.560362 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 04 23:54:56.560846 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.560727 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 04 23:54:56.561732 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.561712 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b4hcm"] Jun 04 23:54:56.567804 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.567783 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lhmvj"] Jun 04 23:54:56.623418 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.623392 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61acbd7e-9273-4884-be2c-c4cc24217311-registry-certificates\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.623553 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.623446 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61acbd7e-9273-4884-be2c-c4cc24217311-image-registry-private-configuration\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.623553 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.623502 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61acbd7e-9273-4884-be2c-c4cc24217311-trusted-ca\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.623656 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.623563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvd74\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-kube-api-access-bvd74\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.623656 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.623595 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61acbd7e-9273-4884-be2c-c4cc24217311-ca-trust-extracted\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.623656 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.623632 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-bound-sa-token\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.623810 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.623659 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.623810 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.623703 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61acbd7e-9273-4884-be2c-c4cc24217311-installation-pull-secrets\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.724745 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.724707 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61acbd7e-9273-4884-be2c-c4cc24217311-image-registry-private-configuration\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.725221 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.724755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61acbd7e-9273-4884-be2c-c4cc24217311-trusted-ca\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.725221 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.724789 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqtll\" (UniqueName: \"kubernetes.io/projected/4ac9536e-706c-42b2-904f-a6facd64f42c-kube-api-access-gqtll\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:54:56.725221 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.724828 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrvhl\" (UniqueName: \"kubernetes.io/projected/edb8cf8a-5d0d-4062-a351-88ea81fc8d12-kube-api-access-jrvhl\") pod \"ingress-canary-lhmvj\" (UID: \"edb8cf8a-5d0d-4062-a351-88ea81fc8d12\") " pod="openshift-ingress-canary/ingress-canary-lhmvj" Jun 04 23:54:56.725221 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.724857 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvd74\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-kube-api-access-bvd74\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.725221 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.724989 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61acbd7e-9273-4884-be2c-c4cc24217311-ca-trust-extracted\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.725221 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.725033 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-bound-sa-token\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.725221 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.725060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:54:56.725221 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.725082 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ac9536e-706c-42b2-904f-a6facd64f42c-tmp-dir\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:54:56.725221 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.725110 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edb8cf8a-5d0d-4062-a351-88ea81fc8d12-cert\") pod \"ingress-canary-lhmvj\" (UID: \"edb8cf8a-5d0d-4062-a351-88ea81fc8d12\") " pod="openshift-ingress-canary/ingress-canary-lhmvj" Jun 04 23:54:56.725221 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.725138 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.725221 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.725168 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61acbd7e-9273-4884-be2c-c4cc24217311-installation-pull-secrets\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.725221 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.725207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61acbd7e-9273-4884-be2c-c4cc24217311-registry-certificates\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.725918 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.725233 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4ac9536e-706c-42b2-904f-a6facd64f42c-config-volume\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:54:56.725918 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:56.725336 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 04 23:54:56.725918 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:56.725354 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd78b68c6-6scbt: secret "image-registry-tls" not found Jun 04 23:54:56.725918 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:56.725413 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls podName:61acbd7e-9273-4884-be2c-c4cc24217311 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:57.225392776 +0000 UTC m=+35.582960900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls") pod "image-registry-fd78b68c6-6scbt" (UID: "61acbd7e-9273-4884-be2c-c4cc24217311") : secret "image-registry-tls" not found Jun 04 23:54:56.725918 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.725457 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61acbd7e-9273-4884-be2c-c4cc24217311-ca-trust-extracted\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.726141 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.725926 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61acbd7e-9273-4884-be2c-c4cc24217311-registry-certificates\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.726141 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.726005 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61acbd7e-9273-4884-be2c-c4cc24217311-trusted-ca\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.729522 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.729502 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61acbd7e-9273-4884-be2c-c4cc24217311-installation-pull-secrets\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.729616 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.729522 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61acbd7e-9273-4884-be2c-c4cc24217311-image-registry-private-configuration\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.734436 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.734394 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvd74\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-kube-api-access-bvd74\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.734560 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.734449 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-bound-sa-token\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:56.826464 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.826363 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:54:56.826464 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.826403 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ac9536e-706c-42b2-904f-a6facd64f42c-tmp-dir\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:54:56.826464 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.826421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edb8cf8a-5d0d-4062-a351-88ea81fc8d12-cert\") pod \"ingress-canary-lhmvj\" (UID: \"edb8cf8a-5d0d-4062-a351-88ea81fc8d12\") " pod="openshift-ingress-canary/ingress-canary-lhmvj" Jun 04 23:54:56.826733 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.826483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4ac9536e-706c-42b2-904f-a6facd64f42c-config-volume\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:54:56.826733 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:56.826516 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:54:56.826733 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.826548 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqtll\" (UniqueName: \"kubernetes.io/projected/4ac9536e-706c-42b2-904f-a6facd64f42c-kube-api-access-gqtll\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:54:56.826733 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:56.826594 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls podName:4ac9536e-706c-42b2-904f-a6facd64f42c nodeName:}" failed. No retries permitted until 2026-06-04 23:54:57.326573931 +0000 UTC m=+35.684142051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls") pod "dns-default-b4hcm" (UID: "4ac9536e-706c-42b2-904f-a6facd64f42c") : secret "dns-default-metrics-tls" not found Jun 04 23:54:56.826733 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.826619 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrvhl\" (UniqueName: \"kubernetes.io/projected/edb8cf8a-5d0d-4062-a351-88ea81fc8d12-kube-api-access-jrvhl\") pod \"ingress-canary-lhmvj\" (UID: \"edb8cf8a-5d0d-4062-a351-88ea81fc8d12\") " pod="openshift-ingress-canary/ingress-canary-lhmvj" Jun 04 23:54:56.826989 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.826751 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ac9536e-706c-42b2-904f-a6facd64f42c-tmp-dir\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:54:56.827047 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.827031 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4ac9536e-706c-42b2-904f-a6facd64f42c-config-volume\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:54:56.829091 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.829069 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edb8cf8a-5d0d-4062-a351-88ea81fc8d12-cert\") pod \"ingress-canary-lhmvj\" (UID: \"edb8cf8a-5d0d-4062-a351-88ea81fc8d12\") " pod="openshift-ingress-canary/ingress-canary-lhmvj" Jun 04 23:54:56.835225 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.835204 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrvhl\" (UniqueName: \"kubernetes.io/projected/edb8cf8a-5d0d-4062-a351-88ea81fc8d12-kube-api-access-jrvhl\") pod \"ingress-canary-lhmvj\" (UID: \"edb8cf8a-5d0d-4062-a351-88ea81fc8d12\") " pod="openshift-ingress-canary/ingress-canary-lhmvj" Jun 04 23:54:56.835445 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.835430 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqtll\" (UniqueName: \"kubernetes.io/projected/4ac9536e-706c-42b2-904f-a6facd64f42c-kube-api-access-gqtll\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:54:56.870732 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:56.870709 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lhmvj" Jun 04 23:54:57.029475 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:57.029442 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:54:57.032552 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:57.032529 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 04 23:54:57.032702 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:57.032530 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j7szf\"" Jun 04 23:54:57.032702 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:57.032577 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 04 23:54:57.230513 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:57.230481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:57.230690 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:57.230623 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 04 23:54:57.230690 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:57.230635 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd78b68c6-6scbt: secret "image-registry-tls" not found Jun 04 23:54:57.230801 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:57.230710 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls podName:61acbd7e-9273-4884-be2c-c4cc24217311 nodeName:}" failed. No retries permitted until 2026-06-04 23:54:58.23069135 +0000 UTC m=+36.588259484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls") pod "image-registry-fd78b68c6-6scbt" (UID: "61acbd7e-9273-4884-be2c-c4cc24217311") : secret "image-registry-tls" not found Jun 04 23:54:57.280741 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:57.280715 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lhmvj"] Jun 04 23:54:57.284531 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:54:57.284511 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedb8cf8a_5d0d_4062_a351_88ea81fc8d12.slice/crio-baa7424352e2a569340b186d0b2e984a4b8f974b8e427f149576b5aa64d8ce37 WatchSource:0}: Error finding container baa7424352e2a569340b186d0b2e984a4b8f974b8e427f149576b5aa64d8ce37: Status 404 returned error can't find the container with id baa7424352e2a569340b186d0b2e984a4b8f974b8e427f149576b5aa64d8ce37 Jun 04 23:54:57.331499 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:57.331472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:54:57.331603 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:57.331594 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:54:57.331654 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:57.331645 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls podName:4ac9536e-706c-42b2-904f-a6facd64f42c nodeName:}" failed. No retries permitted until 2026-06-04 23:54:58.331631854 +0000 UTC m=+36.689199973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls") pod "dns-default-b4hcm" (UID: "4ac9536e-706c-42b2-904f-a6facd64f42c") : secret "dns-default-metrics-tls" not found Jun 04 23:54:58.029805 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:58.029771 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:54:58.030295 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:58.029771 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:54:58.032989 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:58.032965 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 04 23:54:58.033140 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:58.032999 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 04 23:54:58.033140 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:58.033027 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l52sk\"" Jun 04 23:54:58.217550 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:58.217515 2564 generic.go:356] "Generic (PLEG): container finished" podID="95208ebe-68e1-43e0-9ba0-5fe7fba6d15f" containerID="21dd081f2f82a8958255040326efeb241d35b903fea8f50b5893784cd62805ef" exitCode=0 Jun 04 23:54:58.217714 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:58.217594 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k62wx" event={"ID":"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f","Type":"ContainerDied","Data":"21dd081f2f82a8958255040326efeb241d35b903fea8f50b5893784cd62805ef"} Jun 04 23:54:58.218713 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:58.218690 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lhmvj" event={"ID":"edb8cf8a-5d0d-4062-a351-88ea81fc8d12","Type":"ContainerStarted","Data":"baa7424352e2a569340b186d0b2e984a4b8f974b8e427f149576b5aa64d8ce37"} Jun 04 23:54:58.237894 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:58.237818 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:54:58.239353 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:58.238085 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 04 23:54:58.239353 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:58.238123 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd78b68c6-6scbt: secret "image-registry-tls" not found Jun 04 23:54:58.239353 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:58.238178 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls podName:61acbd7e-9273-4884-be2c-c4cc24217311 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:00.238159986 +0000 UTC m=+38.595728120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls") pod "image-registry-fd78b68c6-6scbt" (UID: "61acbd7e-9273-4884-be2c-c4cc24217311") : secret "image-registry-tls" not found Jun 04 23:54:58.339641 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:58.339340 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:54:58.339790 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:58.339700 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:54:58.339790 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:54:58.339780 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls podName:4ac9536e-706c-42b2-904f-a6facd64f42c nodeName:}" failed. No retries permitted until 2026-06-04 23:55:00.339759056 +0000 UTC m=+38.697327183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls") pod "dns-default-b4hcm" (UID: "4ac9536e-706c-42b2-904f-a6facd64f42c") : secret "dns-default-metrics-tls" not found Jun 04 23:54:59.225535 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:59.225335 2564 generic.go:356] "Generic (PLEG): container finished" podID="95208ebe-68e1-43e0-9ba0-5fe7fba6d15f" containerID="a76fc02d1b8bd46dae94f6250d4ceb4635998b04aad9873c56e2f7f90d0d3c4d" exitCode=0 Jun 04 23:54:59.225937 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:54:59.225399 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k62wx" event={"ID":"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f","Type":"ContainerDied","Data":"a76fc02d1b8bd46dae94f6250d4ceb4635998b04aad9873c56e2f7f90d0d3c4d"} Jun 04 23:55:00.230891 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:00.230821 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k62wx" event={"ID":"95208ebe-68e1-43e0-9ba0-5fe7fba6d15f","Type":"ContainerStarted","Data":"2407301aba34288c7fde0978c989a0ac36c56a0f92d2289d7f26f8cde9dfb554"} Jun 04 23:55:00.232265 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:00.232243 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lhmvj" event={"ID":"edb8cf8a-5d0d-4062-a351-88ea81fc8d12","Type":"ContainerStarted","Data":"11620b53ba23421cdb8a5aff6b3eb96d708fafe45a49d77f0e75d9ccf5ecd5f5"} Jun 04 23:55:00.254184 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:00.254154 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:55:00.254289 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:00.254276 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 04 23:55:00.254361 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:00.254291 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd78b68c6-6scbt: secret "image-registry-tls" not found Jun 04 23:55:00.254361 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:00.254338 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls podName:61acbd7e-9273-4884-be2c-c4cc24217311 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:04.254324768 +0000 UTC m=+42.611892891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls") pod "image-registry-fd78b68c6-6scbt" (UID: "61acbd7e-9273-4884-be2c-c4cc24217311") : secret "image-registry-tls" not found Jun 04 23:55:00.254824 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:00.254789 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k62wx" podStartSLOduration=8.708694325 podStartE2EDuration="38.254777058s" totalImagesPullingTime="29.546082733s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:55:00.254270302 +0000 UTC m=+38.611838505" watchObservedRunningTime="2026-06-04 23:55:00.254777058 +0000 UTC m=+38.612345200" Jun 04 23:55:00.269854 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:00.269818 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lhmvj" podStartSLOduration=2.11082654 podStartE2EDuration="4.269807282s" totalImagesPullingTime="2.158980742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:54:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:55:00.269300825 +0000 UTC m=+38.626868967" watchObservedRunningTime="2026-06-04 23:55:00.269807282 +0000 UTC m=+38.627375424" Jun 04 23:55:00.354661 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:00.354627 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:55:00.355256 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:00.355046 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:55:00.355341 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:00.355307 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls podName:4ac9536e-706c-42b2-904f-a6facd64f42c nodeName:}" failed. No retries permitted until 2026-06-04 23:55:04.355288447 +0000 UTC m=+42.712856567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls") pod "dns-default-b4hcm" (UID: "4ac9536e-706c-42b2-904f-a6facd64f42c") : secret "dns-default-metrics-tls" not found Jun 04 23:55:04.282446 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:04.282411 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:55:04.282802 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:04.282547 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 04 23:55:04.282802 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:04.282562 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd78b68c6-6scbt: secret "image-registry-tls" not found Jun 04 23:55:04.282802 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:04.282610 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls podName:61acbd7e-9273-4884-be2c-c4cc24217311 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:12.282596056 +0000 UTC m=+50.640164176 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls") pod "image-registry-fd78b68c6-6scbt" (UID: "61acbd7e-9273-4884-be2c-c4cc24217311") : secret "image-registry-tls" not found Jun 04 23:55:04.382924 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:04.382895 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:55:04.383051 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:04.383034 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:55:04.383099 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:04.383089 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls podName:4ac9536e-706c-42b2-904f-a6facd64f42c nodeName:}" failed. No retries permitted until 2026-06-04 23:55:12.383075034 +0000 UTC m=+50.740643153 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls") pod "dns-default-b4hcm" (UID: "4ac9536e-706c-42b2-904f-a6facd64f42c") : secret "dns-default-metrics-tls" not found Jun 04 23:55:12.338583 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:12.338545 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:55:12.339042 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:12.338669 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 04 23:55:12.339042 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:12.338695 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd78b68c6-6scbt: secret "image-registry-tls" not found Jun 04 23:55:12.339042 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:12.338756 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls podName:61acbd7e-9273-4884-be2c-c4cc24217311 nodeName:}" failed. No retries permitted until 2026-06-04 23:55:28.338740173 +0000 UTC m=+66.696308293 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls") pod "image-registry-fd78b68c6-6scbt" (UID: "61acbd7e-9273-4884-be2c-c4cc24217311") : secret "image-registry-tls" not found Jun 04 23:55:12.439404 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:12.439376 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:55:12.439540 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:12.439493 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:55:12.439540 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:12.439537 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls podName:4ac9536e-706c-42b2-904f-a6facd64f42c nodeName:}" failed. No retries permitted until 2026-06-04 23:55:28.439524933 +0000 UTC m=+66.797093054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls") pod "dns-default-b4hcm" (UID: "4ac9536e-706c-42b2-904f-a6facd64f42c") : secret "dns-default-metrics-tls" not found Jun 04 23:55:22.201656 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:22.201630 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wjspd" Jun 04 23:55:27.750829 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:27.750789 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs\") pod \"network-metrics-daemon-kf8nr\" (UID: \"04667814-8f0e-4653-a2a1-0b2fd6431e61\") " pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:55:27.754067 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:27.754047 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 04 23:55:27.761307 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:27.761289 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 04 23:55:27.761393 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:27.761343 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs podName:04667814-8f0e-4653-a2a1-0b2fd6431e61 nodeName:}" failed. No retries permitted until 2026-06-04 23:56:31.76132868 +0000 UTC m=+130.118896800 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs") pod "network-metrics-daemon-kf8nr" (UID: "04667814-8f0e-4653-a2a1-0b2fd6431e61") : secret "metrics-daemon-secret" not found Jun 04 23:55:27.852072 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:27.852042 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret\") pod \"global-pull-secret-syncer-258hw\" (UID: \"1b04efb1-c48b-4cde-b23e-fcf4ecee8253\") " pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:55:27.852179 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:27.852093 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khp8q\" (UniqueName: \"kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q\") pod \"network-check-target-nb7vh\" (UID: \"1b31f8cd-0950-4ab0-9058-a7e32d4a3c51\") " pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:55:27.855017 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:27.854999 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 04 23:55:27.855017 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:27.855007 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 04 23:55:27.865581 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:27.865559 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 04 23:55:27.866609 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:27.866594 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b04efb1-c48b-4cde-b23e-fcf4ecee8253-original-pull-secret\") pod \"global-pull-secret-syncer-258hw\" (UID: \"1b04efb1-c48b-4cde-b23e-fcf4ecee8253\") " pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:55:27.875980 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:27.875953 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khp8q\" (UniqueName: \"kubernetes.io/projected/1b31f8cd-0950-4ab0-9058-a7e32d4a3c51-kube-api-access-khp8q\") pod \"network-check-target-nb7vh\" (UID: \"1b31f8cd-0950-4ab0-9058-a7e32d4a3c51\") " pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:55:27.942202 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:27.942181 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j7szf\"" Jun 04 23:55:27.950345 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:27.950330 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:55:28.048648 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:28.048621 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-258hw" Jun 04 23:55:28.066021 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:28.066000 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nb7vh"] Jun 04 23:55:28.069025 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:55:28.069000 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b31f8cd_0950_4ab0_9058_a7e32d4a3c51.slice/crio-8f9b54affa7e4520d187175279bad37282af2b611b2a0e48c14609f1361dc3d2 WatchSource:0}: Error finding container 8f9b54affa7e4520d187175279bad37282af2b611b2a0e48c14609f1361dc3d2: Status 404 returned error can't find the container with id 8f9b54affa7e4520d187175279bad37282af2b611b2a0e48c14609f1361dc3d2 Jun 04 23:55:28.164073 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:28.164049 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-258hw"] Jun 04 23:55:28.166469 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:55:28.166445 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b04efb1_c48b_4cde_b23e_fcf4ecee8253.slice/crio-93afeae2edbe16eea37fcafd6d6a436da3254e0eaf089aa70248b37f96b9d9dd WatchSource:0}: Error finding container 93afeae2edbe16eea37fcafd6d6a436da3254e0eaf089aa70248b37f96b9d9dd: Status 404 returned error can't find the container with id 93afeae2edbe16eea37fcafd6d6a436da3254e0eaf089aa70248b37f96b9d9dd Jun 04 23:55:28.297536 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:28.297470 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-258hw" event={"ID":"1b04efb1-c48b-4cde-b23e-fcf4ecee8253","Type":"ContainerStarted","Data":"93afeae2edbe16eea37fcafd6d6a436da3254e0eaf089aa70248b37f96b9d9dd"} Jun 04 23:55:28.298407 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:28.298387 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nb7vh" event={"ID":"1b31f8cd-0950-4ab0-9058-a7e32d4a3c51","Type":"ContainerStarted","Data":"8f9b54affa7e4520d187175279bad37282af2b611b2a0e48c14609f1361dc3d2"} Jun 04 23:55:28.355997 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:28.355976 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:55:28.356125 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:28.356079 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 04 23:55:28.356125 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:28.356090 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd78b68c6-6scbt: secret "image-registry-tls" not found Jun 04 23:55:28.356209 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:28.356134 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls podName:61acbd7e-9273-4884-be2c-c4cc24217311 nodeName:}" failed. No retries permitted until 2026-06-04 23:56:00.356121791 +0000 UTC m=+98.713689911 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls") pod "image-registry-fd78b68c6-6scbt" (UID: "61acbd7e-9273-4884-be2c-c4cc24217311") : secret "image-registry-tls" not found Jun 04 23:55:28.456908 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:28.456885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:55:28.457045 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:28.457029 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:55:28.457102 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:55:28.457091 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls podName:4ac9536e-706c-42b2-904f-a6facd64f42c nodeName:}" failed. No retries permitted until 2026-06-04 23:56:00.457071989 +0000 UTC m=+98.814640109 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls") pod "dns-default-b4hcm" (UID: "4ac9536e-706c-42b2-904f-a6facd64f42c") : secret "dns-default-metrics-tls" not found Jun 04 23:55:33.313448 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:33.313413 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-258hw" event={"ID":"1b04efb1-c48b-4cde-b23e-fcf4ecee8253","Type":"ContainerStarted","Data":"7cc568e5283f79b46f288da02be97b7e477792f95ddaa9495ad1ecafbf6fe779"} Jun 04 23:55:33.314957 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:33.314933 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nb7vh" event={"ID":"1b31f8cd-0950-4ab0-9058-a7e32d4a3c51","Type":"ContainerStarted","Data":"0c3f06df8ffde1a621378c79feb946d5abdf0848009f6768d55f3afd020fda76"} Jun 04 23:55:33.315060 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:33.314988 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:55:33.328723 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:33.328664 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-258hw" podStartSLOduration=67.018386229 podStartE2EDuration="1m11.328652218s" totalImagesPullingTime="4.310265989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:55:33.327613868 +0000 UTC m=+71.685182021" watchObservedRunningTime="2026-06-04 23:55:33.328652218 +0000 UTC m=+71.686220359" Jun 04 23:55:33.341662 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:55:33.341623 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nb7vh" podStartSLOduration=66.937338141 podStartE2EDuration="1m11.341610077s" totalImagesPullingTime="4.404271936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:55:33.341170128 +0000 UTC m=+71.698738270" watchObservedRunningTime="2026-06-04 23:55:33.341610077 +0000 UTC m=+71.699178218" Jun 04 23:56:00.382929 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:56:00.382891 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:56:00.383411 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:56:00.383022 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 04 23:56:00.383411 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:56:00.383038 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd78b68c6-6scbt: secret "image-registry-tls" not found Jun 04 23:56:00.383411 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:56:00.383115 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls podName:61acbd7e-9273-4884-be2c-c4cc24217311 nodeName:}" failed. No retries permitted until 2026-06-04 23:57:04.383096093 +0000 UTC m=+162.740664220 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls") pod "image-registry-fd78b68c6-6scbt" (UID: "61acbd7e-9273-4884-be2c-c4cc24217311") : secret "image-registry-tls" not found Jun 04 23:56:00.483843 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:56:00.483761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:56:00.483959 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:56:00.483895 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:56:00.483959 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:56:00.483953 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls podName:4ac9536e-706c-42b2-904f-a6facd64f42c nodeName:}" failed. No retries permitted until 2026-06-04 23:57:04.483936202 +0000 UTC m=+162.841504328 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls") pod "dns-default-b4hcm" (UID: "4ac9536e-706c-42b2-904f-a6facd64f42c") : secret "dns-default-metrics-tls" not found Jun 04 23:56:04.319276 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:56:04.319244 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nb7vh" Jun 04 23:56:31.789032 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:56:31.788983 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs\") pod \"network-metrics-daemon-kf8nr\" (UID: \"04667814-8f0e-4653-a2a1-0b2fd6431e61\") " pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:56:31.789514 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:56:31.789128 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 04 23:56:31.789514 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:56:31.789201 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs podName:04667814-8f0e-4653-a2a1-0b2fd6431e61 nodeName:}" failed. No retries permitted until 2026-06-04 23:58:33.789185121 +0000 UTC m=+252.146753241 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs") pod "network-metrics-daemon-kf8nr" (UID: "04667814-8f0e-4653-a2a1-0b2fd6431e61") : secret "metrics-daemon-secret" not found Jun 04 23:56:59.551005 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:56:59.550965 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" podUID="61acbd7e-9273-4884-be2c-c4cc24217311" Jun 04 23:56:59.566233 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:56:59.566211 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b4hcm" podUID="4ac9536e-706c-42b2-904f-a6facd64f42c" Jun 04 23:57:00.514648 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:57:00.514569 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b4hcm" Jun 04 23:57:00.514802 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:57:00.514569 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:57:01.043369 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:57:01.043336 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:57:04.408662 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:57:04.408631 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:57:04.409023 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:57:04.408757 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 04 23:57:04.409023 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:57:04.408768 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd78b68c6-6scbt: secret "image-registry-tls" not found Jun 04 23:57:04.409023 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:57:04.408828 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls podName:61acbd7e-9273-4884-be2c-c4cc24217311 nodeName:}" failed. No retries permitted until 2026-06-04 23:59:06.408814562 +0000 UTC m=+284.766382682 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls") pod "image-registry-fd78b68c6-6scbt" (UID: "61acbd7e-9273-4884-be2c-c4cc24217311") : secret "image-registry-tls" not found Jun 04 23:57:04.509025 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:57:04.508991 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:57:04.509125 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:57:04.509100 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 04 23:57:04.509169 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:57:04.509154 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls podName:4ac9536e-706c-42b2-904f-a6facd64f42c nodeName:}" failed. No retries permitted until 2026-06-04 23:59:06.509142202 +0000 UTC m=+284.866710322 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls") pod "dns-default-b4hcm" (UID: "4ac9536e-706c-42b2-904f-a6facd64f42c") : secret "dns-default-metrics-tls" not found Jun 04 23:57:12.030652 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:57:12.030576 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:58:27.971129 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.971092 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76"] Jun 04 23:58:27.972893 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.972877 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76" Jun 04 23:58:27.975358 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.975336 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 04 23:58:27.975480 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.975465 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 04 23:58:27.975535 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.975514 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 04 23:58:27.975608 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.975592 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 04 23:58:27.977010 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.976988 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fvknm\"" Jun 04 23:58:27.978127 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.978105 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-dvmmp"] Jun 04 23:58:27.980213 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.979749 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7"] Jun 04 23:58:27.980213 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.980115 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:27.981358 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.981338 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7bgkv"] Jun 04 23:58:27.981454 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.981414 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" Jun 04 23:58:27.983027 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.983008 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 04 23:58:27.983136 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.983120 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-92l9k\"" Jun 04 23:58:27.983264 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.983249 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76"] Jun 04 23:58:27.983304 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.983282 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 04 23:58:27.983339 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.983325 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7bgkv" Jun 04 23:58:27.983684 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.983647 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 04 23:58:27.984268 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.984247 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tc7nr\"" Jun 04 23:58:27.984353 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.984341 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 04 23:58:27.986311 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.986293 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 04 23:58:27.986433 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.986337 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 04 23:58:27.986501 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.986434 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 04 23:58:27.987304 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.987285 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 04 23:58:27.987406 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.987310 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 04 23:58:27.987406 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.987330 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 04 23:58:27.987406 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.987388 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nr9kf\"" Jun 04 23:58:27.991388 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:27.991364 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 04 23:58:28.010534 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.010513 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7bgkv"] Jun 04 23:58:28.012265 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.012243 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7"] Jun 04 23:58:28.014627 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.014609 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-dvmmp"] Jun 04 23:58:28.058527 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.058505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e34b59-7676-4501-a84c-40cb8b9ec3bc-service-ca-bundle\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.058635 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.058542 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6tsb\" (UniqueName: \"kubernetes.io/projected/1b5cffb4-be62-4d5f-8a90-2e564a67de1d-kube-api-access-j6tsb\") pod \"service-ca-operator-6bc5ff68f5-z5m76\" (UID: \"1b5cffb4-be62-4d5f-8a90-2e564a67de1d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76" Jun 04 23:58:28.058635 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.058569 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b5cffb4-be62-4d5f-8a90-2e564a67de1d-config\") pod \"service-ca-operator-6bc5ff68f5-z5m76\" (UID: \"1b5cffb4-be62-4d5f-8a90-2e564a67de1d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76" Jun 04 23:58:28.058635 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.058586 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68e34b59-7676-4501-a84c-40cb8b9ec3bc-tmp\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.058635 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.058606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/68e34b59-7676-4501-a84c-40cb8b9ec3bc-snapshots\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.058823 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.058666 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b5cffb4-be62-4d5f-8a90-2e564a67de1d-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-z5m76\" (UID: \"1b5cffb4-be62-4d5f-8a90-2e564a67de1d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76" Jun 04 23:58:28.058823 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.058722 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68e34b59-7676-4501-a84c-40cb8b9ec3bc-serving-cert\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.058823 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.058739 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bxf4\" (UniqueName: \"kubernetes.io/projected/68e34b59-7676-4501-a84c-40cb8b9ec3bc-kube-api-access-5bxf4\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.058823 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.058765 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e34b59-7676-4501-a84c-40cb8b9ec3bc-trusted-ca-bundle\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.078311 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.078284 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss"] Jun 04 23:58:28.080092 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.080079 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk"] Jun 04 23:58:28.080200 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.080186 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss" Jun 04 23:58:28.081628 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.081612 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7b9b7767d7-cbxgf"] Jun 04 23:58:28.081740 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.081722 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk" Jun 04 23:58:28.083032 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.083018 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:28.084341 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.084324 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 04 23:58:28.084341 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.084333 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 04 23:58:28.084894 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.084881 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 04 23:58:28.085171 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.085152 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 04 23:58:28.085171 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.085164 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 04 23:58:28.085388 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.085376 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kvvpf\"" Jun 04 23:58:28.085919 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.085903 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6d4l5\"" Jun 04 23:58:28.086007 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.085940 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 04 23:58:28.086777 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.086726 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r7fg5\"" Jun 04 23:58:28.087080 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.087050 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 04 23:58:28.087196 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.087177 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 04 23:58:28.087300 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.087215 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 04 23:58:28.087367 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.087314 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 04 23:58:28.087461 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.087446 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 04 23:58:28.096826 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.096803 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss"] Jun 04 23:58:28.097628 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.097610 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk"] Jun 04 23:58:28.099883 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.099862 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b9b7767d7-cbxgf"] Jun 04 23:58:28.160061 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160037 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68e34b59-7676-4501-a84c-40cb8b9ec3bc-serving-cert\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.160173 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160064 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e34b59-7676-4501-a84c-40cb8b9ec3bc-trusted-ca-bundle\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.160173 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160087 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5c6t\" (UniqueName: \"kubernetes.io/projected/6c6c7626-fff6-4318-99f3-90c8474e1c7b-kube-api-access-j5c6t\") pod \"cluster-monitoring-operator-74bbf69bbb-skht7\" (UID: \"6c6c7626-fff6-4318-99f3-90c8474e1c7b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" Jun 04 23:58:28.160173 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160105 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e34b59-7676-4501-a84c-40cb8b9ec3bc-service-ca-bundle\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.160329 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160223 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-skht7\" (UID: \"6c6c7626-fff6-4318-99f3-90c8474e1c7b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" Jun 04 23:58:28.160329 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68e34b59-7676-4501-a84c-40cb8b9ec3bc-tmp\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.160329 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160298 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/68e34b59-7676-4501-a84c-40cb8b9ec3bc-snapshots\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.160483 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160329 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b5cffb4-be62-4d5f-8a90-2e564a67de1d-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-z5m76\" (UID: \"1b5cffb4-be62-4d5f-8a90-2e564a67de1d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76" Jun 04 23:58:28.160483 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160379 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bxf4\" (UniqueName: \"kubernetes.io/projected/68e34b59-7676-4501-a84c-40cb8b9ec3bc-kube-api-access-5bxf4\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.160483 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160406 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6c6c7626-fff6-4318-99f3-90c8474e1c7b-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-skht7\" (UID: \"6c6c7626-fff6-4318-99f3-90c8474e1c7b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" Jun 04 23:58:28.160483 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160444 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b57z\" (UniqueName: \"kubernetes.io/projected/6cb78786-11af-4447-bb35-21ba1a7f0db7-kube-api-access-5b57z\") pod \"cluster-samples-operator-854f8b96b6-ghlss\" (UID: \"6cb78786-11af-4447-bb35-21ba1a7f0db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss" Jun 04 23:58:28.160707 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160485 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ghlss\" (UID: \"6cb78786-11af-4447-bb35-21ba1a7f0db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss" Jun 04 23:58:28.160707 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160513 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68nds\" (UniqueName: \"kubernetes.io/projected/4e6ddfcc-cc4c-4752-9ad3-858254751fdb-kube-api-access-68nds\") pod \"volume-data-source-validator-78dd696465-7bgkv\" (UID: \"4e6ddfcc-cc4c-4752-9ad3-858254751fdb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7bgkv" Jun 04 23:58:28.160707 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160545 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6tsb\" (UniqueName: \"kubernetes.io/projected/1b5cffb4-be62-4d5f-8a90-2e564a67de1d-kube-api-access-j6tsb\") pod \"service-ca-operator-6bc5ff68f5-z5m76\" (UID: \"1b5cffb4-be62-4d5f-8a90-2e564a67de1d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76" Jun 04 23:58:28.160707 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160584 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b5cffb4-be62-4d5f-8a90-2e564a67de1d-config\") pod \"service-ca-operator-6bc5ff68f5-z5m76\" (UID: \"1b5cffb4-be62-4d5f-8a90-2e564a67de1d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76" Jun 04 23:58:28.160707 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160615 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68e34b59-7676-4501-a84c-40cb8b9ec3bc-tmp\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.160707 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160620 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e34b59-7676-4501-a84c-40cb8b9ec3bc-service-ca-bundle\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.161052 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.160994 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/68e34b59-7676-4501-a84c-40cb8b9ec3bc-snapshots\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.161110 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.161072 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e34b59-7676-4501-a84c-40cb8b9ec3bc-trusted-ca-bundle\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.161182 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.161163 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b5cffb4-be62-4d5f-8a90-2e564a67de1d-config\") pod \"service-ca-operator-6bc5ff68f5-z5m76\" (UID: \"1b5cffb4-be62-4d5f-8a90-2e564a67de1d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76" Jun 04 23:58:28.162545 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.162529 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68e34b59-7676-4501-a84c-40cb8b9ec3bc-serving-cert\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.162630 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.162615 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b5cffb4-be62-4d5f-8a90-2e564a67de1d-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-z5m76\" (UID: \"1b5cffb4-be62-4d5f-8a90-2e564a67de1d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76" Jun 04 23:58:28.166381 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.166358 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv"] Jun 04 23:58:28.169104 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.169088 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv" Jun 04 23:58:28.171661 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.171641 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6tsb\" (UniqueName: \"kubernetes.io/projected/1b5cffb4-be62-4d5f-8a90-2e564a67de1d-kube-api-access-j6tsb\") pod \"service-ca-operator-6bc5ff68f5-z5m76\" (UID: \"1b5cffb4-be62-4d5f-8a90-2e564a67de1d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76" Jun 04 23:58:28.171857 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.171822 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 04 23:58:28.171857 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.171854 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 04 23:58:28.172012 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.171965 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 04 23:58:28.172012 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.171967 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-w9mnr\"" Jun 04 23:58:28.172095 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.171971 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 04 23:58:28.172754 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.172735 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bxf4\" (UniqueName: \"kubernetes.io/projected/68e34b59-7676-4501-a84c-40cb8b9ec3bc-kube-api-access-5bxf4\") pod \"insights-operator-896549976-dvmmp\" (UID: \"68e34b59-7676-4501-a84c-40cb8b9ec3bc\") " pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.180536 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.180519 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv"] Jun 04 23:58:28.261616 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.261556 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68nds\" (UniqueName: \"kubernetes.io/projected/4e6ddfcc-cc4c-4752-9ad3-858254751fdb-kube-api-access-68nds\") pod \"volume-data-source-validator-78dd696465-7bgkv\" (UID: \"4e6ddfcc-cc4c-4752-9ad3-858254751fdb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7bgkv" Jun 04 23:58:28.261616 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.261591 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eaeb0029-3707-45ec-85c1-8b6e5f80b565-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-dzcsk\" (UID: \"eaeb0029-3707-45ec-85c1-8b6e5f80b565\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk" Jun 04 23:58:28.261766 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.261717 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d762fb3-d7c5-49e9-b799-f94c3f0e7807-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zbfhv\" (UID: \"4d762fb3-d7c5-49e9-b799-f94c3f0e7807\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv" Jun 04 23:58:28.261766 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.261755 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-stats-auth\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:28.261834 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.261783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:28.261834 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.261799 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:28.261834 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.261818 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5c6t\" (UniqueName: \"kubernetes.io/projected/6c6c7626-fff6-4318-99f3-90c8474e1c7b-kube-api-access-j5c6t\") pod \"cluster-monitoring-operator-74bbf69bbb-skht7\" (UID: \"6c6c7626-fff6-4318-99f3-90c8474e1c7b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" Jun 04 23:58:28.261969 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.261848 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-skht7\" (UID: \"6c6c7626-fff6-4318-99f3-90c8474e1c7b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" Jun 04 23:58:28.261969 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.261872 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4br5t\" (UniqueName: \"kubernetes.io/projected/475c2176-3c39-4fc5-bf77-2f749e41299b-kube-api-access-4br5t\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:28.261969 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.261919 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-default-certificate\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:28.261969 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.261921 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 04 23:58:28.261969 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.261957 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6c6c7626-fff6-4318-99f3-90c8474e1c7b-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-skht7\" (UID: \"6c6c7626-fff6-4318-99f3-90c8474e1c7b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" Jun 04 23:58:28.262172 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.261978 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls podName:6c6c7626-fff6-4318-99f3-90c8474e1c7b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:28.761963171 +0000 UTC m=+247.119531307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-skht7" (UID: "6c6c7626-fff6-4318-99f3-90c8474e1c7b") : secret "cluster-monitoring-operator-tls" not found Jun 04 23:58:28.262172 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.261996 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqlj8\" (UniqueName: \"kubernetes.io/projected/4d762fb3-d7c5-49e9-b799-f94c3f0e7807-kube-api-access-lqlj8\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zbfhv\" (UID: \"4d762fb3-d7c5-49e9-b799-f94c3f0e7807\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv" Jun 04 23:58:28.262172 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.262019 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b57z\" (UniqueName: \"kubernetes.io/projected/6cb78786-11af-4447-bb35-21ba1a7f0db7-kube-api-access-5b57z\") pod \"cluster-samples-operator-854f8b96b6-ghlss\" (UID: \"6cb78786-11af-4447-bb35-21ba1a7f0db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss" Jun 04 23:58:28.262172 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.262044 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d762fb3-d7c5-49e9-b799-f94c3f0e7807-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zbfhv\" (UID: \"4d762fb3-d7c5-49e9-b799-f94c3f0e7807\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv" Jun 04 23:58:28.262172 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.262103 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-dzcsk\" (UID: \"eaeb0029-3707-45ec-85c1-8b6e5f80b565\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk" Jun 04 23:58:28.262172 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.262143 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ghlss\" (UID: \"6cb78786-11af-4447-bb35-21ba1a7f0db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss" Jun 04 23:58:28.262458 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.262247 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 04 23:58:28.262458 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.262314 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls podName:6cb78786-11af-4447-bb35-21ba1a7f0db7 nodeName:}" failed. No retries permitted until 2026-06-04 23:58:28.76229627 +0000 UTC m=+247.119864392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ghlss" (UID: "6cb78786-11af-4447-bb35-21ba1a7f0db7") : secret "samples-operator-tls" not found Jun 04 23:58:28.262536 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.262519 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6c6c7626-fff6-4318-99f3-90c8474e1c7b-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-skht7\" (UID: \"6c6c7626-fff6-4318-99f3-90c8474e1c7b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" Jun 04 23:58:28.270363 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.270344 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5c6t\" (UniqueName: \"kubernetes.io/projected/6c6c7626-fff6-4318-99f3-90c8474e1c7b-kube-api-access-j5c6t\") pod \"cluster-monitoring-operator-74bbf69bbb-skht7\" (UID: \"6c6c7626-fff6-4318-99f3-90c8474e1c7b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" Jun 04 23:58:28.270453 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.270438 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b57z\" (UniqueName: \"kubernetes.io/projected/6cb78786-11af-4447-bb35-21ba1a7f0db7-kube-api-access-5b57z\") pod \"cluster-samples-operator-854f8b96b6-ghlss\" (UID: \"6cb78786-11af-4447-bb35-21ba1a7f0db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss" Jun 04 23:58:28.270898 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.270878 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68nds\" (UniqueName: \"kubernetes.io/projected/4e6ddfcc-cc4c-4752-9ad3-858254751fdb-kube-api-access-68nds\") pod \"volume-data-source-validator-78dd696465-7bgkv\" (UID: \"4e6ddfcc-cc4c-4752-9ad3-858254751fdb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7bgkv" Jun 04 23:58:28.282512 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.282493 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76" Jun 04 23:58:28.291886 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.291868 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-dvmmp" Jun 04 23:58:28.301825 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.301801 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7bgkv" Jun 04 23:58:28.363234 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.362970 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-dzcsk\" (UID: \"eaeb0029-3707-45ec-85c1-8b6e5f80b565\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk" Jun 04 23:58:28.363234 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.363048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eaeb0029-3707-45ec-85c1-8b6e5f80b565-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-dzcsk\" (UID: \"eaeb0029-3707-45ec-85c1-8b6e5f80b565\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk" Jun 04 23:58:28.363234 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.363101 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d762fb3-d7c5-49e9-b799-f94c3f0e7807-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zbfhv\" (UID: \"4d762fb3-d7c5-49e9-b799-f94c3f0e7807\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv" Jun 04 23:58:28.363234 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.363139 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-stats-auth\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:28.363234 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.363184 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:28.363234 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.363208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:28.363634 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.363260 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4br5t\" (UniqueName: \"kubernetes.io/projected/475c2176-3c39-4fc5-bf77-2f749e41299b-kube-api-access-4br5t\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:28.363634 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.363302 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-default-certificate\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:28.363634 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.363357 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqlj8\" (UniqueName: \"kubernetes.io/projected/4d762fb3-d7c5-49e9-b799-f94c3f0e7807-kube-api-access-lqlj8\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zbfhv\" (UID: \"4d762fb3-d7c5-49e9-b799-f94c3f0e7807\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv" Jun 04 23:58:28.363634 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.363385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d762fb3-d7c5-49e9-b799-f94c3f0e7807-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zbfhv\" (UID: \"4d762fb3-d7c5-49e9-b799-f94c3f0e7807\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv" Jun 04 23:58:28.363634 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.363568 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle podName:475c2176-3c39-4fc5-bf77-2f749e41299b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:28.863543438 +0000 UTC m=+247.221111578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle") pod "router-default-7b9b7767d7-cbxgf" (UID: "475c2176-3c39-4fc5-bf77-2f749e41299b") : configmap references non-existent config key: service-ca.crt Jun 04 23:58:28.365845 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.363915 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 04 23:58:28.365845 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.363970 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert podName:eaeb0029-3707-45ec-85c1-8b6e5f80b565 nodeName:}" failed. No retries permitted until 2026-06-04 23:58:28.863954745 +0000 UTC m=+247.221522879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-dzcsk" (UID: "eaeb0029-3707-45ec-85c1-8b6e5f80b565") : secret "networking-console-plugin-cert" not found Jun 04 23:58:28.365845 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.364657 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eaeb0029-3707-45ec-85c1-8b6e5f80b565-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-dzcsk\" (UID: \"eaeb0029-3707-45ec-85c1-8b6e5f80b565\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk" Jun 04 23:58:28.365845 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.364769 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 04 23:58:28.365845 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.364814 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs podName:475c2176-3c39-4fc5-bf77-2f749e41299b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:28.864798273 +0000 UTC m=+247.222366394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs") pod "router-default-7b9b7767d7-cbxgf" (UID: "475c2176-3c39-4fc5-bf77-2f749e41299b") : secret "router-metrics-certs-default" not found Jun 04 23:58:28.365845 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.365315 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d762fb3-d7c5-49e9-b799-f94c3f0e7807-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zbfhv\" (UID: \"4d762fb3-d7c5-49e9-b799-f94c3f0e7807\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv" Jun 04 23:58:28.367817 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.367299 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d762fb3-d7c5-49e9-b799-f94c3f0e7807-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zbfhv\" (UID: \"4d762fb3-d7c5-49e9-b799-f94c3f0e7807\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv" Jun 04 23:58:28.367817 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.367758 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-stats-auth\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:28.369727 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.369665 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-default-certificate\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:28.375638 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.375591 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqlj8\" (UniqueName: \"kubernetes.io/projected/4d762fb3-d7c5-49e9-b799-f94c3f0e7807-kube-api-access-lqlj8\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zbfhv\" (UID: \"4d762fb3-d7c5-49e9-b799-f94c3f0e7807\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv" Jun 04 23:58:28.376645 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.376619 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4br5t\" (UniqueName: \"kubernetes.io/projected/475c2176-3c39-4fc5-bf77-2f749e41299b-kube-api-access-4br5t\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:28.417001 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.416975 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76"] Jun 04 23:58:28.419216 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:58:28.419185 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b5cffb4_be62_4d5f_8a90_2e564a67de1d.slice/crio-0e2a6f3b6a33760c54220fbeed3f7f3d9669d6b3314f028ba07a91ff02795a7e WatchSource:0}: Error finding container 0e2a6f3b6a33760c54220fbeed3f7f3d9669d6b3314f028ba07a91ff02795a7e: Status 404 returned error can't find the container with id 0e2a6f3b6a33760c54220fbeed3f7f3d9669d6b3314f028ba07a91ff02795a7e Jun 04 23:58:28.435700 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.435662 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-dvmmp"] Jun 04 23:58:28.437443 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:58:28.437416 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e34b59_7676_4501_a84c_40cb8b9ec3bc.slice/crio-1fa8645303f386dc99292c076d4a375fcfbf08c0e32e8243467b4c9778a4eb87 WatchSource:0}: Error finding container 1fa8645303f386dc99292c076d4a375fcfbf08c0e32e8243467b4c9778a4eb87: Status 404 returned error can't find the container with id 1fa8645303f386dc99292c076d4a375fcfbf08c0e32e8243467b4c9778a4eb87 Jun 04 23:58:28.450015 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.449992 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7bgkv"] Jun 04 23:58:28.452568 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:58:28.452548 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6ddfcc_cc4c_4752_9ad3_858254751fdb.slice/crio-38cb4064c32a27f1fd6fb34a22c3fde335806356453e952fa149af2fbdff9724 WatchSource:0}: Error finding container 38cb4064c32a27f1fd6fb34a22c3fde335806356453e952fa149af2fbdff9724: Status 404 returned error can't find the container with id 38cb4064c32a27f1fd6fb34a22c3fde335806356453e952fa149af2fbdff9724 Jun 04 23:58:28.486411 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.486390 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv" Jun 04 23:58:28.604776 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.604747 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv"] Jun 04 23:58:28.607292 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:58:28.607268 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d762fb3_d7c5_49e9_b799_f94c3f0e7807.slice/crio-5f465bf65443fe64206e5465a9ef6e3e23fc909151a4e4de72ecf6ec36ed8094 WatchSource:0}: Error finding container 5f465bf65443fe64206e5465a9ef6e3e23fc909151a4e4de72ecf6ec36ed8094: Status 404 returned error can't find the container with id 5f465bf65443fe64206e5465a9ef6e3e23fc909151a4e4de72ecf6ec36ed8094 Jun 04 23:58:28.724102 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.724073 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76" event={"ID":"1b5cffb4-be62-4d5f-8a90-2e564a67de1d","Type":"ContainerStarted","Data":"0e2a6f3b6a33760c54220fbeed3f7f3d9669d6b3314f028ba07a91ff02795a7e"} Jun 04 23:58:28.725057 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.725034 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv" event={"ID":"4d762fb3-d7c5-49e9-b799-f94c3f0e7807","Type":"ContainerStarted","Data":"5f465bf65443fe64206e5465a9ef6e3e23fc909151a4e4de72ecf6ec36ed8094"} Jun 04 23:58:28.726136 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.726115 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7bgkv" event={"ID":"4e6ddfcc-cc4c-4752-9ad3-858254751fdb","Type":"ContainerStarted","Data":"38cb4064c32a27f1fd6fb34a22c3fde335806356453e952fa149af2fbdff9724"} Jun 04 23:58:28.727179 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.727160 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-dvmmp" event={"ID":"68e34b59-7676-4501-a84c-40cb8b9ec3bc","Type":"ContainerStarted","Data":"1fa8645303f386dc99292c076d4a375fcfbf08c0e32e8243467b4c9778a4eb87"} Jun 04 23:58:28.766996 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.766968 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ghlss\" (UID: \"6cb78786-11af-4447-bb35-21ba1a7f0db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss" Jun 04 23:58:28.767102 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.767085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-skht7\" (UID: \"6c6c7626-fff6-4318-99f3-90c8474e1c7b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" Jun 04 23:58:28.767149 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.767127 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 04 23:58:28.767208 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.767199 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls podName:6cb78786-11af-4447-bb35-21ba1a7f0db7 nodeName:}" failed. No retries permitted until 2026-06-04 23:58:29.767185088 +0000 UTC m=+248.124753208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ghlss" (UID: "6cb78786-11af-4447-bb35-21ba1a7f0db7") : secret "samples-operator-tls" not found Jun 04 23:58:28.767208 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.767200 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 04 23:58:28.767280 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.767228 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls podName:6c6c7626-fff6-4318-99f3-90c8474e1c7b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:29.767222489 +0000 UTC m=+248.124790609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-skht7" (UID: "6c6c7626-fff6-4318-99f3-90c8474e1c7b") : secret "cluster-monitoring-operator-tls" not found Jun 04 23:58:28.867660 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.867604 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:28.867660 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.867635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:28.867788 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:28.867709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-dzcsk\" (UID: \"eaeb0029-3707-45ec-85c1-8b6e5f80b565\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk" Jun 04 23:58:28.867826 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.867796 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle podName:475c2176-3c39-4fc5-bf77-2f749e41299b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:29.867781846 +0000 UTC m=+248.225349966 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle") pod "router-default-7b9b7767d7-cbxgf" (UID: "475c2176-3c39-4fc5-bf77-2f749e41299b") : configmap references non-existent config key: service-ca.crt Jun 04 23:58:28.867826 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.867822 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 04 23:58:28.867893 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.867870 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert podName:eaeb0029-3707-45ec-85c1-8b6e5f80b565 nodeName:}" failed. No retries permitted until 2026-06-04 23:58:29.867859661 +0000 UTC m=+248.225427782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-dzcsk" (UID: "eaeb0029-3707-45ec-85c1-8b6e5f80b565") : secret "networking-console-plugin-cert" not found Jun 04 23:58:28.867893 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.867820 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 04 23:58:28.867958 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:28.867898 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs podName:475c2176-3c39-4fc5-bf77-2f749e41299b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:29.867891758 +0000 UTC m=+248.225459877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs") pod "router-default-7b9b7767d7-cbxgf" (UID: "475c2176-3c39-4fc5-bf77-2f749e41299b") : secret "router-metrics-certs-default" not found Jun 04 23:58:29.778127 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:29.777822 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-skht7\" (UID: \"6c6c7626-fff6-4318-99f3-90c8474e1c7b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" Jun 04 23:58:29.778127 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:29.777938 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ghlss\" (UID: \"6cb78786-11af-4447-bb35-21ba1a7f0db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss" Jun 04 23:58:29.778127 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:29.777989 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 04 23:58:29.778127 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:29.778057 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls podName:6c6c7626-fff6-4318-99f3-90c8474e1c7b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:31.778037091 +0000 UTC m=+250.135605218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-skht7" (UID: "6c6c7626-fff6-4318-99f3-90c8474e1c7b") : secret "cluster-monitoring-operator-tls" not found Jun 04 23:58:29.778127 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:29.778100 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 04 23:58:29.778787 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:29.778150 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls podName:6cb78786-11af-4447-bb35-21ba1a7f0db7 nodeName:}" failed. No retries permitted until 2026-06-04 23:58:31.778135116 +0000 UTC m=+250.135703248 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ghlss" (UID: "6cb78786-11af-4447-bb35-21ba1a7f0db7") : secret "samples-operator-tls" not found Jun 04 23:58:29.879397 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:29.879361 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:29.879397 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:29.879407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:29.879649 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:29.879525 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 04 23:58:29.879649 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:29.879550 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle podName:475c2176-3c39-4fc5-bf77-2f749e41299b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:31.87952782 +0000 UTC m=+250.237095940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle") pod "router-default-7b9b7767d7-cbxgf" (UID: "475c2176-3c39-4fc5-bf77-2f749e41299b") : configmap references non-existent config key: service-ca.crt Jun 04 23:58:29.879888 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:29.879699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-dzcsk\" (UID: \"eaeb0029-3707-45ec-85c1-8b6e5f80b565\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk" Jun 04 23:58:29.879888 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:29.879776 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs podName:475c2176-3c39-4fc5-bf77-2f749e41299b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:31.879759492 +0000 UTC m=+250.237327618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs") pod "router-default-7b9b7767d7-cbxgf" (UID: "475c2176-3c39-4fc5-bf77-2f749e41299b") : secret "router-metrics-certs-default" not found Jun 04 23:58:29.879888 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:29.879832 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 04 23:58:29.880046 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:29.879963 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert podName:eaeb0029-3707-45ec-85c1-8b6e5f80b565 nodeName:}" failed. No retries permitted until 2026-06-04 23:58:31.879929944 +0000 UTC m=+250.237498079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-dzcsk" (UID: "eaeb0029-3707-45ec-85c1-8b6e5f80b565") : secret "networking-console-plugin-cert" not found Jun 04 23:58:30.734690 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:30.734638 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7bgkv" event={"ID":"4e6ddfcc-cc4c-4752-9ad3-858254751fdb","Type":"ContainerStarted","Data":"e544ca29c414e7f796e64f542f656b0c42b9aaea81799bf738ac6e37cd41b225"} Jun 04 23:58:31.741641 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:31.741560 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv" event={"ID":"4d762fb3-d7c5-49e9-b799-f94c3f0e7807","Type":"ContainerStarted","Data":"e0c3823227c7aa76b47011770dfc8473536b18168ceb1dd275ba1b50e48c1223"} Jun 04 23:58:31.743271 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:31.743245 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-dvmmp" event={"ID":"68e34b59-7676-4501-a84c-40cb8b9ec3bc","Type":"ContainerStarted","Data":"08409b106e698ed3c3e68bdc67b731b4caa7ef2b135edcecbfb159357935b93a"} Jun 04 23:58:31.744721 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:31.744697 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76" event={"ID":"1b5cffb4-be62-4d5f-8a90-2e564a67de1d","Type":"ContainerStarted","Data":"4228e099c970e642d5c17095cc1ce72a55f3df8bcca0565f92cf568be3297649"} Jun 04 23:58:31.758183 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:31.758141 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7bgkv" podStartSLOduration=3.52670007 podStartE2EDuration="4.758127563s" totalImagesPullingTime="1.231427493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:58:30.754554555 +0000 UTC m=+249.112122699" watchObservedRunningTime="2026-06-04 23:58:31.758127563 +0000 UTC m=+250.115695705" Jun 04 23:58:31.758633 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:31.758610 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv" podStartSLOduration=0.977527631 podStartE2EDuration="3.758601392s" totalImagesPullingTime="2.781073761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:58:31.757259752 +0000 UTC m=+250.114827894" watchObservedRunningTime="2026-06-04 23:58:31.758601392 +0000 UTC m=+250.116169511" Jun 04 23:58:31.774121 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:31.774075 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-dvmmp" podStartSLOduration=1.817688532 podStartE2EDuration="4.774060179s" totalImagesPullingTime="2.956371647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:58:31.772332208 +0000 UTC m=+250.129900369" watchObservedRunningTime="2026-06-04 23:58:31.774060179 +0000 UTC m=+250.131628322" Jun 04 23:58:31.792790 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:31.792746 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76" podStartSLOduration=1.818827686 podStartE2EDuration="4.792729642s" totalImagesPullingTime="2.973901956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:58:31.791439348 +0000 UTC m=+250.149007494" watchObservedRunningTime="2026-06-04 23:58:31.792729642 +0000 UTC m=+250.150297785" Jun 04 23:58:31.796252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:31.796055 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ghlss\" (UID: \"6cb78786-11af-4447-bb35-21ba1a7f0db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss" Jun 04 23:58:31.796252 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:31.796174 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-skht7\" (UID: \"6c6c7626-fff6-4318-99f3-90c8474e1c7b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" Jun 04 23:58:31.796252 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:31.796177 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 04 23:58:31.796466 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:31.796317 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls podName:6cb78786-11af-4447-bb35-21ba1a7f0db7 nodeName:}" failed. No retries permitted until 2026-06-04 23:58:35.796299172 +0000 UTC m=+254.153867318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ghlss" (UID: "6cb78786-11af-4447-bb35-21ba1a7f0db7") : secret "samples-operator-tls" not found Jun 04 23:58:31.796610 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:31.796228 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 04 23:58:31.796610 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:31.796590 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls podName:6c6c7626-fff6-4318-99f3-90c8474e1c7b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:35.79657115 +0000 UTC m=+254.154139283 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-skht7" (UID: "6c6c7626-fff6-4318-99f3-90c8474e1c7b") : secret "cluster-monitoring-operator-tls" not found Jun 04 23:58:31.897151 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:31.897120 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-dzcsk\" (UID: \"eaeb0029-3707-45ec-85c1-8b6e5f80b565\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk" Jun 04 23:58:31.897294 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:31.897221 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 04 23:58:31.897294 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:31.897285 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert podName:eaeb0029-3707-45ec-85c1-8b6e5f80b565 nodeName:}" failed. No retries permitted until 2026-06-04 23:58:35.897267326 +0000 UTC m=+254.254835449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-dzcsk" (UID: "eaeb0029-3707-45ec-85c1-8b6e5f80b565") : secret "networking-console-plugin-cert" not found Jun 04 23:58:31.897404 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:31.897341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:31.897404 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:31.897367 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:31.897909 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:31.897889 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle podName:475c2176-3c39-4fc5-bf77-2f749e41299b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:35.897872756 +0000 UTC m=+254.255440882 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle") pod "router-default-7b9b7767d7-cbxgf" (UID: "475c2176-3c39-4fc5-bf77-2f749e41299b") : configmap references non-existent config key: service-ca.crt Jun 04 23:58:31.897984 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:31.897955 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 04 23:58:31.898021 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:31.897990 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs podName:475c2176-3c39-4fc5-bf77-2f749e41299b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:35.897979173 +0000 UTC m=+254.255547298 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs") pod "router-default-7b9b7767d7-cbxgf" (UID: "475c2176-3c39-4fc5-bf77-2f749e41299b") : secret "router-metrics-certs-default" not found Jun 04 23:58:32.774147 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:32.774117 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-4bqms"] Jun 04 23:58:32.776555 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:32.776535 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4bqms" Jun 04 23:58:32.779383 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:32.779339 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 04 23:58:32.780495 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:32.780458 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dllzc\"" Jun 04 23:58:32.780603 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:32.780499 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 04 23:58:32.784590 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:32.784572 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-4bqms"] Jun 04 23:58:32.906057 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:32.906013 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swrdm\" (UniqueName: \"kubernetes.io/projected/095776ef-0e75-42d4-ad07-7feea46b4dbd-kube-api-access-swrdm\") pod \"migrator-955ffdf5f-4bqms\" (UID: \"095776ef-0e75-42d4-ad07-7feea46b4dbd\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4bqms" Jun 04 23:58:33.007594 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:33.007558 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swrdm\" (UniqueName: \"kubernetes.io/projected/095776ef-0e75-42d4-ad07-7feea46b4dbd-kube-api-access-swrdm\") pod \"migrator-955ffdf5f-4bqms\" (UID: \"095776ef-0e75-42d4-ad07-7feea46b4dbd\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4bqms" Jun 04 23:58:33.016307 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:33.016281 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swrdm\" (UniqueName: \"kubernetes.io/projected/095776ef-0e75-42d4-ad07-7feea46b4dbd-kube-api-access-swrdm\") pod \"migrator-955ffdf5f-4bqms\" (UID: \"095776ef-0e75-42d4-ad07-7feea46b4dbd\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4bqms" Jun 04 23:58:33.086760 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:33.086703 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4bqms" Jun 04 23:58:33.205264 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:33.205239 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-4bqms"] Jun 04 23:58:33.207502 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:58:33.207474 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod095776ef_0e75_42d4_ad07_7feea46b4dbd.slice/crio-acb8d5c30c88947677f4d5ea490b3648ef00f3829521c630377db32ce6af5a67 WatchSource:0}: Error finding container acb8d5c30c88947677f4d5ea490b3648ef00f3829521c630377db32ce6af5a67: Status 404 returned error can't find the container with id acb8d5c30c88947677f4d5ea490b3648ef00f3829521c630377db32ce6af5a67 Jun 04 23:58:33.753431 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:33.753402 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4bqms" event={"ID":"095776ef-0e75-42d4-ad07-7feea46b4dbd","Type":"ContainerStarted","Data":"acb8d5c30c88947677f4d5ea490b3648ef00f3829521c630377db32ce6af5a67"} Jun 04 23:58:33.814413 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:33.814383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs\") pod \"network-metrics-daemon-kf8nr\" (UID: \"04667814-8f0e-4653-a2a1-0b2fd6431e61\") " pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:58:33.814842 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:33.814565 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 04 23:58:33.814842 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:33.814649 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs podName:04667814-8f0e-4653-a2a1-0b2fd6431e61 nodeName:}" failed. No retries permitted until 2026-06-05 00:00:35.814630377 +0000 UTC m=+374.172198500 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs") pod "network-metrics-daemon-kf8nr" (UID: "04667814-8f0e-4653-a2a1-0b2fd6431e61") : secret "metrics-daemon-secret" not found Jun 04 23:58:34.381065 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:34.381045 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n29wb_54d5011b-d74d-4c1c-adef-cfd356716eb0/dns-node-resolver/0.log" Jun 04 23:58:34.758116 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:34.758083 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4bqms" event={"ID":"095776ef-0e75-42d4-ad07-7feea46b4dbd","Type":"ContainerStarted","Data":"dfb137820bb974409fbc48815948fb37523d220252cdd3a882ccce5374cf7831"} Jun 04 23:58:34.758259 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:34.758132 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4bqms" event={"ID":"095776ef-0e75-42d4-ad07-7feea46b4dbd","Type":"ContainerStarted","Data":"a0b3f7d28849b2d86fe78fdf5067f7d803bd84391c8d105a9082ecc310bfec4a"} Jun 04 23:58:34.774190 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:34.774147 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-4bqms" podStartSLOduration=1.7559855309999999 podStartE2EDuration="2.774134486s" totalImagesPullingTime="1.018148955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:58:34.77334343 +0000 UTC m=+253.130911571" watchObservedRunningTime="2026-06-04 23:58:34.774134486 +0000 UTC m=+253.131702628" Jun 04 23:58:35.581317 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:35.581292 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qdfkf_dd7ef963-f56f-424d-9065-a736675ad48a/node-ca/0.log" Jun 04 23:58:35.830081 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:35.830039 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-skht7\" (UID: \"6c6c7626-fff6-4318-99f3-90c8474e1c7b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" Jun 04 23:58:35.830257 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:35.830121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ghlss\" (UID: \"6cb78786-11af-4447-bb35-21ba1a7f0db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss" Jun 04 23:58:35.830257 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:35.830174 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 04 23:58:35.830257 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:35.830233 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls podName:6c6c7626-fff6-4318-99f3-90c8474e1c7b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:43.830216405 +0000 UTC m=+262.187784525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-skht7" (UID: "6c6c7626-fff6-4318-99f3-90c8474e1c7b") : secret "cluster-monitoring-operator-tls" not found Jun 04 23:58:35.830257 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:35.830235 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 04 23:58:35.830395 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:35.830277 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls podName:6cb78786-11af-4447-bb35-21ba1a7f0db7 nodeName:}" failed. No retries permitted until 2026-06-04 23:58:43.830264534 +0000 UTC m=+262.187832655 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ghlss" (UID: "6cb78786-11af-4447-bb35-21ba1a7f0db7") : secret "samples-operator-tls" not found Jun 04 23:58:35.931191 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:35.931154 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:35.931191 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:35.931196 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:35.931444 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:35.931248 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-dzcsk\" (UID: \"eaeb0029-3707-45ec-85c1-8b6e5f80b565\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk" Jun 04 23:58:35.931444 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:35.931323 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle podName:475c2176-3c39-4fc5-bf77-2f749e41299b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:43.931303908 +0000 UTC m=+262.288872028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle") pod "router-default-7b9b7767d7-cbxgf" (UID: "475c2176-3c39-4fc5-bf77-2f749e41299b") : configmap references non-existent config key: service-ca.crt Jun 04 23:58:35.931444 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:35.931340 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 04 23:58:35.931444 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:35.931376 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert podName:eaeb0029-3707-45ec-85c1-8b6e5f80b565 nodeName:}" failed. No retries permitted until 2026-06-04 23:58:43.931365481 +0000 UTC m=+262.288933601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-dzcsk" (UID: "eaeb0029-3707-45ec-85c1-8b6e5f80b565") : secret "networking-console-plugin-cert" not found Jun 04 23:58:35.931444 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:35.931372 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 04 23:58:35.931444 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:35.931419 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs podName:475c2176-3c39-4fc5-bf77-2f749e41299b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:43.931409559 +0000 UTC m=+262.288977679 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs") pod "router-default-7b9b7767d7-cbxgf" (UID: "475c2176-3c39-4fc5-bf77-2f749e41299b") : secret "router-metrics-certs-default" not found Jun 04 23:58:36.381669 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:36.381644 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lhmvj_edb8cf8a-5d0d-4062-a351-88ea81fc8d12/serve-healthcheck-canary/0.log" Jun 04 23:58:43.892451 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:43.892365 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-skht7\" (UID: \"6c6c7626-fff6-4318-99f3-90c8474e1c7b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" Jun 04 23:58:43.892451 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:43.892436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ghlss\" (UID: \"6cb78786-11af-4447-bb35-21ba1a7f0db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss" Jun 04 23:58:43.892858 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:43.892499 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 04 23:58:43.892858 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:43.892574 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls podName:6c6c7626-fff6-4318-99f3-90c8474e1c7b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:59.892561388 +0000 UTC m=+278.250129508 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-skht7" (UID: "6c6c7626-fff6-4318-99f3-90c8474e1c7b") : secret "cluster-monitoring-operator-tls" not found Jun 04 23:58:43.894779 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:43.894759 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6cb78786-11af-4447-bb35-21ba1a7f0db7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ghlss\" (UID: \"6cb78786-11af-4447-bb35-21ba1a7f0db7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss" Jun 04 23:58:43.990530 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:43.990504 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss" Jun 04 23:58:43.993620 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:43.993603 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-dzcsk\" (UID: \"eaeb0029-3707-45ec-85c1-8b6e5f80b565\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk" Jun 04 23:58:43.993691 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:43.993662 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:43.993744 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:43.993693 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:58:43.993796 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:43.993753 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 04 23:58:43.993796 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:43.993774 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 04 23:58:43.993889 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:43.993812 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert podName:eaeb0029-3707-45ec-85c1-8b6e5f80b565 nodeName:}" failed. No retries permitted until 2026-06-04 23:58:59.993795916 +0000 UTC m=+278.351364041 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-dzcsk" (UID: "eaeb0029-3707-45ec-85c1-8b6e5f80b565") : secret "networking-console-plugin-cert" not found Jun 04 23:58:43.993889 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:43.993826 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs podName:475c2176-3c39-4fc5-bf77-2f749e41299b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:59.993820061 +0000 UTC m=+278.351388180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs") pod "router-default-7b9b7767d7-cbxgf" (UID: "475c2176-3c39-4fc5-bf77-2f749e41299b") : secret "router-metrics-certs-default" not found Jun 04 23:58:43.993889 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:58:43.993880 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle podName:475c2176-3c39-4fc5-bf77-2f749e41299b nodeName:}" failed. No retries permitted until 2026-06-04 23:58:59.993856546 +0000 UTC m=+278.351424673 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle") pod "router-default-7b9b7767d7-cbxgf" (UID: "475c2176-3c39-4fc5-bf77-2f749e41299b") : configmap references non-existent config key: service-ca.crt Jun 04 23:58:44.114074 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:44.114045 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss"] Jun 04 23:58:44.788232 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:44.788194 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss" event={"ID":"6cb78786-11af-4447-bb35-21ba1a7f0db7","Type":"ContainerStarted","Data":"ce548f44fc402f867a420ef887c29b12b24ba286fcd602237fd0c78e934d5f68"} Jun 04 23:58:45.794394 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:45.794359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss" event={"ID":"6cb78786-11af-4447-bb35-21ba1a7f0db7","Type":"ContainerStarted","Data":"bd231c581128582b99a3c97a45dff12c6addd9d9311785ade3d142370e4cba24"} Jun 04 23:58:45.794822 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:45.794415 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss" event={"ID":"6cb78786-11af-4447-bb35-21ba1a7f0db7","Type":"ContainerStarted","Data":"b68785b060485305dc3600db59d062c425a6dd638126b410a6b99480fea0fce1"} Jun 04 23:58:45.810609 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:45.810536 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ghlss" podStartSLOduration=16.404596416 podStartE2EDuration="17.810523767s" totalImagesPullingTime="1.405927351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:58:45.809271623 +0000 UTC m=+264.166839767" watchObservedRunningTime="2026-06-04 23:58:45.810523767 +0000 UTC m=+264.168091909" Jun 04 23:58:56.947910 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:56.947872 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m9tkp"] Jun 04 23:58:56.954056 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:56.954036 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m9tkp" Jun 04 23:58:56.958970 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:56.958948 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6lqsc\"" Jun 04 23:58:56.959086 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:56.958950 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 04 23:58:56.959086 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:56.958967 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 04 23:58:56.975572 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:56.975550 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m9tkp"] Jun 04 23:58:56.993766 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:56.993743 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2514d1ca-d78b-4fd8-82c7-9880624aa843-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m9tkp\" (UID: \"2514d1ca-d78b-4fd8-82c7-9880624aa843\") " pod="openshift-insights/insights-runtime-extractor-m9tkp" Jun 04 23:58:56.993838 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:56.993773 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99v45\" (UniqueName: \"kubernetes.io/projected/2514d1ca-d78b-4fd8-82c7-9880624aa843-kube-api-access-99v45\") pod \"insights-runtime-extractor-m9tkp\" (UID: \"2514d1ca-d78b-4fd8-82c7-9880624aa843\") " pod="openshift-insights/insights-runtime-extractor-m9tkp" Jun 04 23:58:56.993884 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:56.993852 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2514d1ca-d78b-4fd8-82c7-9880624aa843-crio-socket\") pod \"insights-runtime-extractor-m9tkp\" (UID: \"2514d1ca-d78b-4fd8-82c7-9880624aa843\") " pod="openshift-insights/insights-runtime-extractor-m9tkp" Jun 04 23:58:56.993884 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:56.993879 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2514d1ca-d78b-4fd8-82c7-9880624aa843-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m9tkp\" (UID: \"2514d1ca-d78b-4fd8-82c7-9880624aa843\") " pod="openshift-insights/insights-runtime-extractor-m9tkp" Jun 04 23:58:56.993989 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:56.993970 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2514d1ca-d78b-4fd8-82c7-9880624aa843-data-volume\") pod \"insights-runtime-extractor-m9tkp\" (UID: \"2514d1ca-d78b-4fd8-82c7-9880624aa843\") " pod="openshift-insights/insights-runtime-extractor-m9tkp" Jun 04 23:58:57.094448 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:57.094420 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2514d1ca-d78b-4fd8-82c7-9880624aa843-crio-socket\") pod \"insights-runtime-extractor-m9tkp\" (UID: \"2514d1ca-d78b-4fd8-82c7-9880624aa843\") " pod="openshift-insights/insights-runtime-extractor-m9tkp" Jun 04 23:58:57.094558 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:57.094454 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2514d1ca-d78b-4fd8-82c7-9880624aa843-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m9tkp\" (UID: \"2514d1ca-d78b-4fd8-82c7-9880624aa843\") " pod="openshift-insights/insights-runtime-extractor-m9tkp" Jun 04 23:58:57.094558 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:57.094506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2514d1ca-d78b-4fd8-82c7-9880624aa843-data-volume\") pod \"insights-runtime-extractor-m9tkp\" (UID: \"2514d1ca-d78b-4fd8-82c7-9880624aa843\") " pod="openshift-insights/insights-runtime-extractor-m9tkp" Jun 04 23:58:57.094558 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:57.094537 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2514d1ca-d78b-4fd8-82c7-9880624aa843-crio-socket\") pod \"insights-runtime-extractor-m9tkp\" (UID: \"2514d1ca-d78b-4fd8-82c7-9880624aa843\") " pod="openshift-insights/insights-runtime-extractor-m9tkp" Jun 04 23:58:57.094699 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:57.094562 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2514d1ca-d78b-4fd8-82c7-9880624aa843-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m9tkp\" (UID: \"2514d1ca-d78b-4fd8-82c7-9880624aa843\") " pod="openshift-insights/insights-runtime-extractor-m9tkp" Jun 04 23:58:57.094699 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:57.094596 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99v45\" (UniqueName: \"kubernetes.io/projected/2514d1ca-d78b-4fd8-82c7-9880624aa843-kube-api-access-99v45\") pod \"insights-runtime-extractor-m9tkp\" (UID: \"2514d1ca-d78b-4fd8-82c7-9880624aa843\") " pod="openshift-insights/insights-runtime-extractor-m9tkp" Jun 04 23:58:57.094839 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:57.094821 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2514d1ca-d78b-4fd8-82c7-9880624aa843-data-volume\") pod \"insights-runtime-extractor-m9tkp\" (UID: \"2514d1ca-d78b-4fd8-82c7-9880624aa843\") " pod="openshift-insights/insights-runtime-extractor-m9tkp" Jun 04 23:58:57.095133 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:57.095113 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2514d1ca-d78b-4fd8-82c7-9880624aa843-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m9tkp\" (UID: \"2514d1ca-d78b-4fd8-82c7-9880624aa843\") " pod="openshift-insights/insights-runtime-extractor-m9tkp" Jun 04 23:58:57.096770 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:57.096740 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2514d1ca-d78b-4fd8-82c7-9880624aa843-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m9tkp\" (UID: \"2514d1ca-d78b-4fd8-82c7-9880624aa843\") " pod="openshift-insights/insights-runtime-extractor-m9tkp" Jun 04 23:58:57.112504 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:57.112484 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99v45\" (UniqueName: \"kubernetes.io/projected/2514d1ca-d78b-4fd8-82c7-9880624aa843-kube-api-access-99v45\") pod \"insights-runtime-extractor-m9tkp\" (UID: \"2514d1ca-d78b-4fd8-82c7-9880624aa843\") " pod="openshift-insights/insights-runtime-extractor-m9tkp" Jun 04 23:58:57.262028 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:57.261967 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m9tkp" Jun 04 23:58:57.386180 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:57.386151 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m9tkp"] Jun 04 23:58:57.388575 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:58:57.388535 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2514d1ca_d78b_4fd8_82c7_9880624aa843.slice/crio-733746ca679524199fa68e997fa599980d1418702a9b4b49bdf0186d93338535 WatchSource:0}: Error finding container 733746ca679524199fa68e997fa599980d1418702a9b4b49bdf0186d93338535: Status 404 returned error can't find the container with id 733746ca679524199fa68e997fa599980d1418702a9b4b49bdf0186d93338535 Jun 04 23:58:57.829884 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:57.829844 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m9tkp" event={"ID":"2514d1ca-d78b-4fd8-82c7-9880624aa843","Type":"ContainerStarted","Data":"19a29dad25261a74bf6b946356721cb91942ae80df1679aae6f1524990d7d7ae"} Jun 04 23:58:57.830038 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:57.829930 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m9tkp" event={"ID":"2514d1ca-d78b-4fd8-82c7-9880624aa843","Type":"ContainerStarted","Data":"733746ca679524199fa68e997fa599980d1418702a9b4b49bdf0186d93338535"} Jun 04 23:58:58.835577 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:58.835542 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m9tkp" event={"ID":"2514d1ca-d78b-4fd8-82c7-9880624aa843","Type":"ContainerStarted","Data":"9230d2a710a2e747108e04a33f22c68bb517d984254d70f2c13ecc6875ad3429"} Jun 04 23:58:59.840705 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:59.840606 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m9tkp" event={"ID":"2514d1ca-d78b-4fd8-82c7-9880624aa843","Type":"ContainerStarted","Data":"1ab15e691c33166e937187861e6ee6b98fc510852dba970efd346cf5b45f2d08"} Jun 04 23:58:59.859880 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:59.859833 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m9tkp" podStartSLOduration=1.8749380759999998 podStartE2EDuration="3.859819326s" totalImagesPullingTime="1.98488125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 23:58:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:58:59.859595914 +0000 UTC m=+278.217164056" watchObservedRunningTime="2026-06-04 23:58:59.859819326 +0000 UTC m=+278.217387467" Jun 04 23:58:59.921612 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:59.921579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-skht7\" (UID: \"6c6c7626-fff6-4318-99f3-90c8474e1c7b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" Jun 04 23:58:59.923927 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:58:59.923902 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c6c7626-fff6-4318-99f3-90c8474e1c7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-skht7\" (UID: \"6c6c7626-fff6-4318-99f3-90c8474e1c7b\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" Jun 04 23:59:00.022392 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:00.022360 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:59:00.022392 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:00.022397 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:59:00.022601 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:00.022458 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-dzcsk\" (UID: \"eaeb0029-3707-45ec-85c1-8b6e5f80b565\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk" Jun 04 23:59:00.023018 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:00.022994 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/475c2176-3c39-4fc5-bf77-2f749e41299b-service-ca-bundle\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:59:00.024946 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:00.024925 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/475c2176-3c39-4fc5-bf77-2f749e41299b-metrics-certs\") pod \"router-default-7b9b7767d7-cbxgf\" (UID: \"475c2176-3c39-4fc5-bf77-2f749e41299b\") " pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:59:00.025038 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:00.024926 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaeb0029-3707-45ec-85c1-8b6e5f80b565-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-dzcsk\" (UID: \"eaeb0029-3707-45ec-85c1-8b6e5f80b565\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk" Jun 04 23:59:00.096947 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:00.096896 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" Jun 04 23:59:00.196215 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:00.196193 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk" Jun 04 23:59:00.203200 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:00.203176 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:59:00.215494 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:00.215470 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7"] Jun 04 23:59:00.216643 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:59:00.216614 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c6c7626_fff6_4318_99f3_90c8474e1c7b.slice/crio-bca6e83440056695b56d773f6aa634eefce7abe56f891f4a1d15f0f44842ed73 WatchSource:0}: Error finding container bca6e83440056695b56d773f6aa634eefce7abe56f891f4a1d15f0f44842ed73: Status 404 returned error can't find the container with id bca6e83440056695b56d773f6aa634eefce7abe56f891f4a1d15f0f44842ed73 Jun 04 23:59:00.327909 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:00.327880 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk"] Jun 04 23:59:00.331041 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:59:00.331019 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaeb0029_3707_45ec_85c1_8b6e5f80b565.slice/crio-40e16811f733e4b5089bfe6ed8d7d9545c13842f5eff5be1da449df029f87dd0 WatchSource:0}: Error finding container 40e16811f733e4b5089bfe6ed8d7d9545c13842f5eff5be1da449df029f87dd0: Status 404 returned error can't find the container with id 40e16811f733e4b5089bfe6ed8d7d9545c13842f5eff5be1da449df029f87dd0 Jun 04 23:59:00.345503 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:00.345444 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b9b7767d7-cbxgf"] Jun 04 23:59:00.347305 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:59:00.347259 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod475c2176_3c39_4fc5_bf77_2f749e41299b.slice/crio-3be662288fa39cd2f1cd87421f1f611ceddfda83bd38ee6ecef2a5a7f70638f4 WatchSource:0}: Error finding container 3be662288fa39cd2f1cd87421f1f611ceddfda83bd38ee6ecef2a5a7f70638f4: Status 404 returned error can't find the container with id 3be662288fa39cd2f1cd87421f1f611ceddfda83bd38ee6ecef2a5a7f70638f4 Jun 04 23:59:00.845666 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:00.845628 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" event={"ID":"6c6c7626-fff6-4318-99f3-90c8474e1c7b","Type":"ContainerStarted","Data":"bca6e83440056695b56d773f6aa634eefce7abe56f891f4a1d15f0f44842ed73"} Jun 04 23:59:00.847361 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:00.847331 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" event={"ID":"475c2176-3c39-4fc5-bf77-2f749e41299b","Type":"ContainerStarted","Data":"3cacf105fe469d5a7f4e5e84808a400632c174dea04ec65ca47a0583b9514a26"} Jun 04 23:59:00.847504 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:00.847376 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" event={"ID":"475c2176-3c39-4fc5-bf77-2f749e41299b","Type":"ContainerStarted","Data":"3be662288fa39cd2f1cd87421f1f611ceddfda83bd38ee6ecef2a5a7f70638f4"} Jun 04 23:59:00.848652 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:00.848626 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk" event={"ID":"eaeb0029-3707-45ec-85c1-8b6e5f80b565","Type":"ContainerStarted","Data":"40e16811f733e4b5089bfe6ed8d7d9545c13842f5eff5be1da449df029f87dd0"} Jun 04 23:59:00.870906 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:00.870860 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" podStartSLOduration=32.87084247 podStartE2EDuration="32.87084247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:58:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:59:00.868658279 +0000 UTC m=+279.226226445" watchObservedRunningTime="2026-06-04 23:59:00.87084247 +0000 UTC m=+279.228410613" Jun 04 23:59:01.204372 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:01.204344 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:59:01.207371 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:01.207347 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:59:01.852542 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:01.852513 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:59:01.854191 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:01.854170 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7b9b7767d7-cbxgf" Jun 04 23:59:02.857290 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:02.857187 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk" event={"ID":"eaeb0029-3707-45ec-85c1-8b6e5f80b565","Type":"ContainerStarted","Data":"3fccf7299b02eb6d25cb86b6470b1dfdeb979c97123e5d60721ed82d7c5b0a6c"} Jun 04 23:59:02.858745 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:02.858714 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" event={"ID":"6c6c7626-fff6-4318-99f3-90c8474e1c7b","Type":"ContainerStarted","Data":"e4320a8baefb8e66c02420d545eb6d9bd33e8d572f2bd17744d88a71790cde54"} Jun 04 23:59:02.875670 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:02.875629 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-dzcsk" podStartSLOduration=32.613667151 podStartE2EDuration="34.875615529s" totalImagesPullingTime="2.261948378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:59:02.874875135 +0000 UTC m=+281.232443278" watchObservedRunningTime="2026-06-04 23:59:02.875615529 +0000 UTC m=+281.233183670" Jun 04 23:59:02.898832 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:02.898776 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-skht7" podStartSLOduration=33.518928056 podStartE2EDuration="35.898758394s" totalImagesPullingTime="2.379830338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:59:02.89809235 +0000 UTC m=+281.255660493" watchObservedRunningTime="2026-06-04 23:59:02.898758394 +0000 UTC m=+281.256326537" Jun 04 23:59:03.123149 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:03.123073 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rp6sx"] Jun 04 23:59:03.125649 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:03.125628 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rp6sx" Jun 04 23:59:03.128318 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:03.128298 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 04 23:59:03.128318 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:03.128309 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pjs77\"" Jun 04 23:59:03.133360 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:03.133338 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rp6sx"] Jun 04 23:59:03.252822 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:03.252796 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9299486b-b531-430e-9560-c8ea8353ebd1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-rp6sx\" (UID: \"9299486b-b531-430e-9560-c8ea8353ebd1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rp6sx" Jun 04 23:59:03.353931 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:03.353904 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9299486b-b531-430e-9560-c8ea8353ebd1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-rp6sx\" (UID: \"9299486b-b531-430e-9560-c8ea8353ebd1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rp6sx" Jun 04 23:59:03.354042 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:59:03.354014 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 04 23:59:03.354084 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:59:03.354074 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9299486b-b531-430e-9560-c8ea8353ebd1-tls-certificates podName:9299486b-b531-430e-9560-c8ea8353ebd1 nodeName:}" failed. No retries permitted until 2026-06-04 23:59:03.854060048 +0000 UTC m=+282.211628167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/9299486b-b531-430e-9560-c8ea8353ebd1-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-rp6sx" (UID: "9299486b-b531-430e-9560-c8ea8353ebd1") : secret "prometheus-operator-admission-webhook-tls" not found Jun 04 23:59:03.515938 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:59:03.515897 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" podUID="61acbd7e-9273-4884-be2c-c4cc24217311" Jun 04 23:59:03.515938 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:59:03.515911 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b4hcm" podUID="4ac9536e-706c-42b2-904f-a6facd64f42c" Jun 04 23:59:03.857657 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:03.857583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9299486b-b531-430e-9560-c8ea8353ebd1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-rp6sx\" (UID: \"9299486b-b531-430e-9560-c8ea8353ebd1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rp6sx" Jun 04 23:59:03.859931 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:03.859909 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9299486b-b531-430e-9560-c8ea8353ebd1-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-rp6sx\" (UID: \"9299486b-b531-430e-9560-c8ea8353ebd1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rp6sx" Jun 04 23:59:03.861665 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:03.861646 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:59:03.861786 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:03.861713 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b4hcm" Jun 04 23:59:04.034788 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:04.034763 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rp6sx" Jun 04 23:59:04.152576 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:04.152552 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rp6sx"] Jun 04 23:59:04.154460 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:59:04.154434 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9299486b_b531_430e_9560_c8ea8353ebd1.slice/crio-65486c6fe12d31b47d4d39a3805b7392af42c0a2d3f3bd023a35f972747542e7 WatchSource:0}: Error finding container 65486c6fe12d31b47d4d39a3805b7392af42c0a2d3f3bd023a35f972747542e7: Status 404 returned error can't find the container with id 65486c6fe12d31b47d4d39a3805b7392af42c0a2d3f3bd023a35f972747542e7 Jun 04 23:59:04.866300 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:04.866269 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rp6sx" event={"ID":"9299486b-b531-430e-9560-c8ea8353ebd1","Type":"ContainerStarted","Data":"65486c6fe12d31b47d4d39a3805b7392af42c0a2d3f3bd023a35f972747542e7"} Jun 04 23:59:05.872389 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:05.872349 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rp6sx" event={"ID":"9299486b-b531-430e-9560-c8ea8353ebd1","Type":"ContainerStarted","Data":"6d9c057c7350061be545567030ea74576aac6f4f88b1ae076e3033f4812ec039"} Jun 04 23:59:05.872796 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:05.872561 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rp6sx" Jun 04 23:59:05.877082 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:05.877061 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rp6sx" Jun 04 23:59:05.887850 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:05.887808 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-rp6sx" podStartSLOduration=1.818821754 podStartE2EDuration="2.88779459s" totalImagesPullingTime="1.068972836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:59:05.886845014 +0000 UTC m=+284.244413156" watchObservedRunningTime="2026-06-04 23:59:05.88779459 +0000 UTC m=+284.245362732" Jun 04 23:59:06.478932 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:06.478899 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:59:06.481285 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:06.481256 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls\") pod \"image-registry-fd78b68c6-6scbt\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:59:06.565043 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:06.565021 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r5892\"" Jun 04 23:59:06.573267 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:06.573249 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:59:06.579330 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:06.579311 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:59:06.581587 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:06.581563 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ac9536e-706c-42b2-904f-a6facd64f42c-metrics-tls\") pod \"dns-default-b4hcm\" (UID: \"4ac9536e-706c-42b2-904f-a6facd64f42c\") " pod="openshift-dns/dns-default-b4hcm" Jun 04 23:59:06.697598 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:06.697576 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fd78b68c6-6scbt"] Jun 04 23:59:06.699950 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:59:06.699930 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61acbd7e_9273_4884_be2c_c4cc24217311.slice/crio-08ffc83c3929a777042cfbafd78a4dcf1c219cabb1de9051197e9ef25cf294da WatchSource:0}: Error finding container 08ffc83c3929a777042cfbafd78a4dcf1c219cabb1de9051197e9ef25cf294da: Status 404 returned error can't find the container with id 08ffc83c3929a777042cfbafd78a4dcf1c219cabb1de9051197e9ef25cf294da Jun 04 23:59:06.865336 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:06.865296 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zgf9w\"" Jun 04 23:59:06.872725 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:06.872685 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b4hcm" Jun 04 23:59:06.877757 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:06.877725 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" event={"ID":"61acbd7e-9273-4884-be2c-c4cc24217311","Type":"ContainerStarted","Data":"e8a3f0060a39bb7e8a946ec1945ecbfe4f70d0c80a1342fcf60dbb1b8d56d0db"} Jun 04 23:59:06.877869 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:06.877801 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" event={"ID":"61acbd7e-9273-4884-be2c-c4cc24217311","Type":"ContainerStarted","Data":"08ffc83c3929a777042cfbafd78a4dcf1c219cabb1de9051197e9ef25cf294da"} Jun 04 23:59:06.897826 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:06.897785 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" podStartSLOduration=284.897768332 podStartE2EDuration="4m44.897768332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:59:06.896493225 +0000 UTC m=+285.254061388" watchObservedRunningTime="2026-06-04 23:59:06.897768332 +0000 UTC m=+285.255336475" Jun 04 23:59:07.008110 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:07.005509 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b4hcm"] Jun 04 23:59:07.008550 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:59:07.008523 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac9536e_706c_42b2_904f_a6facd64f42c.slice/crio-0f87f0203c36a10321835732f3605de7298bfc19ae1a975b81055816a8b4efda WatchSource:0}: Error finding container 0f87f0203c36a10321835732f3605de7298bfc19ae1a975b81055816a8b4efda: Status 404 returned error can't find the container with id 0f87f0203c36a10321835732f3605de7298bfc19ae1a975b81055816a8b4efda Jun 04 23:59:07.883256 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:07.883218 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4hcm" event={"ID":"4ac9536e-706c-42b2-904f-a6facd64f42c","Type":"ContainerStarted","Data":"0f87f0203c36a10321835732f3605de7298bfc19ae1a975b81055816a8b4efda"} Jun 04 23:59:07.883712 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:07.883315 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:59:08.888846 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:08.888808 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4hcm" event={"ID":"4ac9536e-706c-42b2-904f-a6facd64f42c","Type":"ContainerStarted","Data":"c5a4d82588de40fe885207dd2acd2d1de77bbcf04d252ee5d75746db13abcb38"} Jun 04 23:59:09.894569 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:09.894535 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4hcm" event={"ID":"4ac9536e-706c-42b2-904f-a6facd64f42c","Type":"ContainerStarted","Data":"0f080eb5c84972f9fc07c2acf72b6ad9b88cb3944c6c215c5117b4796198a781"} Jun 04 23:59:09.894971 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:09.894634 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b4hcm" Jun 04 23:59:09.913230 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:09.913186 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b4hcm" podStartSLOduration=252.171338606 podStartE2EDuration="4m13.913172076s" totalImagesPullingTime="1.74183347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:54:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:59:09.910901153 +0000 UTC m=+288.268469315" watchObservedRunningTime="2026-06-04 23:59:09.913172076 +0000 UTC m=+288.270740195" Jun 04 23:59:10.519045 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.519008 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq"] Jun 04 23:59:10.522885 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.522867 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" Jun 04 23:59:10.525506 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.525484 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fwqx4\"" Jun 04 23:59:10.526767 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.526745 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 04 23:59:10.526874 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.526806 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 04 23:59:10.526874 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.526745 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 04 23:59:10.529789 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.529767 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw"] Jun 04 23:59:10.532824 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.532803 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.534196 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.534176 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pz6j9"] Jun 04 23:59:10.535510 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.535494 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 04 23:59:10.535591 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.535513 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6zx4j\"" Jun 04 23:59:10.535591 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.535527 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 04 23:59:10.535591 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.535532 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 04 23:59:10.537270 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.537256 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.539907 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.539883 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 04 23:59:10.540262 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.540242 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z57dz\"" Jun 04 23:59:10.540359 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.540291 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 04 23:59:10.540427 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.540377 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 04 23:59:10.541602 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.541581 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq"] Jun 04 23:59:10.546845 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.546825 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw"] Jun 04 23:59:10.612020 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.611991 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-tls\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.612171 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612026 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e5f8872-c519-4d77-99c8-4765dc1faf1e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.612171 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612047 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.612171 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612069 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-accelerators-collector-config\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.612171 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612110 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-metrics-client-ca\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.612171 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612140 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw2dl\" (UniqueName: \"kubernetes.io/projected/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-kube-api-access-fw2dl\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.612171 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612164 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.612381 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612183 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh9rg\" (UniqueName: \"kubernetes.io/projected/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-api-access-kh9rg\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.612381 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612222 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.612381 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612242 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-sys\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.612381 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612257 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-root\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.612381 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612270 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eaefd12f-37cf-44a6-b194-ef08c261ed6a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-rpsvq\" (UID: \"eaefd12f-37cf-44a6-b194-ef08c261ed6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" Jun 04 23:59:10.612381 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612336 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-textfile\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.612381 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612361 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-wtmp\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.612614 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612416 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9e5f8872-c519-4d77-99c8-4765dc1faf1e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.612614 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612449 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eaefd12f-37cf-44a6-b194-ef08c261ed6a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-rpsvq\" (UID: \"eaefd12f-37cf-44a6-b194-ef08c261ed6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" Jun 04 23:59:10.612614 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612482 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eaefd12f-37cf-44a6-b194-ef08c261ed6a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-rpsvq\" (UID: \"eaefd12f-37cf-44a6-b194-ef08c261ed6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" Jun 04 23:59:10.612614 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612500 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrwmd\" (UniqueName: \"kubernetes.io/projected/eaefd12f-37cf-44a6-b194-ef08c261ed6a-kube-api-access-hrwmd\") pod \"openshift-state-metrics-65f78d5c66-rpsvq\" (UID: \"eaefd12f-37cf-44a6-b194-ef08c261ed6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" Jun 04 23:59:10.612614 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.612531 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.713383 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.713354 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-tls\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.713524 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.713389 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e5f8872-c519-4d77-99c8-4765dc1faf1e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.713524 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.713411 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.713524 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.713445 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-accelerators-collector-config\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.713524 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.713474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-metrics-client-ca\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.713524 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:59:10.713491 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 04 23:59:10.713813 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:59:10.713560 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-tls podName:6b05c49b-f15c-475f-8bb1-a2bb43b2794a nodeName:}" failed. No retries permitted until 2026-06-04 23:59:11.213540507 +0000 UTC m=+289.571108632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-tls") pod "node-exporter-pz6j9" (UID: "6b05c49b-f15c-475f-8bb1-a2bb43b2794a") : secret "node-exporter-tls" not found Jun 04 23:59:10.713813 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.713498 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw2dl\" (UniqueName: \"kubernetes.io/projected/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-kube-api-access-fw2dl\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.713813 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:59:10.713582 2564 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 04 23:59:10.713813 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:59:10.713621 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-state-metrics-tls podName:9e5f8872-c519-4d77-99c8-4765dc1faf1e nodeName:}" failed. No retries permitted until 2026-06-04 23:59:11.213608997 +0000 UTC m=+289.571177121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-m6pqw" (UID: "9e5f8872-c519-4d77-99c8-4765dc1faf1e") : secret "kube-state-metrics-tls" not found Jun 04 23:59:10.713813 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.713642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.713813 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.713699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh9rg\" (UniqueName: \"kubernetes.io/projected/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-api-access-kh9rg\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.713813 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.713742 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.713813 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.713776 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-sys\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.714207 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.713839 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-sys\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.714207 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.713873 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-root\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.714207 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.713898 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eaefd12f-37cf-44a6-b194-ef08c261ed6a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-rpsvq\" (UID: \"eaefd12f-37cf-44a6-b194-ef08c261ed6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" Jun 04 23:59:10.714207 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.713961 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-textfile\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.714207 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.713989 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-wtmp\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.714207 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.713991 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-root\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.714207 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.714020 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9e5f8872-c519-4d77-99c8-4765dc1faf1e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.714207 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.714051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eaefd12f-37cf-44a6-b194-ef08c261ed6a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-rpsvq\" (UID: \"eaefd12f-37cf-44a6-b194-ef08c261ed6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" Jun 04 23:59:10.714207 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.714076 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eaefd12f-37cf-44a6-b194-ef08c261ed6a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-rpsvq\" (UID: \"eaefd12f-37cf-44a6-b194-ef08c261ed6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" Jun 04 23:59:10.714207 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.714105 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrwmd\" (UniqueName: \"kubernetes.io/projected/eaefd12f-37cf-44a6-b194-ef08c261ed6a-kube-api-access-hrwmd\") pod \"openshift-state-metrics-65f78d5c66-rpsvq\" (UID: \"eaefd12f-37cf-44a6-b194-ef08c261ed6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" Jun 04 23:59:10.714207 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.714162 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.714207 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.714164 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-accelerators-collector-config\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.714207 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.714181 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-metrics-client-ca\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.714858 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.714257 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-textfile\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.714858 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.714329 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e5f8872-c519-4d77-99c8-4765dc1faf1e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.714858 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.714576 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-wtmp\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.714994 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.714879 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9e5f8872-c519-4d77-99c8-4765dc1faf1e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.714994 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.714890 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eaefd12f-37cf-44a6-b194-ef08c261ed6a-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-rpsvq\" (UID: \"eaefd12f-37cf-44a6-b194-ef08c261ed6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" Jun 04 23:59:10.714994 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.714894 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.716453 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.716434 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.716744 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.716723 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.716797 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.716756 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eaefd12f-37cf-44a6-b194-ef08c261ed6a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-rpsvq\" (UID: \"eaefd12f-37cf-44a6-b194-ef08c261ed6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" Jun 04 23:59:10.716902 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.716886 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eaefd12f-37cf-44a6-b194-ef08c261ed6a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-rpsvq\" (UID: \"eaefd12f-37cf-44a6-b194-ef08c261ed6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" Jun 04 23:59:10.722400 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.722377 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw2dl\" (UniqueName: \"kubernetes.io/projected/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-kube-api-access-fw2dl\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:10.722723 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.722656 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh9rg\" (UniqueName: \"kubernetes.io/projected/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-api-access-kh9rg\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:10.722847 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.722832 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrwmd\" (UniqueName: \"kubernetes.io/projected/eaefd12f-37cf-44a6-b194-ef08c261ed6a-kube-api-access-hrwmd\") pod \"openshift-state-metrics-65f78d5c66-rpsvq\" (UID: \"eaefd12f-37cf-44a6-b194-ef08c261ed6a\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" Jun 04 23:59:10.832558 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.832493 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" Jun 04 23:59:10.957925 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:10.957865 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq"] Jun 04 23:59:11.218618 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:11.218583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:11.218808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:11.218716 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-tls\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:11.218808 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:59:11.218757 2564 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 04 23:59:11.218897 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:59:11.218823 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-state-metrics-tls podName:9e5f8872-c519-4d77-99c8-4765dc1faf1e nodeName:}" failed. No retries permitted until 2026-06-04 23:59:12.218807594 +0000 UTC m=+290.576375714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-m6pqw" (UID: "9e5f8872-c519-4d77-99c8-4765dc1faf1e") : secret "kube-state-metrics-tls" not found Jun 04 23:59:11.220894 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:11.220878 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6b05c49b-f15c-475f-8bb1-a2bb43b2794a-node-exporter-tls\") pod \"node-exporter-pz6j9\" (UID: \"6b05c49b-f15c-475f-8bb1-a2bb43b2794a\") " pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:11.448364 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:11.448336 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pz6j9" Jun 04 23:59:11.458795 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:59:11.458768 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b05c49b_f15c_475f_8bb1_a2bb43b2794a.slice/crio-a45958d566a3a8fff56dedf9326d62b3e70342d30e45be297d94bbae67c2b8be WatchSource:0}: Error finding container a45958d566a3a8fff56dedf9326d62b3e70342d30e45be297d94bbae67c2b8be: Status 404 returned error can't find the container with id a45958d566a3a8fff56dedf9326d62b3e70342d30e45be297d94bbae67c2b8be Jun 04 23:59:11.905199 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:11.905166 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" event={"ID":"eaefd12f-37cf-44a6-b194-ef08c261ed6a","Type":"ContainerStarted","Data":"dd2098cae3bac8105c6d372e4d19da55f510a1e6ce238dcd33a3a795d34903b0"} Jun 04 23:59:11.905370 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:11.905237 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" event={"ID":"eaefd12f-37cf-44a6-b194-ef08c261ed6a","Type":"ContainerStarted","Data":"8d95c6163a1dfea35e5b8d7645c4151b946ab94a3a4534fa8a1c4136ddb197f6"} Jun 04 23:59:11.905370 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:11.905267 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" event={"ID":"eaefd12f-37cf-44a6-b194-ef08c261ed6a","Type":"ContainerStarted","Data":"259e31751926c85eb22928d7f6ac4647de654fa9d9b51b6165c9f860b52eb07b"} Jun 04 23:59:11.906493 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:11.906462 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pz6j9" event={"ID":"6b05c49b-f15c-475f-8bb1-a2bb43b2794a","Type":"ContainerStarted","Data":"a45958d566a3a8fff56dedf9326d62b3e70342d30e45be297d94bbae67c2b8be"} Jun 04 23:59:12.151366 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.151339 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-5nvz9"] Jun 04 23:59:12.154598 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.154576 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-5nvz9" Jun 04 23:59:12.157588 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.157335 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 04 23:59:12.157588 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.157411 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-w7grm\"" Jun 04 23:59:12.157780 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.157607 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 04 23:59:12.164208 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.164182 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-5nvz9"] Jun 04 23:59:12.229198 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.229000 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:12.229198 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.229101 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59bmz\" (UniqueName: \"kubernetes.io/projected/a8e5b2f9-e25a-4877-b2fc-f0f75fa9e67b-kube-api-access-59bmz\") pod \"downloads-6657875f97-5nvz9\" (UID: \"a8e5b2f9-e25a-4877-b2fc-f0f75fa9e67b\") " pod="openshift-console/downloads-6657875f97-5nvz9" Jun 04 23:59:12.231894 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.231870 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e5f8872-c519-4d77-99c8-4765dc1faf1e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-m6pqw\" (UID: \"9e5f8872-c519-4d77-99c8-4765dc1faf1e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:12.329838 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.329800 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59bmz\" (UniqueName: \"kubernetes.io/projected/a8e5b2f9-e25a-4877-b2fc-f0f75fa9e67b-kube-api-access-59bmz\") pod \"downloads-6657875f97-5nvz9\" (UID: \"a8e5b2f9-e25a-4877-b2fc-f0f75fa9e67b\") " pod="openshift-console/downloads-6657875f97-5nvz9" Jun 04 23:59:12.337594 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.337568 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59bmz\" (UniqueName: \"kubernetes.io/projected/a8e5b2f9-e25a-4877-b2fc-f0f75fa9e67b-kube-api-access-59bmz\") pod \"downloads-6657875f97-5nvz9\" (UID: \"a8e5b2f9-e25a-4877-b2fc-f0f75fa9e67b\") " pod="openshift-console/downloads-6657875f97-5nvz9" Jun 04 23:59:12.341362 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.341340 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" Jun 04 23:59:12.466466 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.466371 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-5nvz9" Jun 04 23:59:12.678556 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.678530 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw"] Jun 04 23:59:12.682634 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:59:12.682611 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e5f8872_c519_4d77_99c8_4765dc1faf1e.slice/crio-16b80f86184f3d0210f54df5be7af19378b3d9304d062c6ec224bcfc42cd2f15 WatchSource:0}: Error finding container 16b80f86184f3d0210f54df5be7af19378b3d9304d062c6ec224bcfc42cd2f15: Status 404 returned error can't find the container with id 16b80f86184f3d0210f54df5be7af19378b3d9304d062c6ec224bcfc42cd2f15 Jun 04 23:59:12.690922 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.690879 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-5nvz9"] Jun 04 23:59:12.693576 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:59:12.693549 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e5b2f9_e25a_4877_b2fc_f0f75fa9e67b.slice/crio-77e90a34f4143cbf022877fbc637c1a9bc2ea815a8fa3044b79129d00698d23e WatchSource:0}: Error finding container 77e90a34f4143cbf022877fbc637c1a9bc2ea815a8fa3044b79129d00698d23e: Status 404 returned error can't find the container with id 77e90a34f4143cbf022877fbc637c1a9bc2ea815a8fa3044b79129d00698d23e Jun 04 23:59:12.912068 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.912031 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" event={"ID":"eaefd12f-37cf-44a6-b194-ef08c261ed6a","Type":"ContainerStarted","Data":"bdf0164f511ff0354d8b62b7cc8dc187b72b15e8d4d6294e79ed3f8aad1e0603"} Jun 04 23:59:12.913363 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.913337 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" event={"ID":"9e5f8872-c519-4d77-99c8-4765dc1faf1e","Type":"ContainerStarted","Data":"16b80f86184f3d0210f54df5be7af19378b3d9304d062c6ec224bcfc42cd2f15"} Jun 04 23:59:12.914473 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.914446 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-5nvz9" event={"ID":"a8e5b2f9-e25a-4877-b2fc-f0f75fa9e67b","Type":"ContainerStarted","Data":"77e90a34f4143cbf022877fbc637c1a9bc2ea815a8fa3044b79129d00698d23e"} Jun 04 23:59:12.916023 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.915995 2564 generic.go:356] "Generic (PLEG): container finished" podID="6b05c49b-f15c-475f-8bb1-a2bb43b2794a" containerID="fec007e49c76c4ec313db5b6a2ea9c91f46b3891207ec11f9ccec831d80112eb" exitCode=0 Jun 04 23:59:12.916023 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.916026 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pz6j9" event={"ID":"6b05c49b-f15c-475f-8bb1-a2bb43b2794a","Type":"ContainerDied","Data":"fec007e49c76c4ec313db5b6a2ea9c91f46b3891207ec11f9ccec831d80112eb"} Jun 04 23:59:12.928808 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:12.928770 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rpsvq" podStartSLOduration=1.961180726 podStartE2EDuration="2.9287575s" totalImagesPullingTime="967.576774ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:59:12.928240196 +0000 UTC m=+291.285808363" watchObservedRunningTime="2026-06-04 23:59:12.9287575 +0000 UTC m=+291.286325641" Jun 04 23:59:13.930780 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:13.930737 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pz6j9" event={"ID":"6b05c49b-f15c-475f-8bb1-a2bb43b2794a","Type":"ContainerStarted","Data":"053861eda7b727296e2fdac1bc53673bcf92b6b8630e97bb772f5f7d05970e70"} Jun 04 23:59:13.931238 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:13.930844 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pz6j9" event={"ID":"6b05c49b-f15c-475f-8bb1-a2bb43b2794a","Type":"ContainerStarted","Data":"d328cbc9eab02f8e28f1363ebf7768cede144268c920504bd3812d045fabf72f"} Jun 04 23:59:13.952986 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:13.952920 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pz6j9" podStartSLOduration=2.763429058 podStartE2EDuration="3.952900228s" totalImagesPullingTime="1.121567603s" totalInitContainerRuntime="67.903567ms" isStatefulPod=true podCreationTimestamp="2026-06-04 23:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:59:13.952810057 +0000 UTC m=+292.310378201" watchObservedRunningTime="2026-06-04 23:59:13.952900228 +0000 UTC m=+292.310468371" Jun 04 23:59:14.508351 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.508270 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7d987d574-kcz9m"] Jun 04 23:59:14.512380 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.512347 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.516344 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.516101 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 04 23:59:14.516344 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.516126 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 04 23:59:14.516344 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.516213 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 04 23:59:14.516344 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.516279 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 04 23:59:14.517024 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.516900 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8f9hq\"" Jun 04 23:59:14.517024 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.516936 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 04 23:59:14.517024 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.517003 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9t9cgiap2u2t9\"" Jun 04 23:59:14.522254 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.522229 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d987d574-kcz9m"] Jun 04 23:59:14.652727 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.652684 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-grpc-tls\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.652903 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.652784 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35ff4ea3-387b-4387-83a1-67485e9e2273-metrics-client-ca\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.652903 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.652835 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-thanos-querier-tls\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.652903 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.652869 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjps4\" (UniqueName: \"kubernetes.io/projected/35ff4ea3-387b-4387-83a1-67485e9e2273-kube-api-access-jjps4\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.653033 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.652915 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.653033 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.652942 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.653114 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.653034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.653161 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.653140 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.753696 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.753653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-thanos-querier-tls\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.753879 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.753710 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjps4\" (UniqueName: \"kubernetes.io/projected/35ff4ea3-387b-4387-83a1-67485e9e2273-kube-api-access-jjps4\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.753879 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.753742 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.753879 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.753768 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.753879 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.753802 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.753879 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.753861 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.754131 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.753887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-grpc-tls\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.754131 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.753941 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35ff4ea3-387b-4387-83a1-67485e9e2273-metrics-client-ca\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.754723 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.754697 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35ff4ea3-387b-4387-83a1-67485e9e2273-metrics-client-ca\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.757815 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.757038 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.757815 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.757284 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-thanos-querier-tls\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.757815 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.757459 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-grpc-tls\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.757815 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.757702 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.758062 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.757905 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.758489 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.758442 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/35ff4ea3-387b-4387-83a1-67485e9e2273-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.762056 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.762033 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjps4\" (UniqueName: \"kubernetes.io/projected/35ff4ea3-387b-4387-83a1-67485e9e2273-kube-api-access-jjps4\") pod \"thanos-querier-7d987d574-kcz9m\" (UID: \"35ff4ea3-387b-4387-83a1-67485e9e2273\") " pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.824794 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.824761 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:14.939849 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.939816 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" event={"ID":"9e5f8872-c519-4d77-99c8-4765dc1faf1e","Type":"ContainerStarted","Data":"a7d418f7cbf9f3f8d1910f9744da656e6b3cf1a9ef9f3160c61afea1b8090309"} Jun 04 23:59:14.940308 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.939881 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" event={"ID":"9e5f8872-c519-4d77-99c8-4765dc1faf1e","Type":"ContainerStarted","Data":"5f79ddbb3f922d8dc5d5e3e17040ad8bddefa297f2e66ef5c05c8e436658c79a"} Jun 04 23:59:14.940308 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.939909 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" event={"ID":"9e5f8872-c519-4d77-99c8-4765dc1faf1e","Type":"ContainerStarted","Data":"5041e43ff1128fc877f774ddd76aa8b5af7bd2d872d45860dd8b530e4b762cfb"} Jun 04 23:59:14.961171 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.961124 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-m6pqw" podStartSLOduration=3.533529128 podStartE2EDuration="4.961107441s" totalImagesPullingTime="1.427578313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:59:14.958798742 +0000 UTC m=+293.316366887" watchObservedRunningTime="2026-06-04 23:59:14.961107441 +0000 UTC m=+293.318675583" Jun 04 23:59:14.994232 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:14.994207 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d987d574-kcz9m"] Jun 04 23:59:14.996752 ip-10-0-140-8 kubenswrapper[2564]: W0604 23:59:14.996724 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35ff4ea3_387b_4387_83a1_67485e9e2273.slice/crio-2bd908084ccc5bbf43355b6d9e1af65f4f71ee20aa0b0b7dbff6d36b35697737 WatchSource:0}: Error finding container 2bd908084ccc5bbf43355b6d9e1af65f4f71ee20aa0b0b7dbff6d36b35697737: Status 404 returned error can't find the container with id 2bd908084ccc5bbf43355b6d9e1af65f4f71ee20aa0b0b7dbff6d36b35697737 Jun 04 23:59:15.032045 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:59:15.031978 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kf8nr" podUID="04667814-8f0e-4653-a2a1-0b2fd6431e61" Jun 04 23:59:15.947434 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:15.947317 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" event={"ID":"35ff4ea3-387b-4387-83a1-67485e9e2273","Type":"ContainerStarted","Data":"2bd908084ccc5bbf43355b6d9e1af65f4f71ee20aa0b0b7dbff6d36b35697737"} Jun 04 23:59:17.959634 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:17.959594 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" event={"ID":"35ff4ea3-387b-4387-83a1-67485e9e2273","Type":"ContainerStarted","Data":"7a275bae1027eddd3fc71c60de2b0ea7b05a12ecdbb345c3e769976f7f103b7a"} Jun 04 23:59:17.960013 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:17.959705 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" event={"ID":"35ff4ea3-387b-4387-83a1-67485e9e2273","Type":"ContainerStarted","Data":"fae2df7dc9c4f21c999d3232d003b91f9b86b24af169693ecf9551a3f0cc1e45"} Jun 04 23:59:17.960013 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:17.959748 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" event={"ID":"35ff4ea3-387b-4387-83a1-67485e9e2273","Type":"ContainerStarted","Data":"551fb9c3844a7de4c1fe45be1e8126a42499eed841112b9a6edcfb0ec94890d6"} Jun 04 23:59:17.960013 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:17.959787 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" event={"ID":"35ff4ea3-387b-4387-83a1-67485e9e2273","Type":"ContainerStarted","Data":"19b9d68e2f4b754ba5a7ed19dc1fbe8e697dcdf2224bd8f1bad0bc21d23c08e3"} Jun 04 23:59:18.967546 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:18.967509 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" event={"ID":"35ff4ea3-387b-4387-83a1-67485e9e2273","Type":"ContainerStarted","Data":"fd0a662ef214d2522e025d8416bc721b82dd5bda7efb99a6bf7a805487a5bc6c"} Jun 04 23:59:18.967992 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:18.967589 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" event={"ID":"35ff4ea3-387b-4387-83a1-67485e9e2273","Type":"ContainerStarted","Data":"4e62318417f42937e65d370dcbcc73bb6bef83a2b685946c7948d4c97a58d57b"} Jun 04 23:59:18.967992 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:18.967688 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:18.995353 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:18.995309 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" podStartSLOduration=2.370661257 podStartE2EDuration="4.99529571s" totalImagesPullingTime="2.624634453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:59:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:59:18.993612295 +0000 UTC m=+297.351180478" watchObservedRunningTime="2026-06-04 23:59:18.99529571 +0000 UTC m=+297.352863851" Jun 04 23:59:19.901181 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:19.901147 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b4hcm" Jun 04 23:59:21.993478 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:21.993452 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/ovn-acl-logging/0.log" Jun 04 23:59:21.994077 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:21.993528 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/ovn-acl-logging/0.log" Jun 04 23:59:22.001642 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:22.001625 2564 kubelet.go:1648] "Image garbage collection succeeded" Jun 04 23:59:24.979857 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:24.979822 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7d987d574-kcz9m" Jun 04 23:59:26.029797 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:26.029763 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 04 23:59:26.579530 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:26.579488 2564 patch_prober.go:28] interesting pod/image-registry-fd78b68c6-6scbt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 04 23:59:26.579734 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:26.579553 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" podUID="61acbd7e-9273-4884-be2c-c4cc24217311" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 04 23:59:28.725762 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:28.725727 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fd78b68c6-6scbt"] Jun 04 23:59:28.731296 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:28.731271 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:59:30.019251 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:30.019214 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-5nvz9" event={"ID":"a8e5b2f9-e25a-4877-b2fc-f0f75fa9e67b","Type":"ContainerStarted","Data":"f5e360c20839a4c54a4001097de9784fd7ae73d6cd0821dff4bd3a8fc6c8b34e"} Jun 04 23:59:30.019739 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:30.019416 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-5nvz9" Jun 04 23:59:30.038731 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:30.038703 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-5nvz9" Jun 04 23:59:30.040101 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:30.040059 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-5nvz9" podStartSLOduration=1.682604223 podStartE2EDuration="18.040044269s" totalImagesPullingTime="16.357440046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 23:59:30.037836384 +0000 UTC m=+308.395404529" watchObservedRunningTime="2026-06-04 23:59:30.040044269 +0000 UTC m=+308.397612410" Jun 04 23:59:52.109970 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:52.109888 2564 generic.go:356] "Generic (PLEG): container finished" podID="68e34b59-7676-4501-a84c-40cb8b9ec3bc" containerID="08409b106e698ed3c3e68bdc67b731b4caa7ef2b135edcecbfb159357935b93a" exitCode=0 Jun 04 23:59:52.109970 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:52.109942 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-dvmmp" event={"ID":"68e34b59-7676-4501-a84c-40cb8b9ec3bc","Type":"ContainerDied","Data":"08409b106e698ed3c3e68bdc67b731b4caa7ef2b135edcecbfb159357935b93a"} Jun 04 23:59:52.110363 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:52.110233 2564 scope.go:117] "RemoveContainer" containerID="08409b106e698ed3c3e68bdc67b731b4caa7ef2b135edcecbfb159357935b93a" Jun 04 23:59:53.115259 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:53.115227 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-dvmmp" event={"ID":"68e34b59-7676-4501-a84c-40cb8b9ec3bc","Type":"ContainerStarted","Data":"cbf31d1ef65d4570f9c0be2ec2c0304375f1c3abb2fa880d8865956b8a8465eb"} Jun 04 23:59:53.116718 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:53.116692 2564 generic.go:356] "Generic (PLEG): container finished" podID="4d762fb3-d7c5-49e9-b799-f94c3f0e7807" containerID="e0c3823227c7aa76b47011770dfc8473536b18168ceb1dd275ba1b50e48c1223" exitCode=0 Jun 04 23:59:53.116718 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:53.116700 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv" event={"ID":"4d762fb3-d7c5-49e9-b799-f94c3f0e7807","Type":"ContainerDied","Data":"e0c3823227c7aa76b47011770dfc8473536b18168ceb1dd275ba1b50e48c1223"} Jun 04 23:59:53.116973 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:53.116962 2564 scope.go:117] "RemoveContainer" containerID="e0c3823227c7aa76b47011770dfc8473536b18168ceb1dd275ba1b50e48c1223" Jun 04 23:59:53.748952 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:53.748906 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" podUID="61acbd7e-9273-4884-be2c-c4cc24217311" containerName="registry" containerID="cri-o://e8a3f0060a39bb7e8a946ec1945ecbfe4f70d0c80a1342fcf60dbb1b8d56d0db" gracePeriod=30 Jun 04 23:59:54.030389 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.030313 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:59:54.112169 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.112141 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61acbd7e-9273-4884-be2c-c4cc24217311-trusted-ca\") pod \"61acbd7e-9273-4884-be2c-c4cc24217311\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " Jun 04 23:59:54.112334 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.112180 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61acbd7e-9273-4884-be2c-c4cc24217311-registry-certificates\") pod \"61acbd7e-9273-4884-be2c-c4cc24217311\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " Jun 04 23:59:54.112334 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.112244 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61acbd7e-9273-4884-be2c-c4cc24217311-ca-trust-extracted\") pod \"61acbd7e-9273-4884-be2c-c4cc24217311\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " Jun 04 23:59:54.112334 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.112293 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61acbd7e-9273-4884-be2c-c4cc24217311-image-registry-private-configuration\") pod \"61acbd7e-9273-4884-be2c-c4cc24217311\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " Jun 04 23:59:54.112334 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.112320 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvd74\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-kube-api-access-bvd74\") pod \"61acbd7e-9273-4884-be2c-c4cc24217311\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " Jun 04 23:59:54.112552 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.112364 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-bound-sa-token\") pod \"61acbd7e-9273-4884-be2c-c4cc24217311\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " Jun 04 23:59:54.112552 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.112400 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61acbd7e-9273-4884-be2c-c4cc24217311-installation-pull-secrets\") pod \"61acbd7e-9273-4884-be2c-c4cc24217311\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " Jun 04 23:59:54.112552 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.112433 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls\") pod \"61acbd7e-9273-4884-be2c-c4cc24217311\" (UID: \"61acbd7e-9273-4884-be2c-c4cc24217311\") " Jun 04 23:59:54.112552 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.112526 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61acbd7e-9273-4884-be2c-c4cc24217311-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "61acbd7e-9273-4884-be2c-c4cc24217311" (UID: "61acbd7e-9273-4884-be2c-c4cc24217311"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 04 23:59:54.112774 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.112574 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61acbd7e-9273-4884-be2c-c4cc24217311-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "61acbd7e-9273-4884-be2c-c4cc24217311" (UID: "61acbd7e-9273-4884-be2c-c4cc24217311"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 04 23:59:54.112774 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.112750 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61acbd7e-9273-4884-be2c-c4cc24217311-trusted-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 04 23:59:54.112774 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.112770 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61acbd7e-9273-4884-be2c-c4cc24217311-registry-certificates\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 04 23:59:54.115220 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.115188 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "61acbd7e-9273-4884-be2c-c4cc24217311" (UID: "61acbd7e-9273-4884-be2c-c4cc24217311"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 04 23:59:54.115330 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.115226 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61acbd7e-9273-4884-be2c-c4cc24217311-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "61acbd7e-9273-4884-be2c-c4cc24217311" (UID: "61acbd7e-9273-4884-be2c-c4cc24217311"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 04 23:59:54.115330 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.115298 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "61acbd7e-9273-4884-be2c-c4cc24217311" (UID: "61acbd7e-9273-4884-be2c-c4cc24217311"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 04 23:59:54.115330 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.115315 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61acbd7e-9273-4884-be2c-c4cc24217311-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "61acbd7e-9273-4884-be2c-c4cc24217311" (UID: "61acbd7e-9273-4884-be2c-c4cc24217311"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 04 23:59:54.115656 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.115319 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-kube-api-access-bvd74" (OuterVolumeSpecName: "kube-api-access-bvd74") pod "61acbd7e-9273-4884-be2c-c4cc24217311" (UID: "61acbd7e-9273-4884-be2c-c4cc24217311"). InnerVolumeSpecName "kube-api-access-bvd74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 04 23:59:54.121405 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.121383 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61acbd7e-9273-4884-be2c-c4cc24217311-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "61acbd7e-9273-4884-be2c-c4cc24217311" (UID: "61acbd7e-9273-4884-be2c-c4cc24217311"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 04 23:59:54.123034 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.123013 2564 generic.go:356] "Generic (PLEG): container finished" podID="61acbd7e-9273-4884-be2c-c4cc24217311" containerID="e8a3f0060a39bb7e8a946ec1945ecbfe4f70d0c80a1342fcf60dbb1b8d56d0db" exitCode=0 Jun 04 23:59:54.123116 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.123052 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" Jun 04 23:59:54.123116 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.123092 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" event={"ID":"61acbd7e-9273-4884-be2c-c4cc24217311","Type":"ContainerDied","Data":"e8a3f0060a39bb7e8a946ec1945ecbfe4f70d0c80a1342fcf60dbb1b8d56d0db"} Jun 04 23:59:54.123200 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.123145 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fd78b68c6-6scbt" event={"ID":"61acbd7e-9273-4884-be2c-c4cc24217311","Type":"ContainerDied","Data":"08ffc83c3929a777042cfbafd78a4dcf1c219cabb1de9051197e9ef25cf294da"} Jun 04 23:59:54.123200 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.123174 2564 scope.go:117] "RemoveContainer" containerID="e8a3f0060a39bb7e8a946ec1945ecbfe4f70d0c80a1342fcf60dbb1b8d56d0db" Jun 04 23:59:54.125126 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.125108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zbfhv" event={"ID":"4d762fb3-d7c5-49e9-b799-f94c3f0e7807","Type":"ContainerStarted","Data":"2663dbfe5598b68ac9ab457cba08374847a9cf7d7652af32914b9bec7a5215d5"} Jun 04 23:59:54.131949 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.131934 2564 scope.go:117] "RemoveContainer" containerID="e8a3f0060a39bb7e8a946ec1945ecbfe4f70d0c80a1342fcf60dbb1b8d56d0db" Jun 04 23:59:54.132195 ip-10-0-140-8 kubenswrapper[2564]: E0604 23:59:54.132177 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8a3f0060a39bb7e8a946ec1945ecbfe4f70d0c80a1342fcf60dbb1b8d56d0db\": container with ID starting with e8a3f0060a39bb7e8a946ec1945ecbfe4f70d0c80a1342fcf60dbb1b8d56d0db not found: ID does not exist" containerID="e8a3f0060a39bb7e8a946ec1945ecbfe4f70d0c80a1342fcf60dbb1b8d56d0db" Jun 04 23:59:54.132261 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.132202 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a3f0060a39bb7e8a946ec1945ecbfe4f70d0c80a1342fcf60dbb1b8d56d0db"} err="failed to get container status \"e8a3f0060a39bb7e8a946ec1945ecbfe4f70d0c80a1342fcf60dbb1b8d56d0db\": rpc error: code = NotFound desc = could not find container \"e8a3f0060a39bb7e8a946ec1945ecbfe4f70d0c80a1342fcf60dbb1b8d56d0db\": container with ID starting with e8a3f0060a39bb7e8a946ec1945ecbfe4f70d0c80a1342fcf60dbb1b8d56d0db not found: ID does not exist" Jun 04 23:59:54.160153 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.160130 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fd78b68c6-6scbt"] Jun 04 23:59:54.164774 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.164752 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-fd78b68c6-6scbt"] Jun 04 23:59:54.214120 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.214094 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61acbd7e-9273-4884-be2c-c4cc24217311-installation-pull-secrets\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 04 23:59:54.214120 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.214118 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-registry-tls\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 04 23:59:54.214279 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.214134 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61acbd7e-9273-4884-be2c-c4cc24217311-ca-trust-extracted\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 04 23:59:54.214279 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.214146 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61acbd7e-9273-4884-be2c-c4cc24217311-image-registry-private-configuration\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 04 23:59:54.214279 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.214159 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvd74\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-kube-api-access-bvd74\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 04 23:59:54.214279 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:54.214172 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61acbd7e-9273-4884-be2c-c4cc24217311-bound-sa-token\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 04 23:59:56.035066 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:56.035033 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61acbd7e-9273-4884-be2c-c4cc24217311" path="/var/lib/kubelet/pods/61acbd7e-9273-4884-be2c-c4cc24217311/volumes" Jun 04 23:59:57.138738 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:57.138691 2564 generic.go:356] "Generic (PLEG): container finished" podID="1b5cffb4-be62-4d5f-8a90-2e564a67de1d" containerID="4228e099c970e642d5c17095cc1ce72a55f3df8bcca0565f92cf568be3297649" exitCode=0 Jun 04 23:59:57.138738 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:57.138706 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76" event={"ID":"1b5cffb4-be62-4d5f-8a90-2e564a67de1d","Type":"ContainerDied","Data":"4228e099c970e642d5c17095cc1ce72a55f3df8bcca0565f92cf568be3297649"} Jun 04 23:59:57.139095 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:57.138976 2564 scope.go:117] "RemoveContainer" containerID="4228e099c970e642d5c17095cc1ce72a55f3df8bcca0565f92cf568be3297649" Jun 04 23:59:58.144915 ip-10-0-140-8 kubenswrapper[2564]: I0604 23:59:58.144877 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-z5m76" event={"ID":"1b5cffb4-be62-4d5f-8a90-2e564a67de1d","Type":"ContainerStarted","Data":"f1731f9f23b76d8c75cc3c8e6a675a7b26cc996756aa5309d66dcd5acb0f2014"} Jun 05 00:00:00.146138 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:00.146101 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-pruner-29676960-s64j6"] Jun 05 00:00:00.146620 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:00.146540 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61acbd7e-9273-4884-be2c-c4cc24217311" containerName="registry" Jun 05 00:00:00.146620 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:00.146557 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="61acbd7e-9273-4884-be2c-c4cc24217311" containerName="registry" Jun 05 00:00:00.146783 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:00.146659 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="61acbd7e-9273-4884-be2c-c4cc24217311" containerName="registry" Jun 05 00:00:00.170805 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:00.170771 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29676960-s64j6"] Jun 05 00:00:00.170945 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:00.170878 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29676960-s64j6" Jun 05 00:00:00.174055 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:00.174027 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"serviceca\"" Jun 05 00:00:00.174194 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:00.174177 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-pwp4x\"" Jun 05 00:00:00.264767 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:00.264734 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxrsj\" (UniqueName: \"kubernetes.io/projected/f164c790-cbdf-42be-9a75-fcb2d5c349ea-kube-api-access-mxrsj\") pod \"image-pruner-29676960-s64j6\" (UID: \"f164c790-cbdf-42be-9a75-fcb2d5c349ea\") " pod="openshift-image-registry/image-pruner-29676960-s64j6" Jun 05 00:00:00.264923 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:00.264794 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f164c790-cbdf-42be-9a75-fcb2d5c349ea-serviceca\") pod \"image-pruner-29676960-s64j6\" (UID: \"f164c790-cbdf-42be-9a75-fcb2d5c349ea\") " pod="openshift-image-registry/image-pruner-29676960-s64j6" Jun 05 00:00:00.366228 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:00.366199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f164c790-cbdf-42be-9a75-fcb2d5c349ea-serviceca\") pod \"image-pruner-29676960-s64j6\" (UID: \"f164c790-cbdf-42be-9a75-fcb2d5c349ea\") " pod="openshift-image-registry/image-pruner-29676960-s64j6" Jun 05 00:00:00.366357 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:00.366309 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxrsj\" (UniqueName: \"kubernetes.io/projected/f164c790-cbdf-42be-9a75-fcb2d5c349ea-kube-api-access-mxrsj\") pod \"image-pruner-29676960-s64j6\" (UID: \"f164c790-cbdf-42be-9a75-fcb2d5c349ea\") " pod="openshift-image-registry/image-pruner-29676960-s64j6" Jun 05 00:00:00.366908 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:00.366889 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f164c790-cbdf-42be-9a75-fcb2d5c349ea-serviceca\") pod \"image-pruner-29676960-s64j6\" (UID: \"f164c790-cbdf-42be-9a75-fcb2d5c349ea\") " pod="openshift-image-registry/image-pruner-29676960-s64j6" Jun 05 00:00:00.375411 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:00.375388 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxrsj\" (UniqueName: \"kubernetes.io/projected/f164c790-cbdf-42be-9a75-fcb2d5c349ea-kube-api-access-mxrsj\") pod \"image-pruner-29676960-s64j6\" (UID: \"f164c790-cbdf-42be-9a75-fcb2d5c349ea\") " pod="openshift-image-registry/image-pruner-29676960-s64j6" Jun 05 00:00:00.499188 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:00.499107 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29676960-s64j6" Jun 05 00:00:00.642958 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:00.642935 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29676960-s64j6"] Jun 05 00:00:00.645063 ip-10-0-140-8 kubenswrapper[2564]: W0605 00:00:00.645033 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf164c790_cbdf_42be_9a75_fcb2d5c349ea.slice/crio-db305b05f47d1e4334c3bcadef58065871f62b0fad3ea38f43f78c2fb2edfbb5 WatchSource:0}: Error finding container db305b05f47d1e4334c3bcadef58065871f62b0fad3ea38f43f78c2fb2edfbb5: Status 404 returned error can't find the container with id db305b05f47d1e4334c3bcadef58065871f62b0fad3ea38f43f78c2fb2edfbb5 Jun 05 00:00:01.157416 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:01.157380 2564 generic.go:356] "Generic (PLEG): container finished" podID="f164c790-cbdf-42be-9a75-fcb2d5c349ea" containerID="bc292681a797dee3ede7c2a94016dadb66c34dd6c77162a048215c07265664a4" exitCode=0 Jun 05 00:00:01.157826 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:01.157426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29676960-s64j6" event={"ID":"f164c790-cbdf-42be-9a75-fcb2d5c349ea","Type":"ContainerDied","Data":"bc292681a797dee3ede7c2a94016dadb66c34dd6c77162a048215c07265664a4"} Jun 05 00:00:01.157826 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:01.157487 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29676960-s64j6" event={"ID":"f164c790-cbdf-42be-9a75-fcb2d5c349ea","Type":"ContainerStarted","Data":"db305b05f47d1e4334c3bcadef58065871f62b0fad3ea38f43f78c2fb2edfbb5"} Jun 05 00:00:02.309505 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:02.309476 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29676960-s64j6" Jun 05 00:00:02.485221 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:02.485142 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f164c790-cbdf-42be-9a75-fcb2d5c349ea-serviceca\") pod \"f164c790-cbdf-42be-9a75-fcb2d5c349ea\" (UID: \"f164c790-cbdf-42be-9a75-fcb2d5c349ea\") " Jun 05 00:00:02.485221 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:02.485216 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxrsj\" (UniqueName: \"kubernetes.io/projected/f164c790-cbdf-42be-9a75-fcb2d5c349ea-kube-api-access-mxrsj\") pod \"f164c790-cbdf-42be-9a75-fcb2d5c349ea\" (UID: \"f164c790-cbdf-42be-9a75-fcb2d5c349ea\") " Jun 05 00:00:02.485512 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:02.485490 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f164c790-cbdf-42be-9a75-fcb2d5c349ea-serviceca" (OuterVolumeSpecName: "serviceca") pod "f164c790-cbdf-42be-9a75-fcb2d5c349ea" (UID: "f164c790-cbdf-42be-9a75-fcb2d5c349ea"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 00:00:02.487235 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:02.487204 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f164c790-cbdf-42be-9a75-fcb2d5c349ea-kube-api-access-mxrsj" (OuterVolumeSpecName: "kube-api-access-mxrsj") pod "f164c790-cbdf-42be-9a75-fcb2d5c349ea" (UID: "f164c790-cbdf-42be-9a75-fcb2d5c349ea"). InnerVolumeSpecName "kube-api-access-mxrsj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 00:00:02.586470 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:02.586435 2564 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f164c790-cbdf-42be-9a75-fcb2d5c349ea-serviceca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 05 00:00:02.586470 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:02.586464 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxrsj\" (UniqueName: \"kubernetes.io/projected/f164c790-cbdf-42be-9a75-fcb2d5c349ea-kube-api-access-mxrsj\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 05 00:00:03.168207 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:03.168173 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29676960-s64j6" event={"ID":"f164c790-cbdf-42be-9a75-fcb2d5c349ea","Type":"ContainerDied","Data":"db305b05f47d1e4334c3bcadef58065871f62b0fad3ea38f43f78c2fb2edfbb5"} Jun 05 00:00:03.168207 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:03.168203 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29676960-s64j6" Jun 05 00:00:03.168207 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:03.168220 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db305b05f47d1e4334c3bcadef58065871f62b0fad3ea38f43f78c2fb2edfbb5" Jun 05 00:00:35.867641 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:35.867597 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs\") pod \"network-metrics-daemon-kf8nr\" (UID: \"04667814-8f0e-4653-a2a1-0b2fd6431e61\") " pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 05 00:00:35.869912 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:35.869893 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04667814-8f0e-4653-a2a1-0b2fd6431e61-metrics-certs\") pod \"network-metrics-daemon-kf8nr\" (UID: \"04667814-8f0e-4653-a2a1-0b2fd6431e61\") " pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 05 00:00:35.933082 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:35.933054 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l52sk\"" Jun 05 00:00:35.940390 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:35.940373 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kf8nr" Jun 05 00:00:36.066158 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:36.066140 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kf8nr"] Jun 05 00:00:36.068423 ip-10-0-140-8 kubenswrapper[2564]: W0605 00:00:36.068392 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04667814_8f0e_4653_a2a1_0b2fd6431e61.slice/crio-80a6ed134fe502017226453192270bb5d8aacfd6f7227f96e37d6400f8381a8c WatchSource:0}: Error finding container 80a6ed134fe502017226453192270bb5d8aacfd6f7227f96e37d6400f8381a8c: Status 404 returned error can't find the container with id 80a6ed134fe502017226453192270bb5d8aacfd6f7227f96e37d6400f8381a8c Jun 05 00:00:36.070339 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:36.070320 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 00:00:36.308034 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:36.307998 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kf8nr" event={"ID":"04667814-8f0e-4653-a2a1-0b2fd6431e61","Type":"ContainerStarted","Data":"80a6ed134fe502017226453192270bb5d8aacfd6f7227f96e37d6400f8381a8c"} Jun 05 00:00:37.313204 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:37.313126 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kf8nr" event={"ID":"04667814-8f0e-4653-a2a1-0b2fd6431e61","Type":"ContainerStarted","Data":"ea8afd0b853396a85002eeb650e8c00fb386516a0e53cc82fe3788b23fefd866"} Jun 05 00:00:37.313204 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:37.313174 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kf8nr" event={"ID":"04667814-8f0e-4653-a2a1-0b2fd6431e61","Type":"ContainerStarted","Data":"5bd8a6747c01119b7fc69f0d8d8a28155cf65b1bd67b05f4c68acc1464c62f42"} Jun 05 00:00:37.337160 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:00:37.337108 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kf8nr" podStartSLOduration=374.381093475 podStartE2EDuration="6m15.337094511s" totalImagesPullingTime="956.001036ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 23:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 00:00:37.335481135 +0000 UTC m=+375.693049279" watchObservedRunningTime="2026-06-05 00:00:37.337094511 +0000 UTC m=+375.694662653" Jun 05 00:01:49.117557 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.117484 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r"] Jun 05 00:01:49.118011 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.117862 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f164c790-cbdf-42be-9a75-fcb2d5c349ea" containerName="image-pruner" Jun 05 00:01:49.118011 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.117874 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f164c790-cbdf-42be-9a75-fcb2d5c349ea" containerName="image-pruner" Jun 05 00:01:49.118011 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.117926 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f164c790-cbdf-42be-9a75-fcb2d5c349ea" containerName="image-pruner" Jun 05 00:01:49.120076 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.120056 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" Jun 05 00:01:49.122884 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.122866 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-njrg9\"" Jun 05 00:01:49.123158 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.123130 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 00:01:49.124340 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.124318 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 00:01:49.131764 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.131744 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r"] Jun 05 00:01:49.242327 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.242300 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h84p\" (UniqueName: \"kubernetes.io/projected/c422545d-af30-4c88-930e-5f0a75be0e2e-kube-api-access-4h84p\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r\" (UID: \"c422545d-af30-4c88-930e-5f0a75be0e2e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" Jun 05 00:01:49.242484 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.242341 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c422545d-af30-4c88-930e-5f0a75be0e2e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r\" (UID: \"c422545d-af30-4c88-930e-5f0a75be0e2e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" Jun 05 00:01:49.242484 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.242367 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c422545d-af30-4c88-930e-5f0a75be0e2e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r\" (UID: \"c422545d-af30-4c88-930e-5f0a75be0e2e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" Jun 05 00:01:49.342884 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.342853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h84p\" (UniqueName: \"kubernetes.io/projected/c422545d-af30-4c88-930e-5f0a75be0e2e-kube-api-access-4h84p\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r\" (UID: \"c422545d-af30-4c88-930e-5f0a75be0e2e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" Jun 05 00:01:49.343007 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.342900 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c422545d-af30-4c88-930e-5f0a75be0e2e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r\" (UID: \"c422545d-af30-4c88-930e-5f0a75be0e2e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" Jun 05 00:01:49.343050 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.343008 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c422545d-af30-4c88-930e-5f0a75be0e2e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r\" (UID: \"c422545d-af30-4c88-930e-5f0a75be0e2e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" Jun 05 00:01:49.343202 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.343184 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c422545d-af30-4c88-930e-5f0a75be0e2e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r\" (UID: \"c422545d-af30-4c88-930e-5f0a75be0e2e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" Jun 05 00:01:49.343353 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.343332 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c422545d-af30-4c88-930e-5f0a75be0e2e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r\" (UID: \"c422545d-af30-4c88-930e-5f0a75be0e2e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" Jun 05 00:01:49.351285 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.351257 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h84p\" (UniqueName: \"kubernetes.io/projected/c422545d-af30-4c88-930e-5f0a75be0e2e-kube-api-access-4h84p\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r\" (UID: \"c422545d-af30-4c88-930e-5f0a75be0e2e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" Jun 05 00:01:49.431245 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.431223 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" Jun 05 00:01:49.557129 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.557105 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r"] Jun 05 00:01:49.559788 ip-10-0-140-8 kubenswrapper[2564]: W0605 00:01:49.559754 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc422545d_af30_4c88_930e_5f0a75be0e2e.slice/crio-31e1bdcd58bf3eface135d39466251f7722041918163cae13fc6cab83662b5d0 WatchSource:0}: Error finding container 31e1bdcd58bf3eface135d39466251f7722041918163cae13fc6cab83662b5d0: Status 404 returned error can't find the container with id 31e1bdcd58bf3eface135d39466251f7722041918163cae13fc6cab83662b5d0 Jun 05 00:01:49.595813 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:49.595787 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" event={"ID":"c422545d-af30-4c88-930e-5f0a75be0e2e","Type":"ContainerStarted","Data":"31e1bdcd58bf3eface135d39466251f7722041918163cae13fc6cab83662b5d0"} Jun 05 00:01:57.630941 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:57.630906 2564 generic.go:356] "Generic (PLEG): container finished" podID="c422545d-af30-4c88-930e-5f0a75be0e2e" containerID="3671c0a449556635d7477f3ccbf7bd3021a8c27312cd8cbca12ef2ef77aad292" exitCode=0 Jun 05 00:01:57.631372 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:01:57.630941 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" event={"ID":"c422545d-af30-4c88-930e-5f0a75be0e2e","Type":"ContainerDied","Data":"3671c0a449556635d7477f3ccbf7bd3021a8c27312cd8cbca12ef2ef77aad292"} Jun 05 00:02:00.645291 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:00.645259 2564 generic.go:356] "Generic (PLEG): container finished" podID="c422545d-af30-4c88-930e-5f0a75be0e2e" containerID="2308de089224ad1f489e24544199dd224e93563320a117fd8f3f39f913c37630" exitCode=0 Jun 05 00:02:00.645736 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:00.645346 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" event={"ID":"c422545d-af30-4c88-930e-5f0a75be0e2e","Type":"ContainerDied","Data":"2308de089224ad1f489e24544199dd224e93563320a117fd8f3f39f913c37630"} Jun 05 00:02:08.689140 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:08.689106 2564 generic.go:356] "Generic (PLEG): container finished" podID="c422545d-af30-4c88-930e-5f0a75be0e2e" containerID="0cb93d964f863ca2e621d0492af8548f2bd557b10d623ac1b38a1573a3ccd7c3" exitCode=0 Jun 05 00:02:08.689536 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:08.689193 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" event={"ID":"c422545d-af30-4c88-930e-5f0a75be0e2e","Type":"ContainerDied","Data":"0cb93d964f863ca2e621d0492af8548f2bd557b10d623ac1b38a1573a3ccd7c3"} Jun 05 00:02:09.818845 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:09.818821 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" Jun 05 00:02:09.892624 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:09.892596 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c422545d-af30-4c88-930e-5f0a75be0e2e-bundle\") pod \"c422545d-af30-4c88-930e-5f0a75be0e2e\" (UID: \"c422545d-af30-4c88-930e-5f0a75be0e2e\") " Jun 05 00:02:09.892772 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:09.892650 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c422545d-af30-4c88-930e-5f0a75be0e2e-util\") pod \"c422545d-af30-4c88-930e-5f0a75be0e2e\" (UID: \"c422545d-af30-4c88-930e-5f0a75be0e2e\") " Jun 05 00:02:09.892772 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:09.892718 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h84p\" (UniqueName: \"kubernetes.io/projected/c422545d-af30-4c88-930e-5f0a75be0e2e-kube-api-access-4h84p\") pod \"c422545d-af30-4c88-930e-5f0a75be0e2e\" (UID: \"c422545d-af30-4c88-930e-5f0a75be0e2e\") " Jun 05 00:02:09.893280 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:09.893254 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c422545d-af30-4c88-930e-5f0a75be0e2e-bundle" (OuterVolumeSpecName: "bundle") pod "c422545d-af30-4c88-930e-5f0a75be0e2e" (UID: "c422545d-af30-4c88-930e-5f0a75be0e2e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 00:02:09.894803 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:09.894777 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c422545d-af30-4c88-930e-5f0a75be0e2e-kube-api-access-4h84p" (OuterVolumeSpecName: "kube-api-access-4h84p") pod "c422545d-af30-4c88-930e-5f0a75be0e2e" (UID: "c422545d-af30-4c88-930e-5f0a75be0e2e"). InnerVolumeSpecName "kube-api-access-4h84p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 00:02:09.897483 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:09.897457 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c422545d-af30-4c88-930e-5f0a75be0e2e-util" (OuterVolumeSpecName: "util") pod "c422545d-af30-4c88-930e-5f0a75be0e2e" (UID: "c422545d-af30-4c88-930e-5f0a75be0e2e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 00:02:09.993858 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:09.993783 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h84p\" (UniqueName: \"kubernetes.io/projected/c422545d-af30-4c88-930e-5f0a75be0e2e-kube-api-access-4h84p\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 05 00:02:09.993858 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:09.993809 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c422545d-af30-4c88-930e-5f0a75be0e2e-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 05 00:02:09.993858 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:09.993821 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c422545d-af30-4c88-930e-5f0a75be0e2e-util\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 05 00:02:10.702488 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:10.702451 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" event={"ID":"c422545d-af30-4c88-930e-5f0a75be0e2e","Type":"ContainerDied","Data":"31e1bdcd58bf3eface135d39466251f7722041918163cae13fc6cab83662b5d0"} Jun 05 00:02:10.702661 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:10.702512 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31e1bdcd58bf3eface135d39466251f7722041918163cae13fc6cab83662b5d0" Jun 05 00:02:10.702661 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:10.702462 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dx4b8r" Jun 05 00:02:17.141946 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.141914 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-f56bc759d-ws6hc"] Jun 05 00:02:17.142372 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.142224 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c422545d-af30-4c88-930e-5f0a75be0e2e" containerName="pull" Jun 05 00:02:17.142372 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.142235 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c422545d-af30-4c88-930e-5f0a75be0e2e" containerName="pull" Jun 05 00:02:17.142372 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.142248 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c422545d-af30-4c88-930e-5f0a75be0e2e" containerName="util" Jun 05 00:02:17.142372 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.142254 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c422545d-af30-4c88-930e-5f0a75be0e2e" containerName="util" Jun 05 00:02:17.142372 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.142272 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c422545d-af30-4c88-930e-5f0a75be0e2e" containerName="extract" Jun 05 00:02:17.142372 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.142278 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c422545d-af30-4c88-930e-5f0a75be0e2e" containerName="extract" Jun 05 00:02:17.142372 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.142332 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c422545d-af30-4c88-930e-5f0a75be0e2e" containerName="extract" Jun 05 00:02:17.144138 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.144122 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-f56bc759d-ws6hc" Jun 05 00:02:17.146791 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.146769 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fk6k4\"" Jun 05 00:02:17.146791 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.146782 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 05 00:02:17.146982 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.146896 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 05 00:02:17.157825 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.157802 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-f56bc759d-ws6hc"] Jun 05 00:02:17.250253 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.250079 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7a5c9ed-6a69-4a94-9f01-07ed761f353d-tmp\") pod \"cert-manager-operator-controller-manager-f56bc759d-ws6hc\" (UID: \"e7a5c9ed-6a69-4a94-9f01-07ed761f353d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-f56bc759d-ws6hc" Jun 05 00:02:17.250253 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.250222 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h9dz\" (UniqueName: \"kubernetes.io/projected/e7a5c9ed-6a69-4a94-9f01-07ed761f353d-kube-api-access-8h9dz\") pod \"cert-manager-operator-controller-manager-f56bc759d-ws6hc\" (UID: \"e7a5c9ed-6a69-4a94-9f01-07ed761f353d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-f56bc759d-ws6hc" Jun 05 00:02:17.350929 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.350898 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7a5c9ed-6a69-4a94-9f01-07ed761f353d-tmp\") pod \"cert-manager-operator-controller-manager-f56bc759d-ws6hc\" (UID: \"e7a5c9ed-6a69-4a94-9f01-07ed761f353d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-f56bc759d-ws6hc" Jun 05 00:02:17.351087 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.350977 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h9dz\" (UniqueName: \"kubernetes.io/projected/e7a5c9ed-6a69-4a94-9f01-07ed761f353d-kube-api-access-8h9dz\") pod \"cert-manager-operator-controller-manager-f56bc759d-ws6hc\" (UID: \"e7a5c9ed-6a69-4a94-9f01-07ed761f353d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-f56bc759d-ws6hc" Jun 05 00:02:17.351297 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.351280 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7a5c9ed-6a69-4a94-9f01-07ed761f353d-tmp\") pod \"cert-manager-operator-controller-manager-f56bc759d-ws6hc\" (UID: \"e7a5c9ed-6a69-4a94-9f01-07ed761f353d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-f56bc759d-ws6hc" Jun 05 00:02:17.359288 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.359265 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h9dz\" (UniqueName: \"kubernetes.io/projected/e7a5c9ed-6a69-4a94-9f01-07ed761f353d-kube-api-access-8h9dz\") pod \"cert-manager-operator-controller-manager-f56bc759d-ws6hc\" (UID: \"e7a5c9ed-6a69-4a94-9f01-07ed761f353d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-f56bc759d-ws6hc" Jun 05 00:02:17.453222 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.453153 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-f56bc759d-ws6hc" Jun 05 00:02:17.587458 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.587434 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-f56bc759d-ws6hc"] Jun 05 00:02:17.589150 ip-10-0-140-8 kubenswrapper[2564]: W0605 00:02:17.589121 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7a5c9ed_6a69_4a94_9f01_07ed761f353d.slice/crio-5c85d0c260005b003f4ef968e3435c43213da4e31e547a4ca76778e43b1ecc8f WatchSource:0}: Error finding container 5c85d0c260005b003f4ef968e3435c43213da4e31e547a4ca76778e43b1ecc8f: Status 404 returned error can't find the container with id 5c85d0c260005b003f4ef968e3435c43213da4e31e547a4ca76778e43b1ecc8f Jun 05 00:02:17.734218 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:17.734141 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-f56bc759d-ws6hc" event={"ID":"e7a5c9ed-6a69-4a94-9f01-07ed761f353d","Type":"ContainerStarted","Data":"5c85d0c260005b003f4ef968e3435c43213da4e31e547a4ca76778e43b1ecc8f"} Jun 05 00:02:19.745701 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:19.745586 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-f56bc759d-ws6hc" event={"ID":"e7a5c9ed-6a69-4a94-9f01-07ed761f353d","Type":"ContainerStarted","Data":"7da237e29155a6f2a0ccc16c268e42a949f8b9012c25c0ed8d23c9985b744962"} Jun 05 00:02:19.768658 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:19.768601 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-f56bc759d-ws6hc" podStartSLOduration=0.93788866 podStartE2EDuration="2.768582971s" totalImagesPullingTime="1.830694311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 00:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 00:02:19.765025867 +0000 UTC m=+478.122594010" watchObservedRunningTime="2026-06-05 00:02:19.768582971 +0000 UTC m=+478.126151115" Jun 05 00:02:22.929654 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:22.929618 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-khpds"] Jun 05 00:02:22.932215 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:22.932190 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-khpds" Jun 05 00:02:22.935022 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:22.935003 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 05 00:02:22.936307 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:22.936288 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 05 00:02:22.936484 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:22.936472 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-pwh7t\"" Jun 05 00:02:22.943589 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:22.943568 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-khpds"] Jun 05 00:02:22.995848 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:22.995824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/18ea03d7-e12b-4530-b9d3-fd92184530c0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-khpds\" (UID: \"18ea03d7-e12b-4530-b9d3-fd92184530c0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-khpds" Jun 05 00:02:22.995957 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:22.995874 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdrzp\" (UniqueName: \"kubernetes.io/projected/18ea03d7-e12b-4530-b9d3-fd92184530c0-kube-api-access-kdrzp\") pod \"cert-manager-webhook-7dc76cbb94-khpds\" (UID: \"18ea03d7-e12b-4530-b9d3-fd92184530c0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-khpds" Jun 05 00:02:23.097033 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:23.097009 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdrzp\" (UniqueName: \"kubernetes.io/projected/18ea03d7-e12b-4530-b9d3-fd92184530c0-kube-api-access-kdrzp\") pod \"cert-manager-webhook-7dc76cbb94-khpds\" (UID: \"18ea03d7-e12b-4530-b9d3-fd92184530c0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-khpds" Jun 05 00:02:23.097111 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:23.097066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/18ea03d7-e12b-4530-b9d3-fd92184530c0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-khpds\" (UID: \"18ea03d7-e12b-4530-b9d3-fd92184530c0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-khpds" Jun 05 00:02:23.105833 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:23.105803 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/18ea03d7-e12b-4530-b9d3-fd92184530c0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-khpds\" (UID: \"18ea03d7-e12b-4530-b9d3-fd92184530c0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-khpds" Jun 05 00:02:23.105943 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:23.105928 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdrzp\" (UniqueName: \"kubernetes.io/projected/18ea03d7-e12b-4530-b9d3-fd92184530c0-kube-api-access-kdrzp\") pod \"cert-manager-webhook-7dc76cbb94-khpds\" (UID: \"18ea03d7-e12b-4530-b9d3-fd92184530c0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-khpds" Jun 05 00:02:23.256698 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:23.256623 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-khpds" Jun 05 00:02:23.379549 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:23.379524 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-khpds"] Jun 05 00:02:23.381477 ip-10-0-140-8 kubenswrapper[2564]: W0605 00:02:23.381445 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18ea03d7_e12b_4530_b9d3_fd92184530c0.slice/crio-31f1bfa09c45d7279e46e3203ca87289025d9736cd874e8c7065ae4733bd8e8a WatchSource:0}: Error finding container 31f1bfa09c45d7279e46e3203ca87289025d9736cd874e8c7065ae4733bd8e8a: Status 404 returned error can't find the container with id 31f1bfa09c45d7279e46e3203ca87289025d9736cd874e8c7065ae4733bd8e8a Jun 05 00:02:23.764754 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:23.764724 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-khpds" event={"ID":"18ea03d7-e12b-4530-b9d3-fd92184530c0","Type":"ContainerStarted","Data":"31f1bfa09c45d7279e46e3203ca87289025d9736cd874e8c7065ae4733bd8e8a"} Jun 05 00:02:25.775885 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:25.775855 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-khpds" event={"ID":"18ea03d7-e12b-4530-b9d3-fd92184530c0","Type":"ContainerStarted","Data":"3af3b8e355b7825c89bbfc293f13859c6282ceb6ad4e91f34fc87a36ad4e1caa"} Jun 05 00:02:25.776234 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:25.775984 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-khpds" Jun 05 00:02:25.790979 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:25.790938 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-khpds" podStartSLOduration=1.476119974 podStartE2EDuration="3.790918671s" totalImagesPullingTime="2.314798697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 00:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 00:02:25.790282978 +0000 UTC m=+484.147851139" watchObservedRunningTime="2026-06-05 00:02:25.790918671 +0000 UTC m=+484.148486800" Jun 05 00:02:31.782778 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:31.782748 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-khpds" Jun 05 00:02:41.099080 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:41.099045 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-fwvmb"] Jun 05 00:02:41.117172 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:41.117138 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-fwvmb"] Jun 05 00:02:41.117330 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:41.117222 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-fwvmb" Jun 05 00:02:41.119963 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:41.119939 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6gb86\"" Jun 05 00:02:41.233644 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:41.233611 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0bff8445-c60d-4d74-9353-690f56ad0ca2-bound-sa-token\") pod \"cert-manager-59c77684cc-fwvmb\" (UID: \"0bff8445-c60d-4d74-9353-690f56ad0ca2\") " pod="cert-manager/cert-manager-59c77684cc-fwvmb" Jun 05 00:02:41.233644 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:41.233653 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzn75\" (UniqueName: \"kubernetes.io/projected/0bff8445-c60d-4d74-9353-690f56ad0ca2-kube-api-access-fzn75\") pod \"cert-manager-59c77684cc-fwvmb\" (UID: \"0bff8445-c60d-4d74-9353-690f56ad0ca2\") " pod="cert-manager/cert-manager-59c77684cc-fwvmb" Jun 05 00:02:41.334689 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:41.334655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0bff8445-c60d-4d74-9353-690f56ad0ca2-bound-sa-token\") pod \"cert-manager-59c77684cc-fwvmb\" (UID: \"0bff8445-c60d-4d74-9353-690f56ad0ca2\") " pod="cert-manager/cert-manager-59c77684cc-fwvmb" Jun 05 00:02:41.334826 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:41.334723 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzn75\" (UniqueName: \"kubernetes.io/projected/0bff8445-c60d-4d74-9353-690f56ad0ca2-kube-api-access-fzn75\") pod \"cert-manager-59c77684cc-fwvmb\" (UID: \"0bff8445-c60d-4d74-9353-690f56ad0ca2\") " pod="cert-manager/cert-manager-59c77684cc-fwvmb" Jun 05 00:02:41.342647 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:41.342616 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0bff8445-c60d-4d74-9353-690f56ad0ca2-bound-sa-token\") pod \"cert-manager-59c77684cc-fwvmb\" (UID: \"0bff8445-c60d-4d74-9353-690f56ad0ca2\") " pod="cert-manager/cert-manager-59c77684cc-fwvmb" Jun 05 00:02:41.342774 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:41.342727 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzn75\" (UniqueName: \"kubernetes.io/projected/0bff8445-c60d-4d74-9353-690f56ad0ca2-kube-api-access-fzn75\") pod \"cert-manager-59c77684cc-fwvmb\" (UID: \"0bff8445-c60d-4d74-9353-690f56ad0ca2\") " pod="cert-manager/cert-manager-59c77684cc-fwvmb" Jun 05 00:02:41.426463 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:41.426442 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-fwvmb" Jun 05 00:02:41.566563 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:41.566541 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-fwvmb"] Jun 05 00:02:41.568462 ip-10-0-140-8 kubenswrapper[2564]: W0605 00:02:41.568430 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bff8445_c60d_4d74_9353_690f56ad0ca2.slice/crio-2838e060ebdebeb430043853e50eff71a2208a3450e5c37bbc2f0e83fa591450 WatchSource:0}: Error finding container 2838e060ebdebeb430043853e50eff71a2208a3450e5c37bbc2f0e83fa591450: Status 404 returned error can't find the container with id 2838e060ebdebeb430043853e50eff71a2208a3450e5c37bbc2f0e83fa591450 Jun 05 00:02:41.847187 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:41.847154 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-fwvmb" event={"ID":"0bff8445-c60d-4d74-9353-690f56ad0ca2","Type":"ContainerStarted","Data":"95f275e3bd7e034c83f6abf2c873e618b7014dbd16ba4777be27f62e473ee67e"} Jun 05 00:02:41.847329 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:41.847196 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-fwvmb" event={"ID":"0bff8445-c60d-4d74-9353-690f56ad0ca2","Type":"ContainerStarted","Data":"2838e060ebdebeb430043853e50eff71a2208a3450e5c37bbc2f0e83fa591450"} Jun 05 00:02:41.865329 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:41.865284 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-fwvmb" podStartSLOduration=0.865268226 podStartE2EDuration="865.268226ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 00:02:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 00:02:41.863049177 +0000 UTC m=+500.220617320" watchObservedRunningTime="2026-06-05 00:02:41.865268226 +0000 UTC m=+500.222836369" Jun 05 00:02:42.229527 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.229493 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz"] Jun 05 00:02:42.251615 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.251586 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz"] Jun 05 00:02:42.251783 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.251714 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" Jun 05 00:02:42.254509 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.254488 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 00:02:42.254642 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.254489 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-njrg9\"" Jun 05 00:02:42.254642 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.254489 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 00:02:42.344296 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.344267 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7j8b\" (UniqueName: \"kubernetes.io/projected/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-kube-api-access-m7j8b\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz\" (UID: \"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" Jun 05 00:02:42.344415 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.344317 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz\" (UID: \"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" Jun 05 00:02:42.344415 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.344365 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz\" (UID: \"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" Jun 05 00:02:42.445536 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.445515 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7j8b\" (UniqueName: \"kubernetes.io/projected/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-kube-api-access-m7j8b\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz\" (UID: \"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" Jun 05 00:02:42.445658 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.445552 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz\" (UID: \"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" Jun 05 00:02:42.445658 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.445574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz\" (UID: \"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" Jun 05 00:02:42.445934 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.445912 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz\" (UID: \"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" Jun 05 00:02:42.445989 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.445944 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz\" (UID: \"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" Jun 05 00:02:42.453620 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.453601 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7j8b\" (UniqueName: \"kubernetes.io/projected/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-kube-api-access-m7j8b\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz\" (UID: \"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" Jun 05 00:02:42.560851 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.560796 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" Jun 05 00:02:42.685728 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.685704 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz"] Jun 05 00:02:42.687996 ip-10-0-140-8 kubenswrapper[2564]: W0605 00:02:42.687971 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77b55d0_58f6_4d17_ba33_d4b75e8a92dc.slice/crio-cf41328e1bb4dba69b833d27ced792770a88313c8de5dc4cf0a6ee48873d0c6f WatchSource:0}: Error finding container cf41328e1bb4dba69b833d27ced792770a88313c8de5dc4cf0a6ee48873d0c6f: Status 404 returned error can't find the container with id cf41328e1bb4dba69b833d27ced792770a88313c8de5dc4cf0a6ee48873d0c6f Jun 05 00:02:42.852834 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.852775 2564 generic.go:356] "Generic (PLEG): container finished" podID="a77b55d0-58f6-4d17-ba33-d4b75e8a92dc" containerID="ca05442350cf8da30aa09de76ad803b9b12c8fdeedc24234c3b72e7f4146fa2b" exitCode=0 Jun 05 00:02:42.852928 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.852822 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" event={"ID":"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc","Type":"ContainerDied","Data":"ca05442350cf8da30aa09de76ad803b9b12c8fdeedc24234c3b72e7f4146fa2b"} Jun 05 00:02:42.852928 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:42.852874 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" event={"ID":"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc","Type":"ContainerStarted","Data":"cf41328e1bb4dba69b833d27ced792770a88313c8de5dc4cf0a6ee48873d0c6f"} Jun 05 00:02:45.869993 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:45.869959 2564 generic.go:356] "Generic (PLEG): container finished" podID="a77b55d0-58f6-4d17-ba33-d4b75e8a92dc" containerID="651ec8e6c6e3a09575dffa7212fde4791020a07b9687cdc2b5915e59923ae43c" exitCode=0 Jun 05 00:02:45.870467 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:45.870042 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" event={"ID":"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc","Type":"ContainerDied","Data":"651ec8e6c6e3a09575dffa7212fde4791020a07b9687cdc2b5915e59923ae43c"} Jun 05 00:02:46.877042 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:46.877008 2564 generic.go:356] "Generic (PLEG): container finished" podID="a77b55d0-58f6-4d17-ba33-d4b75e8a92dc" containerID="336048e24029cf7483acc9a5c2c69257f919c0478c96f9161bfa45cd6411aba0" exitCode=0 Jun 05 00:02:46.877437 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:46.877050 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" event={"ID":"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc","Type":"ContainerDied","Data":"336048e24029cf7483acc9a5c2c69257f919c0478c96f9161bfa45cd6411aba0"} Jun 05 00:02:48.014040 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:48.014017 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" Jun 05 00:02:48.089639 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:48.089612 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7j8b\" (UniqueName: \"kubernetes.io/projected/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-kube-api-access-m7j8b\") pod \"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc\" (UID: \"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc\") " Jun 05 00:02:48.089787 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:48.089721 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-bundle\") pod \"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc\" (UID: \"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc\") " Jun 05 00:02:48.089787 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:48.089742 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-util\") pod \"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc\" (UID: \"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc\") " Jun 05 00:02:48.090123 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:48.090099 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-bundle" (OuterVolumeSpecName: "bundle") pod "a77b55d0-58f6-4d17-ba33-d4b75e8a92dc" (UID: "a77b55d0-58f6-4d17-ba33-d4b75e8a92dc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 00:02:48.091684 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:48.091649 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-kube-api-access-m7j8b" (OuterVolumeSpecName: "kube-api-access-m7j8b") pod "a77b55d0-58f6-4d17-ba33-d4b75e8a92dc" (UID: "a77b55d0-58f6-4d17-ba33-d4b75e8a92dc"). InnerVolumeSpecName "kube-api-access-m7j8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 00:02:48.095059 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:48.095040 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-util" (OuterVolumeSpecName: "util") pod "a77b55d0-58f6-4d17-ba33-d4b75e8a92dc" (UID: "a77b55d0-58f6-4d17-ba33-d4b75e8a92dc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 00:02:48.191070 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:48.191013 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 05 00:02:48.191070 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:48.191034 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-util\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 05 00:02:48.191070 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:48.191043 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7j8b\" (UniqueName: \"kubernetes.io/projected/a77b55d0-58f6-4d17-ba33-d4b75e8a92dc-kube-api-access-m7j8b\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 05 00:02:48.887171 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:48.887136 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" event={"ID":"a77b55d0-58f6-4d17-ba33-d4b75e8a92dc","Type":"ContainerDied","Data":"cf41328e1bb4dba69b833d27ced792770a88313c8de5dc4cf0a6ee48873d0c6f"} Jun 05 00:02:48.887171 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:48.887176 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78em7jwz" Jun 05 00:02:48.887369 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:48.887192 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf41328e1bb4dba69b833d27ced792770a88313c8de5dc4cf0a6ee48873d0c6f" Jun 05 00:02:54.191941 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.191906 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-wbxsl"] Jun 05 00:02:54.192289 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.192227 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77b55d0-58f6-4d17-ba33-d4b75e8a92dc" containerName="extract" Jun 05 00:02:54.192289 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.192238 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77b55d0-58f6-4d17-ba33-d4b75e8a92dc" containerName="extract" Jun 05 00:02:54.192289 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.192249 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77b55d0-58f6-4d17-ba33-d4b75e8a92dc" containerName="util" Jun 05 00:02:54.192289 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.192254 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77b55d0-58f6-4d17-ba33-d4b75e8a92dc" containerName="util" Jun 05 00:02:54.192289 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.192266 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77b55d0-58f6-4d17-ba33-d4b75e8a92dc" containerName="pull" Jun 05 00:02:54.192289 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.192273 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77b55d0-58f6-4d17-ba33-d4b75e8a92dc" containerName="pull" Jun 05 00:02:54.192467 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.192330 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a77b55d0-58f6-4d17-ba33-d4b75e8a92dc" containerName="extract" Jun 05 00:02:54.196447 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.196430 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-wbxsl" Jun 05 00:02:54.199139 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.199121 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jun 05 00:02:54.199234 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.199179 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jun 05 00:02:54.200581 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.200562 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-kfhfc\"" Jun 05 00:02:54.202660 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.202639 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-wbxsl"] Jun 05 00:02:54.339648 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.339625 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d1a7c69-e4a1-4ce3-a010-12a9699aac88-tmp\") pod \"jobset-operator-5bc45f897-wbxsl\" (UID: \"6d1a7c69-e4a1-4ce3-a010-12a9699aac88\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-wbxsl" Jun 05 00:02:54.339798 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.339686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z698r\" (UniqueName: \"kubernetes.io/projected/6d1a7c69-e4a1-4ce3-a010-12a9699aac88-kube-api-access-z698r\") pod \"jobset-operator-5bc45f897-wbxsl\" (UID: \"6d1a7c69-e4a1-4ce3-a010-12a9699aac88\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-wbxsl" Jun 05 00:02:54.440828 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.440802 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d1a7c69-e4a1-4ce3-a010-12a9699aac88-tmp\") pod \"jobset-operator-5bc45f897-wbxsl\" (UID: \"6d1a7c69-e4a1-4ce3-a010-12a9699aac88\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-wbxsl" Jun 05 00:02:54.440958 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.440852 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z698r\" (UniqueName: \"kubernetes.io/projected/6d1a7c69-e4a1-4ce3-a010-12a9699aac88-kube-api-access-z698r\") pod \"jobset-operator-5bc45f897-wbxsl\" (UID: \"6d1a7c69-e4a1-4ce3-a010-12a9699aac88\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-wbxsl" Jun 05 00:02:54.441210 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.441190 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d1a7c69-e4a1-4ce3-a010-12a9699aac88-tmp\") pod \"jobset-operator-5bc45f897-wbxsl\" (UID: \"6d1a7c69-e4a1-4ce3-a010-12a9699aac88\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-wbxsl" Jun 05 00:02:54.449347 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.449298 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z698r\" (UniqueName: \"kubernetes.io/projected/6d1a7c69-e4a1-4ce3-a010-12a9699aac88-kube-api-access-z698r\") pod \"jobset-operator-5bc45f897-wbxsl\" (UID: \"6d1a7c69-e4a1-4ce3-a010-12a9699aac88\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-wbxsl" Jun 05 00:02:54.506185 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.506160 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-wbxsl" Jun 05 00:02:54.634747 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.634654 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-wbxsl"] Jun 05 00:02:54.636176 ip-10-0-140-8 kubenswrapper[2564]: W0605 00:02:54.636127 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d1a7c69_e4a1_4ce3_a010_12a9699aac88.slice/crio-f9e56b2235358c4bb4236916b99665d9b7c7f3b423b9e1103f8a15dae3dab63e WatchSource:0}: Error finding container f9e56b2235358c4bb4236916b99665d9b7c7f3b423b9e1103f8a15dae3dab63e: Status 404 returned error can't find the container with id f9e56b2235358c4bb4236916b99665d9b7c7f3b423b9e1103f8a15dae3dab63e Jun 05 00:02:54.920547 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:54.920514 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-wbxsl" event={"ID":"6d1a7c69-e4a1-4ce3-a010-12a9699aac88","Type":"ContainerStarted","Data":"f9e56b2235358c4bb4236916b99665d9b7c7f3b423b9e1103f8a15dae3dab63e"} Jun 05 00:02:57.939364 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:57.939270 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-wbxsl" event={"ID":"6d1a7c69-e4a1-4ce3-a010-12a9699aac88","Type":"ContainerStarted","Data":"0e4ef584fdcd9abd304268ce068bda9f203e988b62f9088759373f25bf2cc69c"} Jun 05 00:02:57.956899 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:02:57.956854 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-wbxsl" podStartSLOduration=0.936550942 podStartE2EDuration="3.956839569s" totalImagesPullingTime="3.020288627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 00:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 00:02:57.954429822 +0000 UTC m=+516.311997964" watchObservedRunningTime="2026-06-05 00:02:57.956839569 +0000 UTC m=+516.314407711" Jun 05 00:04:22.023837 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:04:22.023809 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/ovn-acl-logging/0.log" Jun 05 00:04:22.024793 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:04:22.024775 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/ovn-acl-logging/0.log" Jun 05 00:09:22.052990 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:22.052965 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/ovn-acl-logging/0.log" Jun 05 00:09:22.054421 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:22.054400 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/ovn-acl-logging/0.log" Jun 05 00:09:54.361253 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:54.361218 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8ldtv/must-gather-whxvv"] Jun 05 00:09:54.364404 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:54.364388 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8ldtv/must-gather-whxvv" Jun 05 00:09:54.367147 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:54.367118 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8ldtv\"/\"openshift-service-ca.crt\"" Jun 05 00:09:54.368479 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:54.368434 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8ldtv\"/\"default-dockercfg-m7lcn\"" Jun 05 00:09:54.368479 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:54.368471 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8ldtv\"/\"kube-root-ca.crt\"" Jun 05 00:09:54.371186 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:54.371166 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8ldtv/must-gather-whxvv"] Jun 05 00:09:54.502975 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:54.502943 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptj9m\" (UniqueName: \"kubernetes.io/projected/b99d405b-63c2-4525-8ad6-ed6708ba05ad-kube-api-access-ptj9m\") pod \"must-gather-whxvv\" (UID: \"b99d405b-63c2-4525-8ad6-ed6708ba05ad\") " pod="openshift-must-gather-8ldtv/must-gather-whxvv" Jun 05 00:09:54.503128 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:54.503064 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b99d405b-63c2-4525-8ad6-ed6708ba05ad-must-gather-output\") pod \"must-gather-whxvv\" (UID: \"b99d405b-63c2-4525-8ad6-ed6708ba05ad\") " pod="openshift-must-gather-8ldtv/must-gather-whxvv" Jun 05 00:09:54.603395 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:54.603370 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptj9m\" (UniqueName: \"kubernetes.io/projected/b99d405b-63c2-4525-8ad6-ed6708ba05ad-kube-api-access-ptj9m\") pod \"must-gather-whxvv\" (UID: \"b99d405b-63c2-4525-8ad6-ed6708ba05ad\") " pod="openshift-must-gather-8ldtv/must-gather-whxvv" Jun 05 00:09:54.603553 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:54.603431 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b99d405b-63c2-4525-8ad6-ed6708ba05ad-must-gather-output\") pod \"must-gather-whxvv\" (UID: \"b99d405b-63c2-4525-8ad6-ed6708ba05ad\") " pod="openshift-must-gather-8ldtv/must-gather-whxvv" Jun 05 00:09:54.603761 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:54.603669 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b99d405b-63c2-4525-8ad6-ed6708ba05ad-must-gather-output\") pod \"must-gather-whxvv\" (UID: \"b99d405b-63c2-4525-8ad6-ed6708ba05ad\") " pod="openshift-must-gather-8ldtv/must-gather-whxvv" Jun 05 00:09:54.612999 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:54.612946 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptj9m\" (UniqueName: \"kubernetes.io/projected/b99d405b-63c2-4525-8ad6-ed6708ba05ad-kube-api-access-ptj9m\") pod \"must-gather-whxvv\" (UID: \"b99d405b-63c2-4525-8ad6-ed6708ba05ad\") " pod="openshift-must-gather-8ldtv/must-gather-whxvv" Jun 05 00:09:54.675029 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:54.674986 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8ldtv/must-gather-whxvv" Jun 05 00:09:54.803361 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:54.803330 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8ldtv/must-gather-whxvv"] Jun 05 00:09:54.806573 ip-10-0-140-8 kubenswrapper[2564]: W0605 00:09:54.806546 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb99d405b_63c2_4525_8ad6_ed6708ba05ad.slice/crio-e42b56c51b3183b2a134a472b64b788eea240697a01ba996ef9c0f2318d0c6aa WatchSource:0}: Error finding container e42b56c51b3183b2a134a472b64b788eea240697a01ba996ef9c0f2318d0c6aa: Status 404 returned error can't find the container with id e42b56c51b3183b2a134a472b64b788eea240697a01ba996ef9c0f2318d0c6aa Jun 05 00:09:54.808368 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:54.808351 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 00:09:54.820721 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:09:54.820668 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8ldtv/must-gather-whxvv" event={"ID":"b99d405b-63c2-4525-8ad6-ed6708ba05ad","Type":"ContainerStarted","Data":"e42b56c51b3183b2a134a472b64b788eea240697a01ba996ef9c0f2318d0c6aa"} Jun 05 00:10:00.867035 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:00.866996 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8ldtv/must-gather-whxvv" event={"ID":"b99d405b-63c2-4525-8ad6-ed6708ba05ad","Type":"ContainerStarted","Data":"a7a2ad641b9e7e90aa6a43d7435e632a348bd1cfd12a649e68906b3458366fbe"} Jun 05 00:10:01.875456 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:01.875420 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8ldtv/must-gather-whxvv" event={"ID":"b99d405b-63c2-4525-8ad6-ed6708ba05ad","Type":"ContainerStarted","Data":"b68cec99fb71cd36ee8cf85b22339465d8ca238d744c6ae7907dbd1c2604ab23"} Jun 05 00:10:46.110509 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:46.110475 2564 generic.go:356] "Generic (PLEG): container finished" podID="b99d405b-63c2-4525-8ad6-ed6708ba05ad" containerID="a7a2ad641b9e7e90aa6a43d7435e632a348bd1cfd12a649e68906b3458366fbe" exitCode=0 Jun 05 00:10:46.111055 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:46.110554 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8ldtv/must-gather-whxvv" event={"ID":"b99d405b-63c2-4525-8ad6-ed6708ba05ad","Type":"ContainerDied","Data":"a7a2ad641b9e7e90aa6a43d7435e632a348bd1cfd12a649e68906b3458366fbe"} Jun 05 00:10:46.111055 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:46.110960 2564 scope.go:117] "RemoveContainer" containerID="a7a2ad641b9e7e90aa6a43d7435e632a348bd1cfd12a649e68906b3458366fbe" Jun 05 00:10:46.606943 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:46.606907 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8ldtv_must-gather-whxvv_b99d405b-63c2-4525-8ad6-ed6708ba05ad/gather/0.log" Jun 05 00:10:49.949746 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:49.949694 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-258hw_1b04efb1-c48b-4cde-b23e-fcf4ecee8253/global-pull-secret-syncer/0.log" Jun 05 00:10:50.101625 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:50.101599 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-s5zd2_c455b1df-b214-4095-9eeb-fc421b4f1ace/konnectivity-agent/0.log" Jun 05 00:10:50.207108 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:50.207039 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-8.ec2.internal_98bac051df6d1eb92d9dcd6f09edbb90/haproxy/0.log" Jun 05 00:10:51.972866 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:51.972827 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-8ldtv/must-gather-whxvv"] Jun 05 00:10:51.973263 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:51.973031 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-8ldtv/must-gather-whxvv" podUID="b99d405b-63c2-4525-8ad6-ed6708ba05ad" containerName="copy" containerID="cri-o://b68cec99fb71cd36ee8cf85b22339465d8ca238d744c6ae7907dbd1c2604ab23" gracePeriod=2 Jun 05 00:10:51.979183 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:51.979160 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-8ldtv/must-gather-whxvv"] Jun 05 00:10:52.034487 ip-10-0-140-8 kubenswrapper[2564]: E0605 00:10:52.034457 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-whxvv\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-8ldtv\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="b99d405b-63c2-4525-8ad6-ed6708ba05ad" pod="openshift-must-gather-8ldtv/must-gather-whxvv" Jun 05 00:10:52.141722 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:52.141695 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8ldtv_must-gather-whxvv_b99d405b-63c2-4525-8ad6-ed6708ba05ad/copy/0.log" Jun 05 00:10:52.142220 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:52.142197 2564 generic.go:356] "Generic (PLEG): container finished" podID="b99d405b-63c2-4525-8ad6-ed6708ba05ad" containerID="b68cec99fb71cd36ee8cf85b22339465d8ca238d744c6ae7907dbd1c2604ab23" exitCode=143 Jun 05 00:10:52.209621 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:52.209600 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8ldtv_must-gather-whxvv_b99d405b-63c2-4525-8ad6-ed6708ba05ad/copy/0.log" Jun 05 00:10:52.211116 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:52.211100 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8ldtv/must-gather-whxvv" Jun 05 00:10:52.409937 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:52.409907 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b99d405b-63c2-4525-8ad6-ed6708ba05ad-must-gather-output\") pod \"b99d405b-63c2-4525-8ad6-ed6708ba05ad\" (UID: \"b99d405b-63c2-4525-8ad6-ed6708ba05ad\") " Jun 05 00:10:52.410073 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:52.409953 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptj9m\" (UniqueName: \"kubernetes.io/projected/b99d405b-63c2-4525-8ad6-ed6708ba05ad-kube-api-access-ptj9m\") pod \"b99d405b-63c2-4525-8ad6-ed6708ba05ad\" (UID: \"b99d405b-63c2-4525-8ad6-ed6708ba05ad\") " Jun 05 00:10:52.412017 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:52.411994 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b99d405b-63c2-4525-8ad6-ed6708ba05ad-kube-api-access-ptj9m" (OuterVolumeSpecName: "kube-api-access-ptj9m") pod "b99d405b-63c2-4525-8ad6-ed6708ba05ad" (UID: "b99d405b-63c2-4525-8ad6-ed6708ba05ad"). InnerVolumeSpecName "kube-api-access-ptj9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 00:10:52.412117 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:52.412015 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b99d405b-63c2-4525-8ad6-ed6708ba05ad-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "b99d405b-63c2-4525-8ad6-ed6708ba05ad" (UID: "b99d405b-63c2-4525-8ad6-ed6708ba05ad"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 00:10:52.510424 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:52.510394 2564 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b99d405b-63c2-4525-8ad6-ed6708ba05ad-must-gather-output\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 05 00:10:52.510424 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:52.510420 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptj9m\" (UniqueName: \"kubernetes.io/projected/b99d405b-63c2-4525-8ad6-ed6708ba05ad-kube-api-access-ptj9m\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 05 00:10:53.148455 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:53.148421 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8ldtv_must-gather-whxvv_b99d405b-63c2-4525-8ad6-ed6708ba05ad/copy/0.log" Jun 05 00:10:53.148892 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:53.148861 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8ldtv/must-gather-whxvv" Jun 05 00:10:53.148892 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:53.148883 2564 scope.go:117] "RemoveContainer" containerID="b68cec99fb71cd36ee8cf85b22339465d8ca238d744c6ae7907dbd1c2604ab23" Jun 05 00:10:53.157017 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:53.157000 2564 scope.go:117] "RemoveContainer" containerID="a7a2ad641b9e7e90aa6a43d7435e632a348bd1cfd12a649e68906b3458366fbe" Jun 05 00:10:54.035099 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:54.035068 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b99d405b-63c2-4525-8ad6-ed6708ba05ad" path="/var/lib/kubelet/pods/b99d405b-63c2-4525-8ad6-ed6708ba05ad/volumes" Jun 05 00:10:54.160112 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:54.160086 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-skht7_6c6c7626-fff6-4318-99f3-90c8474e1c7b/cluster-monitoring-operator/0.log" Jun 05 00:10:54.192531 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:54.192511 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-m6pqw_9e5f8872-c519-4d77-99c8-4765dc1faf1e/kube-state-metrics/0.log" Jun 05 00:10:54.218184 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:54.218165 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-m6pqw_9e5f8872-c519-4d77-99c8-4765dc1faf1e/kube-rbac-proxy-main/0.log" Jun 05 00:10:54.242417 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:54.242400 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-m6pqw_9e5f8872-c519-4d77-99c8-4765dc1faf1e/kube-rbac-proxy-self/0.log" Jun 05 00:10:54.548661 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:54.548632 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pz6j9_6b05c49b-f15c-475f-8bb1-a2bb43b2794a/node-exporter/0.log" Jun 05 00:10:54.574143 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:54.574123 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pz6j9_6b05c49b-f15c-475f-8bb1-a2bb43b2794a/kube-rbac-proxy/0.log" Jun 05 00:10:54.593832 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:54.593812 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pz6j9_6b05c49b-f15c-475f-8bb1-a2bb43b2794a/init-textfile/0.log" Jun 05 00:10:54.623933 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:54.623910 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-rpsvq_eaefd12f-37cf-44a6-b194-ef08c261ed6a/kube-rbac-proxy-main/0.log" Jun 05 00:10:54.645710 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:54.645690 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-rpsvq_eaefd12f-37cf-44a6-b194-ef08c261ed6a/kube-rbac-proxy-self/0.log" Jun 05 00:10:54.669706 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:54.669668 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-rpsvq_eaefd12f-37cf-44a6-b194-ef08c261ed6a/openshift-state-metrics/0.log" Jun 05 00:10:54.949887 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:54.949858 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-rp6sx_9299486b-b531-430e-9560-c8ea8353ebd1/prometheus-operator-admission-webhook/0.log" Jun 05 00:10:55.067281 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:55.067257 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d987d574-kcz9m_35ff4ea3-387b-4387-83a1-67485e9e2273/thanos-query/0.log" Jun 05 00:10:55.090602 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:55.090578 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d987d574-kcz9m_35ff4ea3-387b-4387-83a1-67485e9e2273/kube-rbac-proxy-web/0.log" Jun 05 00:10:55.113648 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:55.113630 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d987d574-kcz9m_35ff4ea3-387b-4387-83a1-67485e9e2273/kube-rbac-proxy/0.log" Jun 05 00:10:55.135279 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:55.135260 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d987d574-kcz9m_35ff4ea3-387b-4387-83a1-67485e9e2273/prom-label-proxy/0.log" Jun 05 00:10:55.159886 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:55.159864 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d987d574-kcz9m_35ff4ea3-387b-4387-83a1-67485e9e2273/kube-rbac-proxy-rules/0.log" Jun 05 00:10:55.191043 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:55.191020 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d987d574-kcz9m_35ff4ea3-387b-4387-83a1-67485e9e2273/kube-rbac-proxy-metrics/0.log" Jun 05 00:10:56.523293 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:56.523266 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-dzcsk_eaeb0029-3707-45ec-85c1-8b6e5f80b565/networking-console-plugin/0.log" Jun 05 00:10:57.405523 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.405493 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-5nvz9_a8e5b2f9-e25a-4877-b2fc-f0f75fa9e67b/download-server/0.log" Jun 05 00:10:57.726462 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.726381 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8"] Jun 05 00:10:57.726845 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.726750 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b99d405b-63c2-4525-8ad6-ed6708ba05ad" containerName="copy" Jun 05 00:10:57.726845 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.726766 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b99d405b-63c2-4525-8ad6-ed6708ba05ad" containerName="copy" Jun 05 00:10:57.726845 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.726785 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b99d405b-63c2-4525-8ad6-ed6708ba05ad" containerName="gather" Jun 05 00:10:57.726845 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.726793 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b99d405b-63c2-4525-8ad6-ed6708ba05ad" containerName="gather" Jun 05 00:10:57.727041 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.726880 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b99d405b-63c2-4525-8ad6-ed6708ba05ad" containerName="copy" Jun 05 00:10:57.727041 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.726892 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b99d405b-63c2-4525-8ad6-ed6708ba05ad" containerName="gather" Jun 05 00:10:57.731074 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.731056 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:57.733770 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.733747 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mzntn\"/\"openshift-service-ca.crt\"" Jun 05 00:10:57.733947 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.733934 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mzntn\"/\"default-dockercfg-xzfbw\"" Jun 05 00:10:57.735084 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.735071 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mzntn\"/\"kube-root-ca.crt\"" Jun 05 00:10:57.741503 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.741483 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8"] Jun 05 00:10:57.743067 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.743035 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a0dcd394-7e10-4c2b-8cd0-fe14e59dc602-podres\") pod \"perf-node-gather-daemonset-6x2f8\" (UID: \"a0dcd394-7e10-4c2b-8cd0-fe14e59dc602\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:57.743184 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.743081 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjk76\" (UniqueName: \"kubernetes.io/projected/a0dcd394-7e10-4c2b-8cd0-fe14e59dc602-kube-api-access-hjk76\") pod \"perf-node-gather-daemonset-6x2f8\" (UID: \"a0dcd394-7e10-4c2b-8cd0-fe14e59dc602\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:57.743235 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.743179 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0dcd394-7e10-4c2b-8cd0-fe14e59dc602-lib-modules\") pod \"perf-node-gather-daemonset-6x2f8\" (UID: \"a0dcd394-7e10-4c2b-8cd0-fe14e59dc602\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:57.743276 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.743230 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0dcd394-7e10-4c2b-8cd0-fe14e59dc602-sys\") pod \"perf-node-gather-daemonset-6x2f8\" (UID: \"a0dcd394-7e10-4c2b-8cd0-fe14e59dc602\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:57.743276 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.743254 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a0dcd394-7e10-4c2b-8cd0-fe14e59dc602-proc\") pod \"perf-node-gather-daemonset-6x2f8\" (UID: \"a0dcd394-7e10-4c2b-8cd0-fe14e59dc602\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:57.844394 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.844364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0dcd394-7e10-4c2b-8cd0-fe14e59dc602-lib-modules\") pod \"perf-node-gather-daemonset-6x2f8\" (UID: \"a0dcd394-7e10-4c2b-8cd0-fe14e59dc602\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:57.844532 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.844404 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0dcd394-7e10-4c2b-8cd0-fe14e59dc602-sys\") pod \"perf-node-gather-daemonset-6x2f8\" (UID: \"a0dcd394-7e10-4c2b-8cd0-fe14e59dc602\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:57.844532 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.844421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a0dcd394-7e10-4c2b-8cd0-fe14e59dc602-proc\") pod \"perf-node-gather-daemonset-6x2f8\" (UID: \"a0dcd394-7e10-4c2b-8cd0-fe14e59dc602\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:57.844532 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.844482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a0dcd394-7e10-4c2b-8cd0-fe14e59dc602-podres\") pod \"perf-node-gather-daemonset-6x2f8\" (UID: \"a0dcd394-7e10-4c2b-8cd0-fe14e59dc602\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:57.844532 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.844503 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0dcd394-7e10-4c2b-8cd0-fe14e59dc602-sys\") pod \"perf-node-gather-daemonset-6x2f8\" (UID: \"a0dcd394-7e10-4c2b-8cd0-fe14e59dc602\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:57.844532 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.844527 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjk76\" (UniqueName: \"kubernetes.io/projected/a0dcd394-7e10-4c2b-8cd0-fe14e59dc602-kube-api-access-hjk76\") pod \"perf-node-gather-daemonset-6x2f8\" (UID: \"a0dcd394-7e10-4c2b-8cd0-fe14e59dc602\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:57.844731 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.844531 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a0dcd394-7e10-4c2b-8cd0-fe14e59dc602-proc\") pod \"perf-node-gather-daemonset-6x2f8\" (UID: \"a0dcd394-7e10-4c2b-8cd0-fe14e59dc602\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:57.844731 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.844544 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0dcd394-7e10-4c2b-8cd0-fe14e59dc602-lib-modules\") pod \"perf-node-gather-daemonset-6x2f8\" (UID: \"a0dcd394-7e10-4c2b-8cd0-fe14e59dc602\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:57.844731 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.844564 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a0dcd394-7e10-4c2b-8cd0-fe14e59dc602-podres\") pod \"perf-node-gather-daemonset-6x2f8\" (UID: \"a0dcd394-7e10-4c2b-8cd0-fe14e59dc602\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:57.852687 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.852649 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjk76\" (UniqueName: \"kubernetes.io/projected/a0dcd394-7e10-4c2b-8cd0-fe14e59dc602-kube-api-access-hjk76\") pod \"perf-node-gather-daemonset-6x2f8\" (UID: \"a0dcd394-7e10-4c2b-8cd0-fe14e59dc602\") " pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:57.923662 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:57.923635 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-7bgkv_4e6ddfcc-cc4c-4752-9ad3-858254751fdb/volume-data-source-validator/0.log" Jun 05 00:10:58.042059 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:58.041988 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:58.167003 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:58.166879 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8"] Jun 05 00:10:58.170146 ip-10-0-140-8 kubenswrapper[2564]: W0605 00:10:58.170120 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda0dcd394_7e10_4c2b_8cd0_fe14e59dc602.slice/crio-5247131fbc9e33fb771205717d0e97e9c59b11cd7d375e05455b4332ef88576a WatchSource:0}: Error finding container 5247131fbc9e33fb771205717d0e97e9c59b11cd7d375e05455b4332ef88576a: Status 404 returned error can't find the container with id 5247131fbc9e33fb771205717d0e97e9c59b11cd7d375e05455b4332ef88576a Jun 05 00:10:58.836529 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:58.836499 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b4hcm_4ac9536e-706c-42b2-904f-a6facd64f42c/dns/0.log" Jun 05 00:10:58.859947 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:58.859926 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b4hcm_4ac9536e-706c-42b2-904f-a6facd64f42c/kube-rbac-proxy/0.log" Jun 05 00:10:58.959791 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:58.959767 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n29wb_54d5011b-d74d-4c1c-adef-cfd356716eb0/dns-node-resolver/0.log" Jun 05 00:10:59.180277 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:59.180244 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" event={"ID":"a0dcd394-7e10-4c2b-8cd0-fe14e59dc602","Type":"ContainerStarted","Data":"94de0cb4c6282c8cc4a6c3f7b5640f8b62db8e04ebe4d36ade96270fac41d6e9"} Jun 05 00:10:59.180436 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:59.180352 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" event={"ID":"a0dcd394-7e10-4c2b-8cd0-fe14e59dc602","Type":"ContainerStarted","Data":"5247131fbc9e33fb771205717d0e97e9c59b11cd7d375e05455b4332ef88576a"} Jun 05 00:10:59.180436 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:59.180387 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:10:59.197988 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:59.197875 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" podStartSLOduration=2.197860664 podStartE2EDuration="2.197860664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 00:10:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 00:10:59.197744876 +0000 UTC m=+997.555313013" watchObservedRunningTime="2026-06-05 00:10:59.197860664 +0000 UTC m=+997.555428808" Jun 05 00:10:59.373019 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:59.372992 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29676960-s64j6_f164c790-cbdf-42be-9a75-fcb2d5c349ea/image-pruner/0.log" Jun 05 00:10:59.492926 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:10:59.492853 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qdfkf_dd7ef963-f56f-424d-9065-a736675ad48a/node-ca/0.log" Jun 05 00:11:00.214797 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:00.214771 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b9b7767d7-cbxgf_475c2176-3c39-4fc5-bf77-2f749e41299b/router/0.log" Jun 05 00:11:00.602275 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:00.602197 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lhmvj_edb8cf8a-5d0d-4062-a351-88ea81fc8d12/serve-healthcheck-canary/0.log" Jun 05 00:11:00.948936 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:00.948905 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-dvmmp_68e34b59-7676-4501-a84c-40cb8b9ec3bc/insights-operator/1.log" Jun 05 00:11:00.949097 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:00.949055 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-dvmmp_68e34b59-7676-4501-a84c-40cb8b9ec3bc/insights-operator/0.log" Jun 05 00:11:00.970554 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:00.970530 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m9tkp_2514d1ca-d78b-4fd8-82c7-9880624aa843/kube-rbac-proxy/0.log" Jun 05 00:11:00.992613 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:00.992592 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m9tkp_2514d1ca-d78b-4fd8-82c7-9880624aa843/exporter/0.log" Jun 05 00:11:01.014385 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:01.014367 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m9tkp_2514d1ca-d78b-4fd8-82c7-9880624aa843/extractor/0.log" Jun 05 00:11:02.837041 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:02.837014 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-wbxsl_6d1a7c69-e4a1-4ce3-a010-12a9699aac88/jobset-operator/0.log" Jun 05 00:11:05.194982 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:05.194954 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mzntn/perf-node-gather-daemonset-6x2f8" Jun 05 00:11:05.940076 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:05.940046 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-4bqms_095776ef-0e75-42d4-ad07-7feea46b4dbd/migrator/0.log" Jun 05 00:11:05.960669 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:05.960645 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-4bqms_095776ef-0e75-42d4-ad07-7feea46b4dbd/graceful-termination/0.log" Jun 05 00:11:06.303032 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:06.302952 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-zbfhv_4d762fb3-d7c5-49e9-b799-f94c3f0e7807/kube-storage-version-migrator-operator/1.log" Jun 05 00:11:06.303659 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:06.303641 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-zbfhv_4d762fb3-d7c5-49e9-b799-f94c3f0e7807/kube-storage-version-migrator-operator/0.log" Jun 05 00:11:07.634799 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:07.634772 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k62wx_95208ebe-68e1-43e0-9ba0-5fe7fba6d15f/kube-multus-additional-cni-plugins/0.log" Jun 05 00:11:07.664388 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:07.664363 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k62wx_95208ebe-68e1-43e0-9ba0-5fe7fba6d15f/egress-router-binary-copy/0.log" Jun 05 00:11:07.686425 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:07.686406 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k62wx_95208ebe-68e1-43e0-9ba0-5fe7fba6d15f/cni-plugins/0.log" Jun 05 00:11:07.708388 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:07.708371 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k62wx_95208ebe-68e1-43e0-9ba0-5fe7fba6d15f/bond-cni-plugin/0.log" Jun 05 00:11:07.729707 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:07.729688 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k62wx_95208ebe-68e1-43e0-9ba0-5fe7fba6d15f/routeoverride-cni/0.log" Jun 05 00:11:07.750191 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:07.750141 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k62wx_95208ebe-68e1-43e0-9ba0-5fe7fba6d15f/whereabouts-cni-bincopy/0.log" Jun 05 00:11:07.770153 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:07.770136 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k62wx_95208ebe-68e1-43e0-9ba0-5fe7fba6d15f/whereabouts-cni/0.log" Jun 05 00:11:08.008913 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:08.008844 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rl4dv_87545838-85a4-4044-96cd-8a369a9a95ab/kube-multus/0.log" Jun 05 00:11:08.079824 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:08.079796 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kf8nr_04667814-8f0e-4653-a2a1-0b2fd6431e61/network-metrics-daemon/0.log" Jun 05 00:11:08.101233 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:08.101211 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kf8nr_04667814-8f0e-4653-a2a1-0b2fd6431e61/kube-rbac-proxy/0.log" Jun 05 00:11:09.401520 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:09.401495 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/ovn-controller/0.log" Jun 05 00:11:09.439292 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:09.439267 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/ovn-acl-logging/0.log" Jun 05 00:11:09.439414 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:09.439270 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/ovn-acl-logging/1.log" Jun 05 00:11:09.460856 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:09.460833 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/kube-rbac-proxy-node/0.log" Jun 05 00:11:09.482639 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:09.482614 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/kube-rbac-proxy-ovn-metrics/0.log" Jun 05 00:11:09.502903 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:09.502887 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/northd/0.log" Jun 05 00:11:09.523878 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:09.523855 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/nbdb/0.log" Jun 05 00:11:09.545425 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:09.545408 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/sbdb/0.log" Jun 05 00:11:09.584765 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:09.584737 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wjspd_0ab52123-f827-4255-8a84-49ff8208148f/ovnkube-controller/0.log" Jun 05 00:11:10.615926 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:10.615899 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-nb7vh_1b31f8cd-0950-4ab0-9058-a7e32d4a3c51/network-check-target-container/0.log" Jun 05 00:11:11.548320 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:11.548288 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-c84x5_6ca9e683-9c65-4e7d-8e1f-d668feb920bc/iptables-alerter/0.log" Jun 05 00:11:12.233969 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:12.233941 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-lgq2v_307b15de-f46b-41fd-a7ff-c9f455182572/tuned/0.log" Jun 05 00:11:13.915154 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:13.915126 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-ghlss_6cb78786-11af-4447-bb35-21ba1a7f0db7/cluster-samples-operator/0.log" Jun 05 00:11:13.930316 ip-10-0-140-8 kubenswrapper[2564]: I0605 00:11:13.930271 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-ghlss_6cb78786-11af-4447-bb35-21ba1a7f0db7/cluster-samples-operator-watch/0.log"